Abstract
The mesoscopic reaction-diffusion master equation (RDME) is a popular modeling framework frequently applied to stochastic reaction-diffusion kinetics in systems biology. The RDME is derived from assumptions about the underlying physical properties of the system, and it may produce unphysical results for models where those assumptions fail. In that case, other more comprehensive models are better suited, such as hard-sphere Brownian dynamics (BD). Although the RDME is a model in its own right, and not inferred from any specific microscale model, it proves useful to attempt to approximate a microscale model by a specific choice of mesoscopic reaction rates. In this paper we derive mesoscopic scale-dependent reaction rates by matching certain statistics of the RDME solution to statistics of the solution of a widely used microscopic BD model: the Smoluchowski model with a Robin boundary condition at the reaction radius of two molecules. We also establish fundamental limits on the range of mesh resolutions for which this approach yields accurate results and show both theoretically and in numerical examples that as we approach the lower fundamental limit, the mesoscopic dynamics approach the microscopic dynamics. We show that for mesh sizes below the fundamental lower limit, results are less accurate. Thus, the lower limit determines the mesh size for which we obtain the most accurate results.
I. INTRODUCTION
The reaction-diffusion master equation (RDME) is a commonly used mesoscopic model in the field of computational systems biology and it is a natural extension of the classical well-mixed Markov-process formalism for reaction kinetics [1]. Having a long history in the study of fluctuations in chemical reaction systems [2,3], recently it has been successfully applied to study diverse biological phenomena such as yeast polarization [4], pattern formation in Escherichia coli [5,6], and noisy oscillations of Hes1 in embryonic stem cells [7,8].
In the RDME framework, spatial heterogeneity is modeled by dividing space into voxels in a computational mesh, where molecules are assumed to be well mixed inside each voxel. In individual voxels, reactions are simulated using the stochastic simulation algorithm (SSA) [1], while diffusion is accounted for through discrete jumps of molecules between voxels. Discrete diffusion and well-mixed SSA are combined in the next subvolume method (NSM) [9], an efficient kinetic Monte Carlo method. For moderate mesh resolutions, simulations of the RDME are typically orders of magnitude faster than microscopic particle-tracking models, such as the popular Green’s function reaction dynamics (GFRD) algorithm [10–12]. This contributes to the popularity of the method for applications where the system of interest needs to be studied on the minute to hour time scales that are typical for cellular events like gene expression, signaling, and cell division. The RDME underlies software for spatial stochastic simulation such as MESORD [13], URDME [14], PYURDME (www.pyurdme.org), and STEPS [15].
Despite the proven usefulness of the RDME—and the extensive work put into speeding up simulations using approximate [16–18] and hybrid [19] methods, as well as extending it to include additional transport phenomena [20,21] and to simulate it on complex geometries [22,23]—its fundamental numerical properties and its ability to approximate microscopic particle-tracking models at high mesh resolution remains poorly understood. In order to discuss the accuracy of the RDME on small length and time scales, we need to specify a fine-scaled alternative as our gold standard. A microscale model often utilized for that purpose is the Smoluchowski model, in which particles are modeled by hard spheres that diffuse according to Brownian motion, and reactions are modeled by a partially absorbing boundary condition at the surface of the spheres. This model has a long history in chemical physics, going back to ideas by Smoluchowski [24]. In systems biology, the Smoluchowski model is being popularized through software packages such as E-CELL [25] and SMOLDYN [26]. This paper is concerned with the accuracy of the RDME when viewed as an approximation to the Smoluchowski model.
The principal way in which the mesoscale and the microscale are connected is through the mesoscopic bimolecular reaction constant. A classical result by Collins and Kimball [27] provides effective rates in terms of the microscopic, intrinsic, reaction parameters of the Smoluchowski model. When scaled by the volume of the voxels, they can be used as approximate mesoscale reaction rates in the RDME for simulations in three dimensions (3D). The same constant was derived more recently from first-principles physics by Gillespie [28]. The constant is valid when voxels are large in comparison to the molecules. Since, in the conventional implementation, reactions occur only between molecules occupying the same voxel, the average time until molecules react diverges with vanishing size of the voxels [29–31]. A consequence is a lower bound on the size of the voxels, below which no mesoscopic reaction rate can be chosen so the average reaction times match in the RDME and Smoluchowski models [31].
In previous work [31] we analyzed the scenario of a single, irreversible, bimolecular reaction on a Cartesian mesh. For the case of perfect absorption, we obtained analytical lower limits on the mesh size in both 2D and 3D. Above those limits, it is theoretically possible to construct a mesoscopic rate such that the mean binding time in the two models match. Below that critical mesh size, no such rate can be constructed. Hence, in the presence of bimolecular reactions, a fundamental limitation of the RDME results from the inherent bound on the accuracy to which we can represent diffusion. As a direct consequence of our previous analysis, we also obtained mesoscopic reaction rates which ensure that the mean binding time in the RDME matches that of the Smoluchowski model for an irreversible bimolecular reaction.
In this paper we extend our previous analysis. First, we study the case of reversible reactions and ask whether there are additional constraints on the admissible mesh sizes compared to the irreversible case. We derive a critical voxel size under the following three assumptions: (i) the average time until a reaction fires should match between mesoscopic and microscopic models, (ii) the steady-state levels should match, and (iii) the mesoscopic dissociation rate should be smaller than or equal to the intrinsic dissociation rate. The last condition is necessary for the dissociation to make physical sense, and if we are to match not only equilibrium distributions but also transient solutions. The result establishes the previously obtained critical voxel sizes—in the perfectly absorbing, irreversible, case—as a fundamental lower limit for the more general reversible case. Importantly, this means that there will be a nontrivial lower limit for the mesh size, independent of the intrinsic microscopic reaction parameters. We also study the accuracy of our reaction rates as compared to the Smoluchowski model and show good agreement, both at steady state and during the transient phase, between mesoscopic and microscopic simulations as the mesh size approaches the critical lower limit. In particular, we show how the multiscale propensities can provide a better mesoscopic approximation to a diffusion limited model of a MAPK cascade compared to the widely used propensities of Collins and Kimball [27]. It has not previously been possible to accurately simulate this model with a fully local RDME, although it has been simulated successfully with a nonlocal extension of the RDME [32] and using a hybrid microscale-mesoscale method [33].
For simplicity we have chosen not to write out units explicitly. We are using SI units throughout.
II. BACKGROUND
A system of N molecules of S different chemical species, diffusing and reacting inside a finite reaction volume, can be modeled at several different scales, and the accuracy of the different models depends on the properties of the system. In this section we briefly review the microscopic Smoluchowski model and the mesoscopic RDME model and discuss previous work on connecting the two models.
A. Microscopic scale: The Smoluchowski model
Several microscopic models have been proposed and studied in some detail [30,34,35]. We have chosen to focus on the Smoluchowski model, given the extensive attention it has received, for instance, in Refs. [10–12]. In the Smoluchowski framework, molecules are modeled as hard spheres. The radii of the spheres are referred to as the reaction radius of the molecules. The Smoluchowski equation, extended with a Robin boundary condition at the sum of the reaction radii, determines the probability of a reaction occurring between colliding molecules.
Let x1 and x2 be the positions of two molecules. Consider their relative position r = x1 − x2. The governing equation is given by
(1) |
where p(r,t|rn,tn) is the probability distribution function (PDF) of the relative position r at time t, given the relative position rn at time tn, and where D is the sum of the diffusion constants of the molecules. The boundary condition is given by
(2) |
where
(3) |
Here σ is the sum of the reaction radii of the molecules and kr is the microscopic, intrinsic, reaction rate. The initial condition is p(r,tn|rn,tn) = δ(r − rn).
To update a pair of molecules we solve for p(r,t|rn,tn) and then sample the new relative position at time t. Single molecules are updated by sampling from a normal distribution in all directions. The time until a dissociation is sampled from an exponential distribution and the resulting products are placed at a distance equal to σ. A system of N molecules becomes an N-body problem, and a direct solution is generally unattainable. Instead, we can simulate the system with the GFRD algorithm [10,11]. The core of the algorithm is a reduction of the problem to a collection of single- and two-body systems, accomplished through an appropriate restriction of the time step of the algorithm. In Ref. [33] the GFRD algorithm was extended to include complex boundaries, and in Ref. [12] improvements were suggested with the aim of making the algorithm more flexible and efficient.
The GFRD algorithm is efficient for dilute systems where the free space between molecules allows for an efficient grouping in pairs while using a relatively large time step, and the computational benefit over brute-force BD methods can be orders of magnitude. If the system contains some species that are present in higher copy numbers, or if a very high spatial resolution is not required, the mesoscopic RDME can in turn be orders of magnitude faster than GFRD.
B. Mesoscopic scale: The reaction-diffusion master equation
The RDME extends the classical well-mixed Markov-process model [1,36] to the spatial case by introducing a discretization of the domain into N nonoverlapping voxels [37]. Molecules are point particles and the state of the system is the discrete number of molecules of each of the species in each of the voxels. A common choice for the discretization is a uniform Cartesian lattice, where each voxel is a square with area h2 (2D) or a cube with volume h3 (3D). Simulations can also be conducted on unstructured triangular and tetrahedral meshes for better geometric flexibility [23]. The RDME is the forward Kolmogorov equation, governing the time evolution of the probability density of the system.
For brevity of notation, we write p(x,t) = p(x,t|x0,t0) for the probability that the system can be found in state x at time t, conditioned on the initial condition x0 at time t0. For a general reaction-diffusion system, the RDME can be written as
(4) |
where xi· denotes the i-th row and x·j denotes the j-th column of the K × S state matrix x, where S is the number of chemical species. The functions air(xi) define the propensities of the M chemical reactions and μir are stoichiometry vectors associated with the reactions. air(x) and μir have the same meaning as for a well-mixed system but are now defined for each of the voxels. dijk(xi) are propensities for the diffusion jump events, and νijk are stoichiometry vectors for diffusion events. νijk has only two nonzero entries, corresponding to the removal of one molecule of species Xk in voxel i and the addition of a molecule in voxel j. The RDME is too high dimensional to permit a direct solution. Instead, realizations of the stochastic process are sampled, using algorithms similar to the SSA but optimized for reaction-diffusion systems [9].
The propensity functions for the diffusion jumps, dijk, are selected to provide a consistent and local discretization of the diffusion equation or, equivalently, the Fokker-Planck equation for Brownian motion [38]. For a uniform Cartesian grid, a finite-difference discretization results in diffusion jumps with propensities
(5) |
where γs is the diffusion coefficient of Xs and dijs is nonzero only for adjacent voxels. For a triangular or tetrahedral unstructured mesh, finite-element or finite-volume discretizations result in propensities that account for the shape and size of each voxel [23]. With this model of diffusion, setting reactions aside, the solution of the RDME will, with vanishing voxel sizes, converge in probability to Brownian motion.
In the case of mass action kinetics, the propensity functions air(x) for bimolecular reactions take the form
(6) |
We will refer to as the mesoscopic association rate. In practical modeling work, is often obtained by fitting the model to some phenotypic experimental observation or provided directly as a macroscopic or mesoscopic model parameter obtained from experiments. If the association rate is instead given in terms of the microscopic reaction rate, kr, a result of Collins and Kimball [27] provides the effective rate, kCK, of the system, which can be used for mesoscale simulations in 3D through , where
(7) |
Gillespie derives the same relation by applying classical results from gas kinetics and calls it the diffusional propensity function [28]. From Gillespie’s physically rigorous derivation it is possible to relate the intrinsic reaction rate kr to fundamental physical constants.
A natural question, given model parameters and a mesh size, is how well a mesoscopic simulation can capture the microscale dynamics. It has been shown that the solution of the RDME diverges with respect to the Smoluchowski model [31,39]. Due to the point particle assumption, bimolecular reactions occur with successively lower probability, to eventually vanish in the limit of small voxels.
This means that there is a lower bound on the voxel size, below which bimolecular reactions cannot be accurately simulated in the RDME. There is also an upper bound on the voxel size, above which the reaction-diffusion dynamics will be insufficiently resolved. The question of how to choose the voxel size for sufficient accuracy has not yet been satisfactorily answered, but some attempts at establishing lower bounds on the voxel size have been made. A trivial bound on the voxel size follows from physical arguments [40]; the voxels must be large enough for the reacting molecules to remain dilute and well mixed inside the voxel. This condition translates to
(8) |
Apart from physical common sense, the above condition is an explicit assumption in the derivation of (7). Only if this assumption is valid can the rate constant (7) be expected to provide an accurate simulation with respect to the Smoluchowski model. Unfortunately, condition (8) offers little guidance on how to choose the mesh size in practice.
The reaction constant (7) depends on the microscopic parameters but not on the spatial discretization. By allowing the rate to depend on the mesh, and by matching certain properties of the microscopic model, it is possible to derive alternative forms for that perform better than (7) for diffusion limited systems and for fine meshes [31,32]. Those approaches also yield constants in 2D, where no expression based on a physical derivation is available. In Ref. [32] the rates are derived by matching the mean equilibration time of a reversible reaction on a spherical discretization. These rates are then used on Cartesian lattices.
Let be the mean binding time for two molecules in the Smoluchowski model in dimension d. In the case of a single irreversible association reaction on a uniform Cartesian discretization of a square or cube of side length L, Hellander et al. [31] showed that if the mesoscopic propensity is chosen as , where
(9) |
then the mean binding time on the mesoscopic scale will match the mean binding time in the Smoluchowski model. For kr → ∞, this is possible down to in 3D and in 2D. Below , the matching of the mean binding time will not be possible in the perfectly absorbing case. For simple geometries, such as a disk or a sphere, can be obtained analytically. For other geometries, provided that h ≪ L, the analytical result for a disk or a sphere with matching volume provides an excellent approximation. The analytical lower bounds on the voxel sizes are obtained by considering the extreme case of kr → ∞ and using the above-mentioned approximation for . In Ref. [30], based on another assumption not involving the microscopic Smoluchowski model, Erban and Chapman arrived at an expression in 3D that is similar to (9) and that establishes the same critical mesh size.
In what follows, we set out to expand on this theory with the aim of an improved understanding of the range of the mesh sizes for which the RDME will accurately approximate the Smoluchowski model. In particular, we derive critical mesh sizes for more realistic kinetics like reversible bimolecular reactions, and we show that under mild assumptions, the rates (9) are effectively independent of L. We also obtain error estimates that provide a way to estimate the needed mesh resolution to achieve a certain accuracy in the rebinding time distributions.
III. RESULTS
The case of a single irreversible reaction was studied in Ref. [31]. The analysis provided analytical lower bounds on the mesh size in 2D and 3D only for the case of kr → ∞ and reaction rates for matching mean association times. The reaction rates depended on the size L of the domain. As reactions occur locally in space, that dependence is not intuitive.
In this section we expand on that theory. First, we show that the reaction rates are independent of the size of the domain, under the assumption that the domain is much larger than the molecules. From this follows analytical lower bounds on the mesh size for the case of an irreversible reaction with 0 < kr ≤ ∞.
Second, we study a reversible reaction on a square or cubical domain and proceed to derive mesoscopic reaction rates under the following three assumptions: (i) the average reaction time should match between mesoscopic and microscopic models, (ii) the steady-state levels should match, and (iii) the intrinsic dissociation rate should be larger than or equal to the mesoscopic dissociation rate. Under these assumptions we derive a lower bound on the mesh size independent of the reaction rates.
We also show how the multiscale mesoscopic reaction rates behave in the limit of small voxels as well as in the limit of large voxels, effectively connecting the microscopic and mesoscopic scales. Finally, we provide error estimates that relate the mesh size to the error in rebinding-time distributions and show that the mean mesoscopic rebinding time approaches the mean microscopic rebinding time as the mesoscopic mesh size approaches the lower bound.
A. Irreversible reactions
The analytical expressions for the lower bounds on the voxel size h derived in Ref. [31] are valid for the case of irreversible reactions with perfect absorption. In this section we assume L ≫ σ to obtain analytical expressions for the lower bounds in the general case of kr > 0. We show that the reaction rates are independent of the size L of the domain, thus depending on local parameters only.
Theorem 1
Let ρ(d) be the mesoscopic reaction rate in dimension d, and assume that L ≫ σ. Then
(10) |
where d ∈ {2, 3}, and
(11) |
where
(12) |
Let
(13) |
Then ρ(d) is a well-defined reaction rate only for , and
(14) |
Proof
In Ref. [31], the reaction rate ρ(d) was derived under the assumption that L ≫ h. This effectively implies that L ≫ σ, since we have adopted the basic assumption (8). Let and be the mean association times for uniformly distributed particles in dimension d. While individual voxels may be too small for the Collins and Kimball approximation to be valid, the system as a whole may be well mixed and dilute. Thus, if we assume that L ≫ σ we can approximate the global mean reaction time by
which, when inserted into (9), yields
With kCK defined by (7), we obtain ρ(3) as in (10). Thus, for large-enough domains, the effect of the outer boundary is small in 3D, and the reaction rates are defined by local parameters only.
The situation in 2D is more complicated. In Ref. [32] they derive for a disk. Assuming L ≫ σ, this will provide an excellent estimate of in the case of a square. Thus
where
yields
For L ≫ σ we have 1 − λ2 ≈ 1 and 3 − λ2 ≈ 3. We then get
(15) |
By noting that
we find that we can rewrite (15) to obtain (10) also in the case of d = 2. Consequently, for L ≫ σ, the reaction rate defined by ρ(2) is approximately independent of the global parameter L.
Now (14) follows by noting that ρ(d) > 0 holds if and only if
(16) |
and then solving for h.
B. Reversible reactions
In this section we extend the analysis to the reversible case. We limit our considerations to the conventional RDME, thus allowing reactions only between molecules occupying the same voxel. The system consists of one A molecule and one B molecule, diffusing on a Cartesian lattice consisting of N voxels of width h, with periodic boundary conditions. The molecules react reversibly through the reaction
(17) |
Henceforth we assume that kr, the microscopic association rate, and kd, the microscopic dissociation rate, are given model parameters and that is defined by (10).
It remains to define . A plausible approach would be to match the steady-state levels of the species at the mesoscopic and microscopic scales. For a system of one A and one B molecule, the steady state is governed by the ratio of the average time the molecules are unbound to the total time. Thus, to match the steady state at the different scales, we choose such that
(18) |
where and are the respective times until an A and a B molecule rebind, given that they have just dissociated. The quantities and are the average times until a C molecule dissociates (thus and ).
We can compute analytically by expressing it in terms of the mean binding time . We note that the rebinding time is given by
(19) |
When the molecules have reached the same voxel, the system is in the same state as immediately following a dissociation. Thus, by subtracting from the total mean binding time the time it takes to reach the same voxel, we are left with the average rebinding time.
Expressions for are given in Ref. [31], and inserting them into (19) yields
(20) |
Unfortunately is not easily computed by analytical means (for general geometries), but by noting that, similarly as in the mesoscopic case, , we obtain the estimate
(21) |
for L ≫ σ. The argument is the same as for the mesoscopic case; represents the time until two molecules are in contact for the first time. By subtracting that time from the total time for the two molecules to react given a uniform initial distribution, we are left with the rebinding time. By using (20) and (21) in (18) it follows that
(22) |
which, after some simplifications, results in
(23) |
When rearranged, (23) can be recognized as the detailed balance condition. Maintaining this relation between the rate constants is sufficient to ensure that the equilibrium values of A and B are the same in the two models.
However, though we can match the mean association time as well as the equilibrium values for a given voxel size, we may have a mesoscopic dissociation rate that is faster than the microscopic dissociation rate. That would result in more dissociation events on the microscopic scale, and since the microscopic scale is assumed to be more fine grained, this is unphysical. This can be seen by considering that the inverse of the mesoscopic dissociation rate is a combination of the expected time for a complex to break apart and the time for the products to become well mixed by diffusion inside a voxel. The mesoscopic dissociation rate thus includes the possibility of fast microscopic rebinding events that occur before the molecules have become well mixed. Thus, while matching the mean association time and the equilibrium values of the molecules, we may end up with incorrect transient dynamics due to too-fast dissociations on the mesoscopic scale. The intrinsic microscopic dissociation rate is therefore an upper bound on the mesoscopic rate. As a consequence we want to determine for what size of h we can match the mean binding times while satisfying
(24) |
Theorem 2
The condition is satisfied if and only if the inequality
(25) |
holds for G(d)(h, σ) as defined in (11).
Let
Then is the smallest h for which we can satisfy as well as , and we have
(26) |
Proof
We obtain by using (23) in (24):
(27) |
which holds if and only if
(28) |
However, from (10) we have
Thus we find that (28) is equivalent to
(29) |
since (kr/D)G(d)(h, σ) < −1 is excluded by the condition ρ(d) > 0 as shown in (16). Since kr ≥ 0 and D > 0 (we do not consider the case D = 0 here), (25) follows.
We now observe that , and that, immediately from (10) and (13), it follows that . The last equality is an immediate consequence of (25), and we obtain (26).
In Fig. 1 we show how relates to .
C. Some limit cases
In this section we investigate the behavior of the reaction rate ρ(d)(kr, h) in some limit cases. We would expect ρ(3) to behave similarly to kCK for large voxels. In the limit of small voxels, it is of interest to see how the mesoscopic reaction rates relate to the microscopic reaction rates.
Corollary 1
For L/σ ≫ 1 we have
(30) |
Also, as h → ∞, with L/h constant and L/h ≫ 1, we have
(31) |
In the limit of kr/D → 0 we obtain
(32) |
In 3D, (32) implies that
(33) |
as kr/D → 0.
Proof
Since , (30) follows immediately. By noting that
we get (31) from some straightforward algebra. We obtain (32) immediately from (10). Finally, (33) follows from the fact that kCK → kr as kr → 0 or D → ∞.
In other words, as we approach the critical mesh size in the mesoscopic model, the mesoscopic rates approach the microscopic, intrinsic rates. For large voxels in 3D, we note that ρ(3), as expected, approaches kCK.
As an immediate consequence we have
Corollary 2
For L/σ ≫ 1 and , the following holds:
(34) |
Proof
The first approximation is proven in Corollary 1. Using in (23) we obtain . From (20) and (21) it then follows that .
For , we match the mean association time, dissociation time, and the mean rebinding time. For any h below , we cannot simultaneously match both the association and dissociation times. Consequently, the rebinding dynamics will be less accurately captured on the mesoscopic scale for than for .
In Fig. 2 we illustrate these limits in 3D for different values of the intrinsic reaction rate kr. The more diffusion limited the reaction is, the larger the discrepancy between ρ(3) and kCK becomes.
D. Error estimates
Given a system with known intrinsic reaction rates, we would ideally want to know how to choose the mesh size for sufficiently accurate mesoscopic simulations. While solving this is hard for a general system, we can choose the mesh size such that we limit the relative error in the average rebinding times. We do not guarantee an accurate mesoscopic solution by doing so, but if the error in the average rebinding time is large, and we have fine-grained dynamics that we wish to capture, we may have to reduce the voxel size to decrease the error.
Now consider a reversible reaction, with intrinsic reaction rates given by kr and kd.
Corollary 3
For a given error tolerance ε, the following holds:
(35) |
if and only if
(36) |
where
(37) |
Furthermore, for h ≤ F, we have
(38) |
In 2D we have
(39) |
In 3D, we obtain
(40) |
as
(41) |
For all h, it holds that
(42) |
in 3D.
Proof
Assume that
(43) |
holds. Using (10) we obtain
(44) |
From (29) we know that (kr/D)G(d) < 0, and thus (44) becomes
(45) |
Some straightforward algebra now yields
(46) |
By inserting G(d), for d = 2 and d = 3, into (46) and solving for h, we obtain (37).
We obtain (38) by noting that and and using that in (43) together with the observation that [1 − (1 − ε)−1] = −[ε + O(ε2)].
As an immediate consequence of (37) we obtain (39). We get (40) and (41) from (37) and by noting that
(47) |
as
(48) |
Finally, we get (42) immediately from (38) and (40) and (41).
We see that as the reactions become very diffusion limited, the difference between the mesoscopic and microscopic reaction rates can grow large, since kCK → 4πσD as kr → ∞. The less diffusion limited a reaction is, the closer the reaction rates will be (and the difference is bounded). This makes intuitive sense, since less diffusion-limited reactions mean that the system is more well mixed; thus the system can be accurately simulated on a coarser mesh.
In Sec. IVB we demonstrate how this theory can be applied to increase the understanding of the behavior of a relevant biological system.
IV. NUMERICAL EXPERIMENTS
In this section we present two numerical examples that will demonstrate the scope of validity of the mesoscopic reaction rates derived above. In the first example we consider the rebinding time of a pair of molecules. We compute the distributions and compare mesoscopic results for varying h to microscopic simulations.
In the second example we study a model proposed by Takahashi et al. in Ref. [41]. It was shown to have fine-grained dynamics, captured at the microscale but not at the deterministic level; we will simulate it at the mesoscopic scale and show that as the mesh size h approaches , the mesoscopic and microscopic scales agree.
A. Rebinding-time distribution
Consider one molecule of species A and one molecule of species B, subject to a reversible reaction,
(49) |
in a cubic domain of width L.
We showed in Sec. IIIC that for the mean rebinding time at the mesoscopic scale will agree with the mean rebinding time at the microscopic scale. This does not, however, automatically guarantee that this particular choice of mesh size will yield the best agreement between the distributions of the rebinding times at the different scales.
In Fig. 3 we plot the distribution of the rebinding times for different mesh sizes and compare to the distribution obtained by simulations at the microscopic scale. For we get a distribution that matches the microscopic results well for t ≳ h2/(2D). For other values of h, we get a distribution shifted relative to the microscopic distribution. For t ≲ h2/(2D), the microscopic simulations behave differently than the mesoscopic ones, regardless of mesh size. This is due to the fact that at this time scale the spatial resolution is coarser than the temporal resolution, thus being the limiting factor for the accuracy. During a time t, a molecule diffuses an average distance proportional to in each direction. Thus, for t ≲ h2/(2D), the distance the molecule diffuses is less than the size h of a voxel.
On the mesoscopic scale, the distribution of the rebinding time is approximately exponential at short time scales (time scales smaller than the time it takes for a molecule to diffuse on average the distance of a voxel.) That gives the first plateau in Fig. 3. At longer time scales the diffusion causes the rebinding time not to be exponential. In this region the mesoscopic simulations behave similarly to the microscopic. At even longer time scales, the distribution is again approximately exponential; once the molecules have become approximately well mixed in the enclosing volume the assumption of an exponential reaction rate is quite accurate. This is seen as the second plateau in Fig. 3.
In Fig. 4 we plot the mean rebinding time as a function of h and show that for the mean rebinding times match between the different scales.
B. MAPK cascade
An example of when small errors in the transient dynamics of bimolecular equilibration processes can have a large impact on the system’s dynamics was given in Ref. [41] to illustrate the need of the microscale resolution provided by the GFRD algorithm. The model considered is two steps of the omnipresent mitogen activated phospatase kinase (MAPK) cascade. Here, a transcription factor MAPK is phosphorylated in two steps by a kinase MAPKK and dephosphorylated by a phosphatase P:
(50) |
(51) |
(52) |
(53) |
(54) |
(55) |
(56) |
(57) |
During the phosphorylation and dephosphorylation steps, the kinase and phosphatase turns into an inactivated form MAPKK* and P*. This can model, e.g., a conformation change due to conversion of ATP to ADP, resulting in the need to reactivate the enzymes before proceeding with the next reaction. If the time scale for this reactivation step is short and the system very diffusion limited, rapid rebinding of MAPKK to the newly phosphorylated molecules can have a big impact on the overall system dynamics, as illustrated and discussed from a biological perspective in Ref. [41]. Numerically, this means that the system is very challenging to simulate with lattice-based methods, due to the need for very fine spatial resolution in order to resolve the rebindings on the fast time scale. This was noted by Fange et al. in Ref. [32], where length-scale-dependent rates were derived based on the ansatz that the equilibration time should match on the two scales for a spherical discretization. They managed to resolve the microscale dynamics of the model by using these propensities in combination with extending the RDME to allow for reaction events between molecules occupying neighboring voxels as well as molecules occupying the same voxel. Without that extension they were not able to resolve the microscale dynamics; below we show that with reaction rates as defined in (10) and (23) we are able to resolve the microscale dynamics without considering a nonlocal extension of the RDME.
In Fig. 5 we show the results obtained when simulating this model using our local rates for different mesh resolutions. As can be seen, when h is close to , we obtain a good approximation of the results of the GFRD algorithm from Ref. [41]. In the figure, we show the time τres until half-activation (i.e., the time to reach half the steady state level of MAPKpp) for varying diffusion constants, making the system range from reaction limited to diffusion limited. As can be seen, for large values of D, as expected, the rates proposed here and the rates of Collins and Kimball give similar results, but for the strongly diffusion limited cases, our rates result in a much better agreement with the microscale model. Notably, for small D we obtain comparable accuracy to using kCK with for , resulting in simulations that run approximately 16 times faster, due to the 𝒪(h−2) scaling of the computational time.
In Fig. 6(a) we have computed the upper bound on h obtained by requiring that the relative error in the average rebinding time is bounded by 0.05. As expected, we can see that for the less-diffusion-limited cases, when D/kr is larger, we can choose the voxel size larger and still obtain accurate results. As D becomes even larger, the well-mixed assumption will be satisfied, and the system can be simulated at a much coarser scale. For smaller values of D the restriction on h is quite severe, and we are required to approach in order to accurately simulate the system. This has an implication for the computational complexity of the simulations; a small D makes the system less stiff, meaning it becomes less computationally challenging but also forces us to choose a smaller voxel size, while a large D makes the system more stiff but at the same time allows for a larger voxel size. In Fig. 6(b) we have computed the maximum error in the average rebinding time as a function of D but independent of the size h of the voxels.
V. DISCUSSION
As we have seen, by taking a multiscale approach and deriving reaction constants by matching certain statistics of the Smoluchowski model, more accurate simulations can be obtained compared to the classical approach using rates from Collins and Kimball. An important reason why this is possible is that we start out with a given discretization of space and then derive scale-dependent multiscale propensities (discretization-first), while the CK rate was not derived with a mesh in mind, and hence the propensity depends only the volume of the voxels and not their shapes. As a consequence, we can better approximate binding times for bimolecular reactions that need high spatiotemporal resolution.
While it is important to be able to accurately resolve the reaction kinetics of a given diffusion limited system, it may also be important to accurately resolve complex geometries and external and internal boundaries, modeling, for example, cell membranes. In this case, uniform Cartesian grids have distinct drawbacks compared to unstructured triangular and tetrahedral discretizations in that they require more voxels in order to resolve the boundaries [14,23] resulting in unnecessarily long computational time. While we expect fundamental limits for a triangular and tetrahedral discretization to be close to the ones obtained herein for Cartesian grids, whether it will be possible to extend the approaches taken here to obtain sharp estimates and reaction rates also for unstructured meshes has yet to be seen. Another approach to the problem of making an RDME-type model approximate a microscopic model is taken in Ref. [39], where a mesoscale model is constructed by discretizing the Doi model [42]. This approach seems more directly amenable to be used on general grids, but it has not yet been applied to the Smoluchowski model, and except for the case of irreversible, perfect absorption [34], the relationship between the Doi and Smoluchowski models is not well understood.
We have illustrated in numerical examples that by using the propensities proposed here it is possible to accurately simulate the MAPK system discussed in Ref. [41] on the mesoscale using a purely local RDME implementation, and we have shown theoretically why is the optimal mesh size. The same system has previously been successfully simulated with an RDME-type model by Fange et al. [32], using another set of multiscale propensities and by relying on a nonlocal implementation of the RDME in which molecules occupying adjacent voxels are allowed to react. Relying on neighbor interactions leads to an increased computational cost due to the increased number of updates in each step of the kinetic Monte Carlo algorithm and hence we should expect the propensities derived here to provide a computational speed advantage for comparable accuracy.
Although more efficient than a nonlocal implementation, the simulations herein require a uniformly fine mesh and hence expensive simulations for systems that require very high spatial resolution. Unless there are species in the model present in high copy numbers which would cause microscopic simulation to become very time-consuming, it is not unlikely that an efficient implementation of, e.g., GFRD is more efficient than the purely mesoscopic simulation. With this in mind, for very diffusion limited systems with multiscale properties, a compelling approach is the use of hybrid methods. Such a method, blending the RDME and GFRD algorithms, has previously been proposed by the present authors [33], in which it was demonstrated that an accurate hybrid simulation of the MAPK model [41] can yield accurate results with only a small part of the system simulated on the microscopic scale. However, there are outstanding challenges in making such hybrid methods easy to use by practitioners. Dynamic and adaptive partitioning of the system into microscopic and mesoscopic parts according to accuracy requirements is needed both for computational efficiency and for robustness of the simulator. In this paper we advance the fundamental theoretical understanding of the RDME when viewed as an approximation to the Smoluchowski model, something that is a prerequisite to develop adaptivity criteria for hybrid methods.
Acknowledgments
The authors thank Per Lötstedt for constructive comments on the manuscript. This work was funded by NSF Grant No. DMS-1001012, NIGMS of the NIH under Grant No. R01-GM113241-01, Institute of Collaborative Biotechnologies Grant No. W911NF-09-D-0001 from the U.S. Army Research Office, NIBIB of the NIH under Grant No. R01-EB014877-01, and U.S. DOE Grant No. DE-SC0008975.
Footnotes
The content of this paper is solely the responsibility of the authors and does not necessarily represent the official views of these agencies.
Contributor Information
Stefan Hellander, Department of Computer Science, University of California, Santa Barbara, California 93106-5070, Santa Barbara, USA.
Andreas Hellander, Department of Information Technology, Uppsala University, Box 337, SE-75105, Uppsala, Sweden.
Linda Petzold, Department of Computer Science, University of California, Santa Barbara, California 93106-5070, Santa Barbara, USA.
References
- 1.Gillespie DT. A general method for numerically simulating the stochastic time evolution of coupled chemical reactions. J Comput Phys. 1976;22:403. [Google Scholar]
- 2.Gardiner CW, McNeil KJ, Walls DF, Matheson IS. Correlations in stochastic theories of chemical reactions. J Stat Phys. 1976;14:307. [Google Scholar]
- 3.Baras F, Malek Mansour M. Reaction-diffusion master equation: A comparison with microscopic simulations. Phys Rev E. 1996;54:6139. doi: 10.1103/physreve.54.6139. [DOI] [PubMed] [Google Scholar]
- 4.Lawson MJ, Drawert B, Khammash M, Petzold L. Spatial stochastic dynamics enable robust cell polarization. PLoS Comput Biol. 2013;9:e1003139. doi: 10.1371/journal.pcbi.1003139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Howard M, Rutenberg AD. Pattern formation inside bacteria: Fluctuations due to the low copy number of proteins. Phys Rev Lett. 2003;90:128102. doi: 10.1103/PhysRevLett.90.128102. [DOI] [PubMed] [Google Scholar]
- 6.Fange D, Elf J. Noise induced Min phenotypes in E. coli. PLoS Comput Biol. 2006;2:e80. doi: 10.1371/journal.pcbi.0020080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Sturrock M, Hellander A, Marsavinos A, Chaplain M. Spatial stochastic modeling of the hes1 pathway: Intrinsic noise can explain heterogeneity in embryonic stem cell differentiation. J Roy Soc Interface. 2013;10:20120988. doi: 10.1098/rsif.2012.0988. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Sturrock M, Hellander A, Aldakheel S, Petzold L, Chaplain M. The role of dimerisation and nuclear transport in the hes1 gene regulatory network. Bull Math Biol. 2013;76:766. doi: 10.1007/s11538-013-9842-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Elf J, Ehrenberg M. Spontaneous separation of bi-stable biochemical systems into spatial domains of opposite phases. Syst Biol. 2004;1:230. doi: 10.1049/sb:20045021. [DOI] [PubMed] [Google Scholar]
- 10.van Zon JS, ten Wolde PR. Green’s-function reaction dynamics: A particle-based approach for simulating biochemical networks in time and space. J Chem Phys. 2005;123:234910. doi: 10.1063/1.2137716. [DOI] [PubMed] [Google Scholar]
- 11.van Zon JS, ten Wolde PR. Simulating biochemical networks at the particle level and in time and space: Green’s-function reaction dynamics. Phys Rev Lett. 2005;94:128103. doi: 10.1103/PhysRevLett.94.128103. [DOI] [PubMed] [Google Scholar]
- 12.Hellander S, Lötstedt P. Flexible single molecule simulation of reaction-diffusion processes. J Comput Phys. 2011;230:3948. [Google Scholar]
- 13.Hattne J, Fange D, Elf J. Stochastic reaction-diffusion simulation with MesoRD. Bioinformatics. 2005;21:2923. doi: 10.1093/bioinformatics/bti431. [DOI] [PubMed] [Google Scholar]
- 14.Drawert B, Engblom S, Hellander A. URDME: A modular framework for stochastic simulation of reaction-transport processes in complex geometries. BMC Syst Biol. 2012;6:76. doi: 10.1186/1752-0509-6-76. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Hepburn I, Chen W, Wils S, De Schutter E. STEPS: Efficient simulation of stochastic reaction-diffusion models in realistic morphologies. BMC Syst Biol. 2012;6:425. doi: 10.1186/1752-0509-6-36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Rossinelli D, Bayati B, Koumoutsakos P. Accelerated stochastic and hybrid method for spatial simulations of reaction-diffusion systems. Chem Phys Lett. 2008;451:136. [Google Scholar]
- 17.Marquez-Lago TT, Burrage K. Binomial tau-leap spatial stochastic simulation algorithm for applications in chemical kinetics. J Chem Phys. 2007;127:104101. doi: 10.1063/1.2771548. [DOI] [PubMed] [Google Scholar]
- 18.Lampoudi S, Gillespie D, Petzold LR. The multinomial simulation algorithm for discrete stochastic simulation of reaction-diffusion systems. J Chem Phys. 2009;130:094104. doi: 10.1063/1.3074302. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Ferm L, Hellander A, Lötstedt P. An adaptive algorithm for simulation of stochastic reaction-diffusion processes. J Comput Phys. 2010;229:343. [Google Scholar]
- 20.Hellander A, Lötstedt P. Incorporating active transport in mesoscopic reaction-transport models inside living cells. Multiscale Model Simul. 2010;8:1691. [Google Scholar]
- 21.Bayati B. Fractional diffusion-reaction stochastic simulations. J Chem Phys. 2013;138:104117. doi: 10.1063/1.4794696. [DOI] [PubMed] [Google Scholar]
- 22.Isaacson SA, Peskin CS. Incorporating diffusion in complex geometries into stochastic chemical kinetics simulations. SIAM J Sci Comput. 2006;28:47. [Google Scholar]
- 23.Engblom S, Ferm L, Hellander A, Lötstedt P. Simulation of stochastic reaction-diffusion processes on unstructured meshes. SIAM J Sci Comput. 2009;31:1774. [Google Scholar]
- 24.Smoluchowski Mv. Versuch einer mathematischen Theorie der Koagulationskinetik kolloider Lösungen. Z Phys Chemie. 1917;92:129. [Google Scholar]
- 25.Tomita M, Hashimoto K, Takahashi K, Shimizu TS, Matsuzaki Y, Miyoshi F, Saito K, Tanida S, Yugi K, Venter JC, Hutchison CA. E-cell: Software environment for whole-cell simulation. Bioinformatics. 1999;15:72. doi: 10.1093/bioinformatics/15.1.72. [DOI] [PubMed] [Google Scholar]
- 26.Andrews SS, Addy NJ, Brent R, Arkin AP. Detailed simulations of cell biology with Smoldyn 2.1. PLoS Comput Biol. 2010;6:e1000705. doi: 10.1371/journal.pcbi.1000705. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Collins FC, Kimball GE. Diffusion-controlled reaction rates. J Colloid Sci. 1949;4:425. [Google Scholar]
- 28.Gillespie DT. A diffusional bimolecular propensity function. J Chem Phys. 2009;131:164109. doi: 10.1063/1.3253798. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Isaacson SA. The reaction-diffusion master equation as an asymptotic approximation of diffusion to a small target. SIAM J Appl Math. 2009;70:77. [Google Scholar]
- 30.Erban R, Chapman J. Stochastic modeling of reaction-diffusion processes: Algorithms for bimolecular reactions. Phys Biol. 2009;6:046001. doi: 10.1088/1478-3975/6/4/046001. [DOI] [PubMed] [Google Scholar]
- 31.Hellander S, Hellander A, Petzold LR. Reaction-diffusion master equation in the microscopic limit. Phys Rev E. 2012;85:042901. doi: 10.1103/PhysRevE.85.042901. [DOI] [PubMed] [Google Scholar]
- 32.Fange D, Berg OG, Sjöberg P, Elf J. Stochastic reaction-diffusion kinetics in the microscopic limit. Proc Natl Acad Sci USA. 2010;107:19820. doi: 10.1073/pnas.1006565107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Hellander A, Hellander S, Lötstedt P. Coupled mesoscopic and microscopic simulation of stochastic reaction-diffusion processes in mixed dimensions. Multiscale Model Simul. 2012;10:585. [Google Scholar]
- 34.Agbanusi IC, Isaacson SA. A comparison of bimolecular reaction models for stochastic reaction-diffusion systems. Bull Math Biol. 2014;76:922. doi: 10.1007/s11538-013-9833-6. [DOI] [PubMed] [Google Scholar]
- 35.Andrews SS, Bray D. Stochastic simulation of chemical reactions with spatial resolution and single molecule detail. Phys Biol. 2004;1:137. doi: 10.1088/1478-3967/1/3/001. [DOI] [PubMed] [Google Scholar]
- 36.Gillespie DT. A rigorous derivation of the chemical master equation. Physica A. 1992;188:404. [Google Scholar]
- 37.Gardiner CW. Handbook of Stochastic Methods. 3. Springer-Verlag; Berlin: 2004. Springer Series in Synergetics. [Google Scholar]
- 38.Gillespie DT, Hellander A, Petzold LR. Perspective: Stochastic algorithms for chemical kinetics. J Chem Phys. 2013;138:170901. doi: 10.1063/1.4801941. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Isaacson SA. Relationship between the reaction-diffusion master equation and particle tracking models. J Phys A: Math Theor. 2008;41:065003. [Google Scholar]
- 40.Gillespie DT, Petzold LR, Seitaridou E. Validity conditions for stochastic chemical kinetics in diffusion-limited systems. J Chem Phys. 2014;140:054111. doi: 10.1063/1.4863990. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Takahashi K, Tănase-Nicola S, ten Wolde PR. Spatiotemporal correlations can drastically change the response of a MAPK pathway. Proc Natl Acad Sci USA. 2010;107:2473. doi: 10.1073/pnas.0906885107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Isaacson SA. A convergent reaction-diffusion master equation. J Chem Phys. 2013;139:054101. doi: 10.1063/1.4816377. [DOI] [PubMed] [Google Scholar]