Abstract
The production of anticompetitor toxins is widespread among bacteria. Because production of such toxins is costly, it is typically regulated. In particular, many toxins are produced only when the local cell density is high. It is unclear which selection pressures shaped the evolution of density-dependent regulation of toxin production. Here, we study the evolution of toxin production, resistance and the response to a cell-density cue in a model of an evolving bacterial population with spatial structure. We present results for two growth regimes: (i) an undisturbed, fixed habitat in which only small fluctuations of cell density occur, and (ii) a serial-transfer regime with large fluctuations in cell density. We find that density-dependent toxin production can evolve under both regimes. However, the selection pressures driving the evolution of regulation differ. In the fixed habitat, regulation evolves because it allows cells to produce toxin only when opportunities for reproduction are highly limited (because of a high local cell density), and the effective fitness costs of toxin production are hence low. Under serial transfers, regulation evolves because it allows cells to switch from a fast-growing non-toxic phenotype when colonising a new habitat, to a slower-growing competitive toxic phenotype when the cell density increases. Colonies of such regulating cells rapidly expand into unoccupied space because their edges consist of fast-growing, non-toxin-producing cells, but are also combative because cells at the interfaces with competing colonies do produce toxin. Because under the two growth regimes different types of regulation evolve, our results underscore the importance of growth conditions in the evolution of social behaviour in bacteria.
Author summary
Bacteria live in microbial communities, in which they compete with many other microbes for nutrients and space. In this competitive environment, almost all known bacterial strains produce toxins that impair or kill other bacteria. This chemical warfare is thought to be one of the major factors shaping microbial diversity. Many toxins are produced only if the local density of bacteria is high. To achieve this, bacteria respond to cell-density cues: signalling molecules or other indicators of the presence of other cells. Here, we use a computational model to study the evolution of density-based regulation of toxin production in bacterial populations. We show that such regulation can arise under various growth conditions, and analyse the selection pressures driving its evolution. In particular, we find that if bacteria regularly need to colonise a new habitat, density-based regulation allows them to express a fast-growing, non-toxic phenotype when expanding into uncolonised territory, and a slower-growing, toxin-producing phenotype when competing with other strains. Colonies of regulating cells show a typical structure, with cells of the fast-growing, sensitive phenotype at their expanding edges, and toxin-producing cells in the colony interior and at interfaces between colonies.
Introduction
Many bacteria produce antimicrobial toxins that impede the growth of competing bacteria or even kill them [1–3]. A wide variety of such toxins has been discovered, ranging from narrow-range bacteriocins to broad-range antimicrobials that may even affect eukaryotic cells [4, 5]. Because producing and secreting toxins is metabolically costly, toxin producing strains have a reduced growth rate compared to non-producers [6–8]. Toxin production is therefore an example of spiteful behaviour: it is costly to the actor and harmful to the recipient [9, 10].
Over the years, the questions how and under what conditions such spiteful production of anticompetitor toxins can evolve have inspired many experimental and theoretical studies [6, 7, 9, 11–14]. These studies showed that the spatial scale over which interactions between bacteria take place is a key determinant of the evolutionary stability of toxin production. Modelling work predicted that toxin production is evolutionarily unstable in homogeneous, well-mixed environments with global interactions (e.g., a shaken flask), while stable coexistence between a toxin-producing strain (or killer, K) and sensitive strain (S) can arise in spatially structured environments where interactions are local (e.g., agar plates) [7, 11]. Under well-mixed conditions, the K strain is fully outcompeted by resistant (R) cells (which for instance arise from K cells through mutational loss of toxin production but not resistance), because R cells avoid the metabolic costs for toxin production but equally benefit from the killing of S cells by the K strain. In spatially structured environments, however, killing and competition are local processes and hence K cells preferentially benefit from the killing effect of their toxin compared to non-producing cells. The population dynamics then follow local cycles of non-transitive “rock-paper-scissors” interactions: The K strain invades patches of S cells; these K cells are subsequently outcompeted by the R strain; and these R cells are in turn outcompeted by the faster-growing S strain [7]. These local KRS-dynamics cause the emergence of wave-like spatial patterns, in which all three strains (K, R, and S) coexist [11, 15, 16]. These theoretical predictions were confirmed in vitro in populations of colicin-producing, -sensitive and -resistant Escherichia coli cells growing in flasks or on plates [6, 7], and in vivo in enteric bacterial populations in a mouse model [12]. Coexistence of a toxin-producing, -resistant, and -sensitive strain was also found in the more complex environment of a growing biofilm in vitro [13], and in silico modelling showed that the structure of the biofilm strongly affects the evolution of toxin production [14].
In all studies described above, genes for toxin production and resistance were constitutively expressed. Like many metabolically costly traits, however, toxin production is often tightly regulated [3, 4, 17]. In particular, the expression of many anticompetitor toxins is regulated by cell-density cues: small diffusible molecules that are excreted by bacterial cells, such that their extra-cellular concentration reflects the local density of bacteria (see refs [4, 18, 19] for reviews). Responding to a density cue allows bacteria to express costly genes only when the local cell density is high.
The high prevalence of toxin regulation by density cues raises the question of how such regulation evolved. A common explanation for the regulation of social behaviours by cell-density cues is that the benefits of the regulated social behaviour outweigh the costs only if a sufficient number of cells (the quorum) display the behaviour at the same time; the regulation is then also called quorum sensing (QS) [20, 21]. This is for instance the case for the cooperative production of some public goods, like siderophores in Pseudomonas aeruginosa [22, 23]. For such costly public-good production, both theoretical and experimental work has shown that production of, and response to, a quorum sensing signal can be beneficial, as it allows cells to produce the public good only if the cell density is high and the benefit of coordinated public-good production is hence substantial [23–28].
Whereas the evolution of density-dependent regulation is relatively well-understood in the context of cooperative public goods, its evolution in relation to spiteful toxin production is less well-studied. In a single modelling study, Czárán and Hoekstra (2007) considered whether the evolution of density-dependent toxin production could be explained by similar reasoning as described above for public goods [29]. A key feature of their model is that the toxin was assumed to be effective only if the local density of toxin producing cells exceeded a threshold density, which required toxin producers to cooperate. Furthermore, the model allowed gain and loss mutations of QS signal production, the hypothesis being that a genotype-specific cue that is produced by killer cells only might evolve to inform the killer cells about the local killer cell density. The study found, however, that QS regulation of toxin production was evolutionarily unstable to resistant “cheater” cells that produce the QS signal (and hence induce killer cells to produce toxin) but not the costly toxin [29]. Hence, considering anticompetitor toxin as a type of public good that is cooperatively produced has so far been unsuccessful in explaining density regulation of toxin production, and it remains unclear what selection pressures drive the evolution of toxin regulation by density cues.
Here, we therefore explore different explanations for the evolution of density-dependent toxin production. We use a computational model of evolving, spatially structured bacterial populations that deliberately differs from previous studies. In particular, we do not impose that a minimal quorum of toxin-producing cells is required in order to affect sensitive cells, but instead assume that the effect of toxin increases linearly with its concentration. Also, we focus on cases where toxin production is regulated by density cues that are produced by all cells (including cells that are sensitive to the toxin). For instance, production of the antimicrobial pyocyanin by the common pathogen Pseudomonas aeruginosa increases in the presence of peptidoglycan fragments, a general indicator of the local density of gram-positive bacteria [30] (see Discussion for more examples). In such cases, the cue indicates the total cell density rather than the density of killer cells. We obtain results for two growth regimes: (i) a long-term local competition regime, in which the population evolves in a fixed, densely populated habitat, and (ii) a serial-transfer regime in which small, random subsets of the population repeatedly colonise new habitats. We show that density-dependent regulation of toxin production can evolve under both regimes. By characterising the selection pressures shaping the evolution of regulation, we explain how density-dependent toxin production can evolve under various growth regimes.
Model
We developed a spatially explicit individual-based model of a population of bacteria in which production of anticompetitor toxin, resistance to the toxin, and response to a cell-density cue can evolve. Here, a general overview of the model is given; details of the implementation and analysis are provided in the Methods section.
Bacteria and their genotypes
The bacteria in our model live on a square lattice (Fig 1). The model bacteria have several evolvable characteristics, which constitute their “genotype” (Fig 1A). Firstly, they carry a toxin production “gene” and a resistance “gene”, each with three possible alleles: inactive (“Off”), constitutively expressed (“On”), or expressed in response to the density cue (“Regulated”, or “Reg”). We refer to a cell’s toxin production and resistance genotype using a bracket notation: e.g., bacteria with genotype “(Reg, On)” regulate their toxin production but constitutively express resistance. Secondly, bacteria that express their toxin gene may differ in their toxin production rate πT. Lastly, each bacterium has a response threshold value θ, which is the cue concentration above which it expresses its regulated genes, if it has any.
Concentration profiles of the cell-density cue and the toxin
The concentrations of the cell-density cue and the toxin are modelled with partial differential equations describing their local production, degradation, and diffusion. The cue molecule is produced by all cells, while the toxin is only produced by cells expressing the toxin production gene. We consider the dynamics of the cue and toxin to be much faster than the population dynamics of the bacteria, so that the concentration profiles of the cue and toxin at any given time are determined by the current spatial distribution of bacteria [14, 26, 31, 32]. We choose arbitrary units of concentration such that the concentration of the density cue varies between 0 and 1 and the toxin concentration varies between 0 and max(πT), the largest toxin production rate in the bacterial population (see Methods).
Dynamics of bacteria
Time in the model progresses in discrete steps. At the beginning of each time step, each bacterium senses the local cue concentration, which together with the cell’s genotype determines the cell’s “phenotype” (Fig 1A). The phenotype is given by three variables: toxin production ϕT, resistance ϕR, and cue response ϕC, which take the value 0 (Not expressed) or 1 (Expressed). If the cell has a regulated gene, the corresponding phenotype value is set to 1 if the cue concentration exceeds the cell’s response threshold value θ, and to 0 otherwise. Variable ϕC indicates whether the cell expresses a regulatory response system; it is 1 if the cell has at least one Reg gene, and 0 otherwise.
Note that a regulating cell’s phenotype adapts to the local cue concentration at each simulation time step. An exception to this instantaneous adaptation is made in cells that regulate both their toxin production and resistance (genotype (Reg, Reg)): inspired by the com-regulon of Streptococci which displays a delay in the expression of the bacteriocins CbpD and LytA relative to the immunity factor ComM [33–35], a delay of τdelay time steps is implemented between the expression of resistance and the expression of toxin. This delay prevents cells from killing neighbouring cells that have exactly the same genotype but coincidentally experience a slightly lower cue concentration and therefore do not (yet) express resistance.
Reproduction and cell death depend on a cell’s phenotype. The death rate of sensitive bacteria increases linearly with the local toxin concentration (similar to refs [7, 11, 14]). Importantly, this means that no minimal density (quorum) of toxin producers is required for the toxin to have an effect on sensitive cells (in constrast to [29]). Rather, each toxin producing cell proportionally adds to the killing rate of sensitive cells in the local neighbourhood.
The bacteria locally compete for a growth-limiting resource. To incorporate such local competition, at most one bacterium is allowed to occupy each lattice site. Bacteria surrounding an empty site compete for reproduction based on their respective reproduction rates (which depend on their phenotypes, as described below). When a cell reproduces, the daughter cell inherits the parent’s genotype, except that with small probability mutations are introduced.
Fitness costs
Toxin production and resistance are metabolically expensive [6–8]. Being able to respond to the density cue requires the production of receptors and a signal transduction pathway, and therefore likely also bears a metabolic cost. We incorporate these metabolic costs by reducing the reproduction rate of cells expressing these phenotypes. The costs for resistance and the ability to respond to the cue are constant, while the cost for toxin production increases linearly with the cell’s toxin production rate πT. Note that cells that regulate a gene always pay a cost for being able to respond to the cue, but in return may avoid the costs of toxin production and resistance when the density cue concentration is below their response threshold θ.
Results
Evolution of toxin regulation in a fixed, densely populated habitat
We first considered a bacterial population growing in a fixed habitat without external perturbations, by running the model on an undisturbed simulation lattice. Because we aimed to investigate the evolutionary potential of the production of anticompetitor toxin and its density-dependent regulation in general, rather than to model a specific strain of bacteria, we explored possible evolutionary outcomes of the model by performing a parameter sweep over the six defining parameters of our model: the spatial range of the density cue Lcue, the spatial range of the toxin Ltox, of the bacteria (where R0 is the maximal expected number of daughter cells produced per bacterial life time), the scaled toxin production cost , the resistance cost CR, and the cue response cost CC (see S1 Text for the derivation of these parameters). We performed 2000 simulations with random parameter settings uniformly sampled from broad parameter ranges (see Methods, Table 1). For each simulation, we then calculated the mean abundance of each genotype and each phenotype after an evolutionary steady state was reached. Based on this evolved population composition, the simulations were classified into four categories (S1 Fig).
Table 1. Model parameters.
Varied in parameter sweep | ||
Parameter | Description | Range |
Characteristic length scale of the cell-density cue concentration profile (lattice sites) | [2, 20] | |
Characteristic length scale of the toxin concentration profile (lattice sites) | [2, 38] | |
of the bacteria, where R0 is the maximal expected number of offspring per bacterial life time (dimensionless) | [0, 0.5] | |
Scaled slope of toxin production cost function (dimensionless) | [0.01, 0.8] | |
CR | Cost of resistance (dimensionless) | [0.01, 0.25] |
CC | Cost of responding to the density cue (dimensionless) | [0.01, 0.1] |
Fixed | ||
Parameter | Description | Value |
Offset of toxin production cost function | 0.01 | |
τdelay | Delay between expression of resistance and toxin production in (Reg, Reg)-cells | 50 time steps |
μgain | Probability of a gain mutation upon reproduction | 5 ⋅ 10−5 |
μloss | Probability of a loss mutation upon reproduction | 5 ⋅ 10−4 |
μ | Probability that a mutation occurs in response threshold θ or toxin production rate πT upon reproduction | 5 ⋅ 10−4 |
plargemut | Probability that a mutation in θ or πT yields a random value | 10−3 |
σμ | Maximum size of a mutation in θ or πT otherwise | 0.05 |
In 1737 of the 2000 runs, the sensitive genotype (Off, Off) fixed in the population, indicating that most parameter conditions were unfavourable to the evolution of toxin production. In 228 simulations, at least one toxin producing genotype, sensitive genotype, and resistant genotype were found, hence yielding a KRS-system. Most of these evolved KRS-systems consisted of non-regulating killers (genotype (On, On)), non-regulating resistant cells (genotype (Off, On)), and sensitive cells (genotype (Off, Off)) (Fig 2A), reproducing the KRS-dynamics observed in earlier studies [7, 11, 15, 16]. In 22 of the 228 simulations yielding KRS-dynamics, however, at least one regulating genotype was selected. In a clear majority of these (17 runs), a single regulating genotype was found: cells that regulate their toxin production, but constitutively express resistance (genotype (Reg, On)). These regulating cells coexisted with sensitive cells (genotype (Off, Off)) and resistant cells (genotype (Off, On)) (Fig 2B). Lastly, 35 simulations did not result in fixation of sensitives or a KRS-system and were classified as “other”. In none of these simulations regulation evolved, and they were therefore not further considered.
Regulation of toxin production can evolve when regulation costs are low, the density cue is short-ranged, and toxin production is costly
To determine which parameter combinations favour the evolution of regulation, we compared the parameter sets that resulted in KRS-dynamics without regulation (n = 206) to those that resulted in KRS-dynamics with regulation (n = 22) (Fig 3). Unsurprisingly, in simulations in which regulation evolved, the cost of regulation was typically much lower. Regulation also evolved more readily when toxin production was costly and when the spatial range of the cell-density cue was limited. These conditions seem reasonable: the potential benefits of regulation are largest when it controls a costly behaviour, and a short-ranged cue contains more information about the current local environment than a longer-ranged cue. Since competition in the model occurs over short spatial ranges, responding to a short-ranged cue allows bacteria to quickly adapt to changes in their immediate competition environment.
Cells that regulate their toxin production occupy the killer niche in KRS-dynamics
To better understand how density-dependent toxin regulation evolved in our model, we studied the example run of Fig 2B in more detail. The evolving population displayed KRS-dynamics, with regulating killer cells (genotype (Reg, On)) invading patches of sensitive cells (genotype (Off, Off)), constitutively resistant cells (genotype (Off, On)) invading patches of regulating killer cells, and sensitive cells invading patches of resistant cells (Fig 4A, S1 Video). The (Reg, On)-cells hence acted as the killer in these KRS-dynamics, replacing the constitutive killers (genotype (On, On)) found in non-regulating KRS-systems.
When the evolved (Reg, On)-cells express their toxin gene they produce a considerable amount of toxin (πT ≈ 0.8, Fig 4B), but due to regulation they do so only when they sense a high cue concentration. This regulation is governed by the evolved response threshold θ, the cue concentration above which regulated genes are expressed. To interpret the observed response threshold values, we compared them to the distribution of cue concentrations that (Reg, On)-cells sense (Fig 4C). Most response threshold values were greater than the median cue concentration observed, indicating that evolved (Reg, On)-cells are more often in their inactive resistant state than in their active toxin-producing state.
To make sure that we do not base our conclusions on contingencies in a particular example run, we performed ten replicate runs with the same parameter settings, and found that the results were highly reproducible (S2 Fig).
Regulation decreases the effective fitness cost of toxin production
What selection pressures drive the observed evolution of density-dependent toxin regulation? In the cyclic KRS-system, two main factors determine the success of toxin-producing cells: their competitive advantage over sensitive cells and their disadvantage to resistant cells. To quantify the effect of regulation on these competitive (dis)advantages, we performed controlled invasion experiments comparing the invasion dynamics of the evolved (Reg, On)-cells to non-regulating (On, On)-cells evolved under the same parameter conditions but in a simulation where regulation was disabled (S3A Fig). First, we directly competed the regulating (Reg, On)-strain with the (On, On)-strain, and found that the regulating killer strain invades and eventually fully displaces the constitutive killer strain, as expected. Next, we calculated the speed at which both killer strains invade a sensitive population, and the speed at which they are invaded by a resistant strain (S3B Fig). Surprisingly, compared to the (On, On)-strain, the (Reg, On)-strain both invaded a sensitive population faster and was invaded more slowly by the resistant strain (S3C Fig). Cells that regulate their toxin production hence have an advantage over non-regulating killer cells both in their invasion of new patches of sensitives, and in their competition with resistant cells.
The difference in the invasion speed into sensitive patches is explained by a difference in mean toxin production: the evolved (Reg, On)-cells on average produce more toxin per cell (mean long-term toxin production rate: 0.20) than the (On, On)-cells that evolved under the same conditions if regulation was excluded (mean long-term toxin production rate: 0.13). Naively, a higher mean toxin production rate should result in higher fitness costs. However, the increased competitiveness against resistant cells and the results of the direct competition between the two killer strains suggest that the regulating cells actually have a higher effective reproductive fitness than the constitutive killers. Here, the information conferred by the density cue comes into play. Remember that the metabolic costs of toxin production lead to a reduction in the producing cell’s reproduction rate. However, because reproduction can only occur if empty lattice sites are available, the effective fitness costs of a reduction in reproduction rate also depend on the cell’s environment and social neighbourhood. If several lattice sites in the cell’s neighbourhood are unoccupied, the local competition for reproduction is a major determinant of the cell’s fitness and the effective fitness costs resulting from the metabolic costs of toxin production are high. On the other hand, if no neighbouring lattice sites are vacant, the cell has no opportunity to reproduce and the effective fitness costs vanish. By exploiting the cue, the evolved (Reg, On)-cells produce toxin only when none or at most one of their neighbouring sites is empty, and never do so when more than two neighbouring lattice sites are empty (S4 Fig). At the wavefront where the (Reg, On)-cells compete with sensitive (Off, Off)-cells, the produced toxin frees up lattice sites by killing sensitive cells, causing a drop in the density cue concentration, which leads to the expression of the faster-reproducing, non-toxic phenotype in the (Reg, On)-cells benefitting from these available sites (which either produced the toxin themselves or profit from toxin production by closely related neighbouring (Reg, On)-cells). Regulation thus allows cells to produce toxin when reproduction opportunities are scarce and the effective fitness costs of production are hence low, and to exhibit a faster-replicating resistant phenotype when more space is available and hence competition for rapid reproduction is stronger.
Regulation works only if the density cue is sufficiently reliable and phenotypic adaptation is sufficiently fast
The evolved regulation mechanism described above requires that the cue concentration conveys detailed information about the environment. The evolved system might therefore be vulnerable to disturbances in the cue, e.g., caused by stochasticity in production of the cue molecule, its diffusion and degradation, or in the response pathway. To test this hypothesis, we performed simulations in which at each time step independent Gaussian noise was added to the cue concentration at each lattice site. Regulation still evolved in 4 out of 5 replicate runs if a moderate noise level was used (standard deviation of noise was σnoise = 0.025, which is comparable to the change in local cue concentration experienced if one of the eight direct neighbouring cells is removed). At an increased noise level (σnoise = 0.05), however, only 2 out of 5 replicate runs showed evolution of regulation, and at an even higher noise level (σnoise = 0.1) regulation evolved once in 5 replicate runs. Hence, regulation is effective only if the cue concentration is a sufficiently precise predictor of the current local density.
In the model, when the cue concentration changes, regulating cells adjust their phenotype instantaneously. In reality, such a phenotypic switch takes time [36, 37]. To investigate how such a lag affects our results, we introduced a lag time between sensing a change and altering the phenotype. Regulation still evolved when a relatively short lag times of 5 simulation time steps was used, which is equivalent to 50% of the minimal doubling time of the bacteria (S5 Fig). When the lag time was longer, regulation no longer evolved (S5 Fig), indicating that the evolved regulation mechanism requires cells to be able to adjust their phenotype relatively fast. This result seems intuitive: a regulation mechanism that relies on cells reverting to a fast-growing, non-toxin-producing phenotype when locally empty sites are detected can only be effective if this reversion happens faster than the recolonisation of these empty sites.
Evolution of toxin regulation under a serial-transfer regime
So far, we have considered model bacteria living in a fixed, undisturbed habitat. Natural growth conditions, however, tend to vary substantially over space and time, and such variations in growth conditions may cause large fluctuations in cell density. To examine how externally induced density fluctuations affect the evolution of density-dependent toxin regulation, we simulated serial transfers: a procedure, well-known from experimental evolution studies, in which a small sample of the population is regularly transferred to fresh medium [38–42]. The population dynamics were simulated as before, except that periodically the simulation was paused, a random sample of cells was taken from the population, and these founder cells were randomly placed on a new simulation lattice (“fresh medium”). These serial transfers were continued for many cycles to allow the system to approach evolutionary steady state.
Regulation evolves more frequently under serial transfers than in a fixed habitat
To explore the model’s behaviour under the serial-transfer regime, we simulated serial transfers for the same 2000 parameter conditions used in the fixed-habitat parameter sweep. The evolutionary outcome of simulations was again classified based on genotype and phenotype abundances at evolutionary steady state (S6A Fig). Now, 1894 out of the 2000 parameter combinations resulted in the fixation of sensitives, an even larger fraction than in the fixed-habitat case. This makes sense: if cells regularly have to colonise a new, unpopulated environment, selection is expected to favour the fast-replicating sensitive genotype. Toxin production and resistance did evolve in 86 simulations, which were hence classified as “KRS”. The 20 remaining simulations of the parameter sweep were classified as “other”, and were further disregarded.
Out of the 86 simulations that yielded a KRS-system, regulation evolved in a majority of 68 cases (S6A Fig). Hence, regulation evolved more readily under the serial-transfer regime than in the fixed habitat (in which only 22 parameter combinations out of 206 simulations yielding KRS-dynamics resulted in the evolution of regulation). Compared to the simulations that yielded a KRS-system without regulation (n = 18), the simulations in which regulation did evolve (n = 68) had relatively high toxin production and resistance costs, and low response costs (S6B Fig), consistent with the observations in the fixed habitat (c.f., Fig 3).
Under serial transfers, bacteria are selected for fast colony expansion
In 62 of the 68 simulations in which regulation evolved, two types of regulating cells were found: (i) (Reg, Reg)-cells that regulate both their toxin production and their resistance, and (ii) (Off, Reg)-cells, that regulate their resistance and do not produce toxin. These cells coexisted with (Off, Off)- and sometimes (Off, On)-cells. A typical example of such dynamics is shown in Fig 5 and S2 Video, and we next consider this example in more detail.
At low cell density, cells with the three dominant genotypes ((Off, Off), (Off, Reg) and (Reg, Reg)) all express a sensitive phenotype. Cells with a sensitive phenotype have low fitness costs and hence a high replication rate. The genotypes (Off, Off), (Off, Reg) and (Reg, Reg) dominated in all ten replicate simulations performed (S7 Fig), indicating that serial transfers robustly select for genotypes capable of growing at a high rate when cell density is low.
Shortly after each transfer into a new, empty, simulation lattice, founder cells of the three evolved genotypes indeed form colonies with a sensitive phenotype (Fig 5C, first panel; S2 and S3 Videos). As the colonies grow, the cue concentration within colonies increases. This causes cells in the interior of (Off, Reg)- and (Reg, Reg)-colonies to switch phenotype and become resistant (Fig 5C, second and third panel; S2 and S3 Videos). After the delay τdelay between expression of resistance and toxin production, the (Reg, Reg)-cells furthermore switch to a toxin producing phenotype (Fig 5C, third and fourth panel; S2 and S3 Videos). As a consequence, a ring of non-producing resistant (Reg, Reg)-cells forms that acts as a buffer between the outer layers of sensitives cells and the toxin producing cells in the colony interior. While the phenotype of cells in the interior switches to resistant or toxin producing, the cells at the colony edge retain a sensitive phenotype. From a functional perspective, this again seems reasonable: colonies grow at their edges, and expressing a sensitive phenotype at the colony edge maximises the rate at which a colony expands into unoccupied space. Since cell density is per definition low at the edge of a colony, regulation based on the density cue allows toxin producing and resistant cells to express the fast-replicating sensitive phenotype exactly there where the colony is growing.
Regulation allows cells to adjust their phenotype to changing growth conditions
Regulating cells can maintain a sensitive phenotype at the edge of growing colonies if their response threshold θ is larger than the cue concentration at the edge. Approximating the shape of a colony by a circle, we analytically calculated that the cue concentration at the edge of a colony is ≤ 0.49 (S2 Text). This analytical approximation corresponds well to measurements from single-colony simulations (Fig 6A). Although there is some variation between response threshold values of (Reg, Reg)-cells in the replicate runs, all values were well above this lower bound (Fig 6B), showing that the evolved (Reg, Reg)-cells indeed exploit the density cue to form fast-expanding colonies.
Next to the lower bound, the evolved response threshold values are bounded from above by the cue concentrations that cells perceive at the end of a transfer cycle, i.e., when the population approaches carrying capacity (Fig 6B). The evolved (Reg, Reg)-cells hence do produce toxin (and consequently pay fitness costs) when the local cell density is high, suggesting that these cells have been selected to exhibit their competitive phenotype (i.e., toxin production) when the population locally approaches carrying capacity. Importantly, such high cell densities not only occur in the interior of expanding colonies, but also at the interface between colonies where cells of the two colonies (with potentially different genotypes) compete. At the interfaces between colonies, (Reg, Reg)-cells hence express their toxin producing phenotype (S3 Video). The evolved regulating cells adjust their phenotype to varying growth conditions, exhibiting a sensitive phenotype when replicating into unoccupied space, and expressing toxin production and resistance when in competition with other cells.
Over many transfer cycles, the (Reg, Reg)-, (Off, Reg)- and (Off, Off)-cells show KRS-dynamics
So far, we have focussed on explaining the evolution of cells that regulate both their toxin production and resistance. However, a large fraction of the evolved populations is made up of cells that do not produce toxin and regulate their resistance only (Fig 5A and S7 Fig). These (Off, Reg)-cells had response threshold values very similar to those of (Reg, Reg)-cells (S7 Fig), and hence express the same fast-growing sensitive phenotype at the edges of growing colonies, but exhibit a resistant phenotype at the colony interior and where colonies interact (Fig 5C, S2 and S3 Videos).
While the toxin-producing phenotype of (Reg, Reg)-cells provides an advantage when competing with a colony of sensitive (Off, Off)-cells, it confers a disadvantage when competing with a colony of (Off, Reg)-cells. Similarly, the competitive resistant phenotype of (Off, Reg)-cells yields a competitive advantage against (Reg, Reg)-cells, but a disadvantage against (Off, Off)-cells. Hence, within the evolved regulating genotypes we again found cyclic dominance (see S3 Video), and this is reflected in the long term population dynamics (Fig 5A): the number of (Off, Off)-cells, (Off, Reg)-cells and (Reg, Reg)-cells oscillated in a K-R-S order. These KRS oscillations now occur on the time scale of many transfer cycles.
The evolution of regulation under serial transfers is highly robust to variations in the transfer regime, cue concentration and phenotype expression timing
Because serial transfers have such a profound impact on the evolution of regulation, we examined how the evolutionary outcome depends on the frequency of transfers and the number of founder cells used to seed the next population (S8 Fig). The evolution of regulation depends on the balance between selection for fast colony growth in sparsely populated environments, and selection for competitive phenotypes in dense environments. When transfers were very frequent, or the number of founder cells was very small, cells were continuously selected for fast growth and the sensitive (Off, Off)-genotype fixed in the population. On the other hand, when transfers were very infrequent or the number of founder cells was very large, we recovered the results found in the absence of serial transfers. In between, however, regulation was found in a wide parameter range: regulating genotypes still evolved when the time between transfers was increased 5-fold compared to the example parameter set of Fig 5, or the number of founder cells was increased by an order of magnitude (S8 Fig).
Regulation also readily evolved when we relaxed the assumption that the time between subsequent transfers is fixed and instead transferred the population with a fixed probability per time step (that is, as a Poisson process, producing an exponential waiting-time distribution) (S9 Fig). Results of these simulations were similar to the results obtained with fixed transfer cycle lengths, indicating that the evolution of regulation is robust against variation in transfer timing.
Furthermore, the evolution of regulation was also robust to variation in the time delay τdelay between expression of resistance and toxin production in (Reg, Reg)-cells, with (Reg, Reg)-cells evolving even when τdelay = 0 and the ring of non-producing resistant cells in colonies disappears (S10 Fig). Regulation also readily evolved when significant lag times (up to 3 bacterial doubling times) were implemented between the first instance that cells sense a change in cue concentration and the moment these cells change their phenotype accordingly (S11 Fig).
Lastly, the regulatory mechanism that evolved under serial transfers is highly robust to noise in the cue concentration. Even when large Gaussian noise (σnoise = 0.1, on cue concentrations varying between 0 and 0.85) was added to the cue concentration at each lattice site at each time step, regulation still evolved (S12 Fig). The regulation mechanism that evolved under the serial-transfer regime is hence more robust to noise in the cue concentration than the mechanism that evolved in a fixed habitat.
Spatial structure is crucial for the evolution of toxin production and regulation
So far, we have considered a spatially structured population in which reproduction and competition occur locally. This implementation was chosen because previous work has shown that constitutive toxin production is not evolutionarily stable in well-mixed environments [7, 11] (see Introduction). We therefore did not expect toxin production to evolve in our model in the absence of spatial structure, even if regulation was allowed.
To test this, we repeated all runs of our parameter sweep (both in a fixed habitat and under serial transfers) but now randomised the positions of the bacteria at each time step. We then classified the evolutionary outcome of these simulations in the same way as we analysed the spatially structured simulations (see S1 Fig). As expected, the sensitive genotype (Off, Off) fixed in all 4000 simulation runs. Particularly, even under parameter conditions that did yield (regulating) toxin producing cells in the spatially structured simulations, toxin production did not evolve under well-mixed conditions. This result underscores the crucial importance of spatial structure for the evolution of toxin production, regulated or not.
Discussion
Using a simulation model, we have shown that the production of anticompetitor toxins can become regulated by a cell-density cue in evolving populations under two different growth regimes: in a fixed habitat, and in serial-transfer cycles. Under both regimes, regulation of toxin production evolves because it allows cells to adjust their investment in toxin production to changes in the local competition and growth opportunities. However, the selection pressures driving the evolution of toxin production at high density, and the resulting types of regulation that evolve, differ between the growth regimes.
In the fixed habitat, regulating killer cells evolved that produce toxin only at very high local cell densities (Fig 4). We showed that these cells use the density cue to produce toxin only if reproduction opportunities are very scarce and the effective fitness costs of toxin production are therefore low (S4 Fig). This type of regulation relies on the fact that, in the model, cells that cannot reproduce due to a lack of empty neighbouring lattice sites can nevertheless produce toxin, at very low or even zero fitness cost. This phenomenon could occur in reality if at low cell density reproduction and toxin production are limited by the same resource(s) (e.g., the availability of carbon or nitrogen substrates), while at high cell density reproduction is limited by a different resource that does not limit toxin production (e.g., crowding or a lack of substrate not required for toxin production). Interestingly, such conditions have previously been found to stabilise cooperative secretions of swarming-promoting biosurfactants in Pseudomonas aeruginosa [43]. Production and secretion of these carbon-rich biosurfactants is regulated by nutrient availability, such that they are only produced when growth is limited by another nutrient than carbon (in this case, the nitrogen source) and the fitness costs of biosurfactant secretion are hence low, a mechanism called metabolic prudence by Xavier et al., 2011 [43]. Our model hence predicts that such metabolic prudence could also promote the evolution of density-dependent toxin regulation in long-term local competition environments by reducing the effective fitness costs of toxin production.
Under the serial transfer regime, we find that the evolution of regulation is dictated by two selection pressures: (i) selection for fast reproduction at the edge of expanding colonies, and (ii) selection for the expression of competitive phenotypes (toxin producing and/or resistant) at the interface between colonies (Figs 5 and 6). The dynamics of single cells founding expanding colonies leads to competition between these clonal colonies, and bacteria are selected for the colony structure that they produce (see S3 Video). After a serial transfer, those colonies that express a sensitive phenotype at their edges expand more rapidly into the newly available empty (or “resource-rich”) space. Regulation allows cells to recognise the expanding edges of their colonies, because the local cell density at colony edges is low, and to thus express a sensitive phenotype at these edges. The selection for fast colony expansion explains why cells are selected to express a sensitive phenotype at the edge of expanding colonies, but does not explain why expression of resistance and/or toxin production at high cell density is favoured. As long as a colony clonally expands without interacting with other colonies, the production of toxins does not confer any benefit. However, since the colony expands at its edges and the spatial range of the toxin is limited, the observed production of toxin in the interior of the colony also does not hamper the fast expansion of the colony. As soon as the expanding colony meets another colony, the situation changes: toxin production then yields a potential benefit in the competition with cells of the other colony (which might be sensitive to the toxin). Regulating cells cannot distinguish between the interior of a single colony or the interface between two colonies, because at both sites the local cell density is high. Responding to high cell density however allows the cells to express their competitive phenotype (toxin production or resistance) when in direct competition with cells of another colony (thus performing “competition sensing” c.f., [4]), while expression of the competitive phenotype in the interior of the colony does not slow down the colony’s expansion.
The marked differences between results obtained in the fixed habitat and under serial transfers show that the evolutionary dynamics in the model strongly depend on the growth regime. This is not just true for the model presented here. For instance, in experimentally grown colonies of toxin-producing, resistant, and sensitive E. coli strains it was found that populations under range expansion do not always show the coexistence patterns found in a stationary environment [44]. In experimental evolution, it has also long been known that the experimental regime can pose strong selection pressures on evolving populations [45, 46]. Because results obtained in one growth condition often do not generalise to other conditions, it is important to consider multiple regimes in theoretical and experimental evolutionary studies.
The differences between the evolution of regulation in the two growth regimes also warrant the question which results provide the more likely explanation for the observed density-dependent regulation of toxin production in nature. In our model, regulation evolved more frequently in the serial transfer regime than in the fixed habitat (S6A Fig). The regulation that evolved under serial transfers was also more robust to a lag between the change in cue concentration and the switch in phenotype (S5 and S11 Figs), and to noise in the cue concentration (S12 Fig). Lastly, the limitation of toxin production in the fixed habitat to instances where the effective fitness cost is very low (similar to metabolic prudence, c.f., [43]) can only explain the evolution of density-dependent toxin regulation if specific conditions on the resources limiting reproduction and toxin production are met (see Discussion above). The use of the density cue to recognise the edge of an expanding colony after a serial transfer, however, can favour the evolution of density-dependent toxin regulation as long as bacterial replication is limited by a resource that is present at higher concentration on the edge of a colony than in its interior. This seems to be a fairly general condition. Although “metabolic prudence” might contribute to the evolution of regulation for some toxins, we consider selection for the ability to switch between a fast-growing phenotype when colonising a new environment and a competitive phenotype when competing with other bacteria as the biologically more feasible and general candidate to explain evolution of density-dependent toxin regulation.
A similar switch between a fast-growing phenotype when colonising an environment and slower-growing social phenotypes when cell density is high was recently found in a model of quorum-sensing (QS) regulated cooperative public good production in growing biofilms [47]. In this model by Schluter et al. (2016), cells that regulated the production of costly public good through QS were found to outcompete constitutive producer cells, because the regulating cells exhibited a fast-growing, non-producer phenotype during the early stages of biofilm growth, and only switched to public good production when cell density increased. Regulation hence allowed colonies to expand rapidly when cell density was low, and to express a cooperative phenotype when cell density was high. Although this selection for fast colonisation is indeed reminiscent of our results, the selection pressures underlying the social behaviour (public good secretion or toxin production) differ substantially. In the case of public good secretion, Schluter et al. show that the QS signal acts as a measure of local relatedness, allowing cells to delay the secretion of public good until they are surrounded by clone mates and the benefit of public good production is high. In the case of toxin production, however, relatedness is a double-edged sword. While toxin production is promoted by high relatedness between toxin producers and those benefitting from the killing, this benefit only arises when non-related sensitive cells are present in the local neighbourhood [48, 49]. In the model presented here, the benefits of the toxin production at high cell density are not explained by high local relatedness, but rather by the presence of (unrelated) sensitive competitors.
A key feature of the density cue considered in this study is that it is produced by all bacteria. The choice of such a “total-density” cue was inspired by many natural examples of regulation by such cues. For instance, expression of the bacteriocin mutacin in the dental bacterium Streptococcus mutans is regulated by autoinducer-2 (AI-2) [50, 51], a general quorum sensing molecule that is produced by many species of bacteria as a metabolic byproduct [52, 53]. AI-2 is also involved in the regulation of bacteriocin production in the insect pathogen Photorhabdus luminescens [54]. Additionally, in the common pathogen Pseudomonas aeruginosa the production of the broad-spectrum antimicrobial pyocyanin is enhanced by the presence of peptidoglycan fragments, which indicates high local density of gram-positive bacteria [30].
In addition to the examples of regulation by total-density cues provided above, a wide variety of density-dependent toxin regulation mechanisms exists. Instead of using a density cue as an indicator for the presence of competitor cells, some bacteria more directly sense the presence of competitors, for instance through cell damage caused by these competitors, and respond with toxin production [55, 56]. Other toxins promote their own production; examples include several colicins [56–58] and the lantibiotics, a large class of bacteriocins produced by Gram-positive bacteria including nisin and subtilin [18, 59]. For these bacteriocins, a modelling study showed that during invasion events, cells that regulate their bacteriocin based on cell density outcompete cells that constitutively express bacteriocin, if the cost of bacteriocin production and the amount of bacteriocin produced are high [60]. Although this study did not consider long-term evolutionary dynamics and did for instance not include resistant, non-toxin-producing strains, its prediction agrees with the conditions that we find for the evolution of regulation (see Fig 3 and S6B Fig).
Notably, the expression of many other toxins is regulated by quorum sensing molecules that seem to be produced specifically for regulation of the toxin [4, 17, 61]. These QS molecules are often produced by toxin producing cells only, and hence act as “killer-specific” cues. A population in which such a killer-specific quorum sensing signal evolves might be prone to social cheating on the signal, e.g., by cells that produce the signal but do not produce the toxin, or by cells that cease their signal production and go “under the radar”. Such social signalling cheaters cannot arise for total-density cues, because these are by definition produced by all cells. The evolutionary explanations presented in this work for regulation by total-density cues therefore cannot necessarily be generalised to regulation by killer-specific cues. As far as we are aware, only a single modelling study has been undertaken to examine the co-evolution of toxin production and potentially killer-specific quorum sensing, which found that QS control of toxin production was unstable to social cheating [29] (see also the Introduction). In this model, however, cell density was fixed, and only the local population composition (e.g., the fraction of toxin producing bacteria) varied over time. In the model presented here, we have seen that large fluctuations in cell density drastically change the evolution of social behaviours associated with cell density, and might favour the evolution of regulation. Studying the evolution of toxin regulation by killer-specific cues under serial transfers is therefore an interesting and promising direction for future research.
Testing whether or not bacteria employ the types of regulation we identified would require the careful monitoring of the temporal dynamics of toxin production, resistance and cell division in bacterial colonies expanding after serial transfers or growing on a plate at high density, preferably at single-cell level (as e.g., done by Mavridou et al. [56]). Under serial transfers, the model predicts that bacterial colonies should consist of toxin-producing cells at the interior of the colony, and sensitive cells on the edge of the colony. Furthermore, these sensitive cells at the edge should switch to a toxin-producing phenotype when encountering another colony. These predictions can be tested by following toxin production at the single-cell level in growing bacterial colonies of bacteria known to regulate their toxin production with a general cell-density cue. Ahead of such experiments, our modelling work has provided more insight into the mechanisms underlying the evolution of complex regulation systems in microbial populations.
Methods
The general set-up of the model is discussed in the Model section. Below, we provide details on the implementation and analysis. The model was implemented in C. Code is available from the corresponding author upon request.
Spatially structured individual-based model
We developed a spatially explicit individual-based model of bacteria evolving their production of an anticompetitor toxin, resistance, and response to a cell-density cue. Bacteria in the model are characterised by a genotype of four characteristics: a toxin production gene, a resistance gene, a toxin production rate πT and a cue response threshold θ (Fig 1A). The bacteria live on a square N × N lattice (N = 512 for all simulations in this paper) with periodic boundary conditions. Each lattice site can contain at most one bacterium.
Concentration profiles of the cell-density cue and the toxin
The production, degradation and diffusion of the cell-density cue and the toxin are described with partial differential equations. Let be the concentration of secreted product k at location at time t, where the index k can be replaced by “cue” or “toxin”. Then
(1) |
where dk is the degradation rate, Dk the diffusion rate, and the production rate at location . For simplicity, we assume that the cue molecule is produced by all bacteria at a fixed rate pcue: equals pcue if the lattice site at location is occupied, and is 0 otherwise (similar to previous implementations of density cue dynamics [26, 47]). For the toxin, equals , i.e., the toxin production rate of the bacterium at location , if the lattice site is occupied by a bacterium expressing its toxin production gene, and is 0 otherwise.
Each simulation time step, the quasi-steady-state concentration profile of molecule k is found by equating the right-hand side of Eq 1 to zero and solving for ck. Taking the 2D finite-difference approximation of Eq 1 and dropping the index k for brevity, this yields
(2) |
for each position (i, j) on the simulation lattice. Here, P is the production matrix containing the production rates of the molecule at each position, d is the degradation rate and D the diffusion rate. Since we consider periodic boundary conditions, all indices in Eq 2 should be read modulo N.
Eq 2 is a linear system of N × N equations. To solve it efficiently, we make use of Fourier transformations. Because we assume a square simulation lattice and periodic boundary conditions, ci,j is a discrete periodic function with period N in both indices. Let G be the degradation-diffusion kernel at (1, 1):
(3) |
such that Gi,j describes the diffusion and degradation effects of the molecule concentration in lattice site (i, j) on the concentration in lattice site (1, 1). The N × N equations defined by Eq 2 can then be rewritten as
(4) |
where c*N G is the circular discrete convolution of matrices c and G. By the circular convolution theorem, c*N G is equal to the inverse Fourier transform of the element-wise product of the individual Fourier transforms of c and G, i.e. we can solve from
(5) |
and then compute the inverse Fourier transform to get the concentration matrix c. Since the degradation and diffusion rates of the molecules are constant over the simulation, so is G. Hence, needs to be calculated only once per simulation, and at each simulation time step we are left with finding the Fourier transform of the production matrix, dividing the result element-wise by , and then using the inverse Fourier transform to find c. Fourier transformations were performed using the fftw3-library [62]. Since algorithms for Fourier transformations are highly efficient [62], Eq 5 allows us to rapidly find the quasi-steady-state concentration profiles even for large simulation lattices.
Population dynamics of bacteria
Every time step, the phenotype of bacteria (toxin production ϕT, resistance ϕR, and cue response ϕC) is determined based on their genotype and the current local cue concentration (Fig 1A). If a gene is regulated, it is expressed only if the cue concentration exceeds the cell’s response threshold θ.
The probability of cell death per time step has a basal value δ and increases linearly with the local toxin concentration , unless the bacterium is resistant:
(6) |
The slope δtox describes the toxicity of the toxin. When bacteria die, they leave behind an empty lattice site.
Empty sites can be repopulated by reproduction of bacteria on the eight neighbouring lattice sites. For each empty lattice site, the probability that it becomes occupied by reproduction of any of its neighbouring bacteria in the current time step is
(7) |
where γ is a scaling factor determining the maximal reproduction rate per time step and Ri is the reproductive fitness of the i-th neighbour (further specified below). If reproduction occurs, neighbour j is selected as the parent with probability
(8) |
Eqs 7 and 8 ensure that (i) the overall probability of reproduction increases with the total reproductive fitness of the eight neighbours but never exceeds 1, and (ii) the probability of reproduction of a specific cell is determined by its reproductive fitness relative to its local competitors.
Toxin production, resistance, and the ability to respond to the density cue bear metabolic costs. The metabolic costs of cell j’s phenotype are linearly incorporated in its reproductive fitness as
(9) |
The costs for resistance (CR) and the ability to respond to the cue (CC) are given by single parameters. The cost for toxin production linearly depends on the cell’s toxin production rate πT, with offset and slope bT. Note that we do not include a cost for cue production. Because all cells produce the density cue (at the same rate), such a cost would be the same for all phenotypes, and hence would not influence the competition between cells of different phenotypes.
Mutations
When a bacterium reproduces, the daughter cell generally inherits the genotype of its parent. With small probability, however, mutations are introduced. First, mutations can alter the toxin and resistance gene. If a mutation generates a cell that produces toxin while not simultaneously expressing resistance, this cell is considered nonviable and discarded from the simulation. Second, mutations in the response threshold value θ are introduced with a fixed probability μ. If the parent cell has a regulating genotype, the mutated response threshold is generally drawn from a uniform distribution on the interval [θparent − σμ; θparent + σμ] (if the new threshold value is below 0, it is set to 0). However, to ensure that the genotype space is sufficiently accessible, with probability plargemut = 10−3 the new response threshold is chosen randomly between 0 and 1. Response threshold values of regulating daughter cells with a non-regulating parent are also uniformly sampled from [0, 1]. Third, mutations in the toxin production rate πT are introduced in the same way as response threshold mutations, with the same rate μ, step size σμ, and probability of not inheriting the parental value plargemut.
The number of ways a functional sequence can be removed or destroyed by small-scale mutations (substitutions, short indels) usually greatly exceeds the number of mutations that can create such a functional sequence, simply because most sequences do not perform the desired function. For larger scale mutations, gene loss is thought to be the major driver of evolution of many prokaryotic lineages over relatively short evolutionary times (e.g., within genera), occurring several times more frequently than de novo gene discovery and gene gain through horizontal gene transfer [63, 64]. We therefore consider gain-of-function mutations (Off → On, Off → Reg, and On → Reg) to be less likely than loss-of-function mutations (On → Off, Reg → Off, and Reg → On).
Parameter sweep
Parameter reduction and parameter values
Altogether, the model has 18 parameters. Brute-force sampling an 18-dimensional parameter space in an exploratory parameter sweep is computationally infeasible. Fortunately, the parameter space can be reduced by identifying lumped parameters (Table 1, see S1 Text for derivations). The 13 parameters remaining after the parameter reduction include the 5 mutation parameters and the delay between expression of resistance and toxin in (Reg, Reg)-cells τdelay. Over many test runs we observed that these parameters only marginally affect the simulation results, as long as mutations happen reasonably frequently. The mutation parameters and τdelay were therefore fixed at default values (Table 1). To further reduce the number of parameters included in our parameter sweep, we finally noted that the offset defines a minimal cost of toxin production and should hence be > 0 to make sure toxin production is never “free”, but should also not be too large because else toxin production can never evolve. Because is also a measure for the cost of toxin production, we chose to keep constant, and only vary in the parameter sweep along with the five other remaining parameters (Table 1).
To capture the different potential evolutionary outcomes for varying bacterial species and environments, we varied our parameters over relatively broad ranges in a parameter sweep (Table 1). Since we aimed to investigate regulation by local cell density, the characteristic length scale Lcue of the density cue was chosen between 2 and 20 lattice sites. To set reasonable values for the toxin length scale Ltox, we noted that in many KRS-models toxin-dependent killing is limited to direct neighbours in space [7, 11, 29, 65]. Experiments show, however, that the inhibition range of toxins is generally much larger, and can span several tens or even hundreds of μm [6, 56]. For colicins, a length scale of 100—175 μm has been reported [44], which corresponds in size to at least 50 bacteria. We therefore chose the range of Ltox twice as broad as the range for Lcue (Table 1). KRS-systems in general, and regulation of toxin production in particular, evolved more readily for small values of Ltox (see Fig 3), so an even wider range would not yield more insight into the model.
To determine bounds on δ/γ, note that this lumped parameter is equal to R0−1 of the bacteria, where R0 is the maximal expected number of offspring of a sensitive cell (i.e. when it is completely surrounded by empty space). Any population with R0 < 1 is nonviable. Note, furthermore, that for a sensitive population at carrying capacity the cell density is equal to 1 − R0−1. Since toxin production is most likely to evolve in high-density environments where competition for empty space is strong, the range of δ/γ was chosen such that the density of cells at carrying capacity is at least 50%.
For the three cost parameters, a lower bound of 0.01 was chosen to avoid the occurrence of “free” phenotypes that are not selected for. Metabolic costs for toxin production and resistance have been shown to exist for various toxins, although the extent of these costs may differ between toxins and bacterial species [6–8, 44, 66]. To capture these different scenarios, we vary the toxin production cost and resistance cost parameters between the lower bound of 0.01 and relatively high values. For the resistance cost, we go up to a cost of 25% of the reproduction rate, while for the toxin production we set an upper bound on such that the reproduction rate of producing cells would be 0 if its production rate πT = 1. Since we expect regulation to evolve only if the costs of regulation are lower than the costs of the regulated behaviours (toxin production and resistance), we consider a narrower range for the cue response cost CC (Table 1).
Simulations and analysis
To sample the parameter space, 2000 simulations were performed for random combinations of the six lumped parameters. Parameter values were independently sampled from uniform distributions with a wide, parameter-specific range (Table 1). Simulations were initialised with a randomly selected 10% of lattice sites occupied by cells with random genotypes (response threshold values and the toxin production rate values were randomly chosen between 0 and 1), and were run for 400, 000 time steps (generally sufficient to reach evolutionary steady state). The mean fraction of cells with each possible geno-/phenotype combination was calculated over the last 50, 000 simulation time steps. Based on these genotype and phenotype abundances the simulations were classified using a decision tree with several steps (S1 Fig). In the first step, simulations were assessed on the abundance of phenotypes (S: sensitives, R: resistants, or K: killers), and a phenotype was called “fixed” if it was present at > 98% abundance. Only fixation of sensitives was observed; resistance or toxin production never fixed. If cells of all three possible phenotypes (K, R and S) occurred at appreciable abundance (defined as > 2% of the population), the simulation was classified as “KRS”. Simulations that did not yield fixation of a single phenotype or KRS-dynamics were classified as “other”. In the second step, simulations within the KRS-class were considered to show “potential regulation” if at least one regulating genotype was present at > 2% abundance. In the final third step, these “potential regulation” cases were only classified as “true regulation” if at least 10% of the cells of the regulating genotype were in the inactive phenotype (regulated gene not expressed), and at least 10% were in the active phenotype. Altogether, this classification assigned all simulations to one of four evolutionary outcomes: (1) Sensitives fix, (2) KRS-dynamics, no regulation evolved, (3) KRS-dynamics, regulation evolved, and (4) other (S1 Fig).
Invasion speeds
To understand why the regulating killer cells (genotype (Reg, On)) can outcompete constitutive killer cells (genotype (On, On)) under certain conditions, we compared invasion dynamics of these two killer types. To allow for a fair comparison, we first evolved constitutive killers under conditions that would usually favour regulation by removing the possibility of regulation from the model (S3A Fig, evolved under the same parameter conditions as Fig 4). Over three replicate simulations, constitutive killers under these conditions evolved a mean toxin production rate of πT = 0.13. Over the ten replicate simulations of evolving (Reg, On)-killers, these cells evolved a mean toxin production rate of πT = 0.8 and a mean response threshold of θ = 0.875 (S2 Fig). We therefore constructed two “average evolved killer strains”, a constitutive killer with genotype (On, On) and πT = 0.13, and a regulating killer with genotype (Reg, On), πT = 0.8 and θ = 0.875, and compared the invasion dynamics of these two constructed killer strains.
To characterise the invasion into a sensitive population, a 20-cell-wide strip of one of the two killer strains was placed on a lattice that was otherwise filled with a sensitive population at carrying capacity (S3B Fig). Population dynamics were then simulated and the decline of the number of sensitives over time was followed (S3B Fig). The invasion speed was calculated as
(10) |
where βS on t is the linear regression coefficient of the number of sensitive cells on time, N is the number of rows of the simulation lattice and KS = (1 − δ/γ) is the density of sensitive cells at carrying capacity. Similarly, the invasion speed of resistant cells (genotype (Off, On)) into a population of (Reg, On)-cells and (On, On)-cells was measured by placing a 20-cell-wide strip of resistant cells on a lattice otherwise filled with (Reg, On)-cells or (On, On)-cells at carrying capacity and calculating
(11) |
where βR on t is the linear regression coefficient of the number of resistant cells on time and KR = (1 − δ/(γ(1 − cR)) is the density of sensitive cells at carrying capacity. (The invasion speeds we measure here serve as a tool to quantify the difference between the two killer strains and thus better understand the evolutionary outcome of the simulations. For a more formal analysis of the effect of toxin production and quorum sensing on invasion speeds, see [67]).
Note that to calculate the decline of the number of sensitives is used, while in the calculation of the increase in the number of resistant cells is considered. This choice was made because the characteristics of the sensitive strain and the resistant strain are the same in both invasion experiments, while the two killer strains differ. For each invasion experiment, 10 replicate runs were performed.
Serial transfers
Under the serial transfer regime, simulations were again initialised with cells with random genotypes placed at a random 10% of lattice sites. Population dynamics were simulated as before, except that the simulations were periodically paused and a transfer was performed. At each transfer, a random sample of the population at the end of the growth cycle was taken as founder cells for the new population. These founder cells were then randomly placed on an otherwise empty simulation lattice, and the simulation of the population dynamics was resumed until the next transfer. Unless otherwise noted, transfers were performed every 500 simulation time steps, and each new cycle was seeded with 1000 founder cells. Simulations were continued for 800 (parameter sweep) or 1200 (example runs) transfer cycles. Evolutionary steady state was generally reached well before the end of the simulation.
Supporting information
Data Availability
All relevant data are within the manuscript and its Supporting Information files.
Funding Statement
This work was supported by the Human Frontier Science Program grant nr. RGY0072/2015 (HMD, RH), http://www.hfsp.org/funding/research-grants. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Klaenhammer TR. Bacteriocins of lactic acid bacteria. Biochimie. 1988;70(3):337–349. 10.1016/0300-9084(88)90206-4 [DOI] [PubMed] [Google Scholar]
- 2. Riley MA, Wertz JE. Bacteriocin diversity: ecological and evolutionary perspectives. Biochimie. 2002;84(5–6):357–364. 10.1016/s0300-9084(02)01421-9 [DOI] [PubMed] [Google Scholar]
- 3. Gonzalez D, Mavridou DAI. Making the Best of Aggression: The Many Dimensions of Bacterial Toxin Regulation. Trends Microbiol. 2019. 10.1016/j.tim.2019.05.009 [DOI] [PubMed] [Google Scholar]
- 4. Cornforth DM, Foster KR. Competition sensing: the social side of bacterial stress responses. Nat Rev Microbiol. 2013;11(4):285–293. 10.1038/nrmicro2977 [DOI] [PubMed] [Google Scholar]
- 5. García-Bayona L, Comstock LE. Bacterial antagonism in host-associated microbial communities. Science. 2018;361(6408):eaat2456 10.1126/science.aat2456 [DOI] [PubMed] [Google Scholar]
- 6. Chao L, Levin BR. Structured habitats and the evolution of anticompetitor toxins in bacteria. Proc Natl Acad Sci U S A. 1981;78(10):6324–6328. 10.1073/pnas.78.10.6324 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Kerr B, Riley MA, Feldman MW, Bohannan BJM. Local dispersal promotes biodiversity in a real-life game of rock–paper–scissors. Nature. 2002;418(6894):171–174. 10.1038/nature00823 [DOI] [PubMed] [Google Scholar]
- 8. Riley MA, Wertz JE. Bacteriocins: Evolution, Ecology, and Application. Annu Rev Microbiol. 2002;56(1):117–137. 10.1146/annurev.micro.56.012302.161024 [DOI] [PubMed] [Google Scholar]
- 9. Gardner A, West SA, Buckling A. Bacteriocins, spite and virulence. Proc R Soc B: Biol Sci. 2004;271(1547):1529–1535. 10.1098/rspb.2004.2756 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Nadell CD, Xavier JB, Foster KR. The sociobiology of biofilms. FEMS Microbiol Rev. 2009;33(1):206–224. 10.1111/j.1574-6976.2008.00150.x [DOI] [PubMed] [Google Scholar]
- 11. Durrett R, Levin S. Allelopathy in Spatially Distributed Populations. J Theor Biol. 1997;185(2):165–171. 10.1006/jtbi.1996.0292 [DOI] [PubMed] [Google Scholar]
- 12. Kirkup BC, Riley MA. Antibiotic-mediated antagonism leads to a bacterial game of rock–paper–scissors in vivo. Nature. 2004;428(6981):412–414. 10.1038/nature02429 [DOI] [PubMed] [Google Scholar]
- 13. Narisawa N, Haruta S, Arai H, Ishii M, Igarashi Y. Coexistence of Antibiotic-Producing and Antibiotic-Sensitive Bacteria in Biofilms Is Mediated by Resistant Bacteria. Appl Environ Microbiol. 2008;74(12):3887–3894. 10.1128/AEM.02497-07 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Bucci V, Nadell CD, Xavier JB, Day AET, McPeek EMA. The Evolution of Bacteriocin Production in Bacterial Biofilms. Am Nat. 2011;178(6):E162–E173. 10.1086/662668 [DOI] [PubMed] [Google Scholar]
- 15. Reichenbach T, Mobilia M, Frey E. Mobility promotes and jeopardizes biodiversity in rock–paper–scissors games. Nature. 2007;448(7157):1046–1049. 10.1038/nature06095 [DOI] [PubMed] [Google Scholar]
- 16. Szolnoki A, Mobilia M, Jiang LL, Szczesny B, Rucklidge AM, Perc M. Cyclic dominance in evolutionary games: a review. J R Soc Interface. 2014;11(100):20140735 10.1098/rsif.2014.0735 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. LeRoux M, Peterson SB, Mougous JD. Bacterial danger sensing. J Mol Biol. 2015;427(23):3744–3753. 10.1016/j.jmb.2015.09.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Kleerebezem M, Quadri LE. Peptide pheromone-dependent regulation of antimicrobial peptide production in Gram-positive bacteria: a case of multicellular behavior. Peptides. 2001;22(10):1579–1596. 10.1016/s0196-9781(01)00493-4 [DOI] [PubMed] [Google Scholar]
- 19. Jimenez JC, Federle MJ. Quorum sensing in group A Streptococcus. Front Cell Infect Microbiol. 2014;4 10.3389/fcimb.2014.00127 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Nealson KH, Platt T, Hastings JW. Cellular Control of the Synthesis and Activity of the Bacterial Luminescent System 1. J Bacteriol. 1970;104(1):313–322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Miller MB, Bassler BL. Quorum Sensing in Bacteria. Ann Rev Microbiol. 2001;55(1):165–199. 10.1146/annurev.micro.55.1.165 [DOI] [PubMed] [Google Scholar]
- 22. Diggle SP, Griffin AS, Campbell GS, West SA. Cooperation and conflict in quorum-sensing bacterial populations. Nature. 2007;450(7168):411–414. 10.1038/nature06279 [DOI] [PubMed] [Google Scholar]
- 23. Darch SE, West SA, Winzer K, Diggle SP. Density-dependent fitness benefits in quorum-sensing bacterial populations. Proc Natl Acad Sci U S A. 2012;109(21):8259–8263. 10.1073/pnas.1118131109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Brookfield JFY. Quorum Sensing and Group Selection. Evolution. 1998;52(5):1263–1269. 10.1111/j.1558-5646.1998.tb02007.x [DOI] [PubMed] [Google Scholar]
- 25. Brown SP, Johnstone RA. Cooperation in the dark: signalling and collective action in quorum-sensing bacteria. Proc R Soc B: Biol Sci. 2001;268(1470):961–965. 10.1098/rspb.2001.1609 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Nadell CD, Xavier JB, Levin SA, Foster KR. The Evolution of Quorum Sensing in Bacterial Biofilms. PLOS Biol. 2008;6(1):e14 10.1371/journal.pbio.0060014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Czárán T, Hoekstra RF. Microbial Communication, Cooperation and Cheating: Quorum Sensing Drives the Evolution of Cooperation in Bacteria. PLoS ONE. 2009;4(8):e6655 10.1371/journal.pone.0006655 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Drescher K, Nadell CD, Stone HA, Wingreen NS, Bassler BL. Solutions to the public goods dilemma in bacterial biofilms. Curr Biol. 2014;24(1):50–55. 10.1016/j.cub.2013.10.030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Czárán T, Hoekstra RF. A spatial model of the evolution of quorum sensing regulating bacteriocin production. Behav Ecol. 2007;18(5):866–873. 10.1093/beheco/arm061 [DOI] [Google Scholar]
- 30. Korgaonkar AK, Whiteley M. Pseudomonas aeruginosa Enhances Production of an Antimicrobial in Response to N-Acetylglucosamine and Peptidoglycan. J Bacteriol. 2011;193(4):909–917. 10.1128/JB.01175-10 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Picioreanu C, Loosdrecht MCMV, Heijnen JJ. Effect of diffusive and convective substrate transport on biofilm structure formation: A two-dimensional modeling study. Biotechnol Bioeng. 2000;69(5):504–515. [DOI] [PubMed] [Google Scholar]
- 32. Xavier JB, Foster KR. Cooperation and conflict in microbial biofilms. Proc Natl Acad Sci U S A. 2007;104(3):876–881. 10.1073/pnas.0607651104 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Claverys JP, Håvarstein LS. Cannibalism and fratricide: mechanisms and raisons d’être. Nat Rev Microbiol. 2007;5(3):219–229. 10.1038/nrmicro1613 [DOI] [PubMed] [Google Scholar]
- 34. Berg KH, Biornstad TJ, Johnsborg O, Havarstein LS. Properties and Biological Role of Streptococcal Fratricins. Appl Environ Microbiol. 2012;78(10):3515–3522. 10.1128/AEM.00098-12 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Slager J, Aprianto R, Veening JW. Refining the pneumococcal competence regulon by RNA-sequencing. J Bacteriol. 2019; p. JB.00780-18 10.1128/JB.00780-18 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Monod J. The Growth of Bacterial Cultures. Ann Rev Microbiol. 1949;3(1):371–394. 10.1146/annurev.mi.03.100149.002103 [DOI] [Google Scholar]
- 37. Rolfe MD, Rice CJ, Lucchini S, Pin C, Thompson A, Cameron ADS, et al. Lag Phase Is a Distinct Growth Phase That Prepares Bacteria for Exponential Growth and Involves Transient Metal Accumulation. J Bacteriol. 2012;194(3):686–701. 10.1128/JB.06112-11 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Lenski RE, Rose MR, Simpson SC, Tadler SC. Long-Term Experimental Evolution in Escherichia coli. I. Adaptation and Divergence During 2,000 Generations. Am Nat. 1991;138(6):1315–1341. 10.1086/285289 [DOI] [Google Scholar]
- 39. Rainey PB, Travisano M. Adaptive radiation in a heterogeneous environment. Nature. 1998;394(6688):69 10.1038/27900 [DOI] [PubMed] [Google Scholar]
- 40. Velicer GJ, Yu YtN. Evolution of novel cooperative swarming in the bacterium Myxococcus xanthus. Nature. 2003;425(6953):75 10.1038/nature01908 [DOI] [PubMed] [Google Scholar]
- 41. Kawecki TJ, Lenski RE, Ebert D, Hollis B, Olivieri I, Whitlock MC. Experimental evolution. Trends Ecol Evol. 2012;27(10):547–560. 10.1016/j.tree.2012.06.001 [DOI] [PubMed] [Google Scholar]
- 42. Inglis RF, Scanlan P, Buckling A. Iron availability shapes the evolution of bacteriocin resistance in Pseudomonas aeruginosa. ISME J. 2016;10(8):2060–2066. 10.1038/ismej.2016.15 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Xavier JB, Kim W, Foster KR. A molecular mechanism that stabilizes cooperative secretions in Pseudomonas aeruginosa. Mol Microbiol. 2011;79(1):166–179. 10.1111/j.1365-2958.2010.07436.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Weber MF, Poxleitner G, Hebisch E, Frey E, Opitz M. Chemical warfare and survival strategies in bacterial range expansions. J R Soc Interface. 2014;11(96). 10.1098/rsif.2014.0172 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Atwood KC, Schneider LK, Ryan FJ. Periodic Selection in Escherichia coli. Proc Natl Acad Sci U S A. 1951;37(3):146–155. 10.1073/pnas.37.3.146 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Levin BR, Perrot V, Walker N. Compensatory mutations, antibiotic resistance and the population genetics of adaptive evolution in bacteria. Genetics. 2000;154(3):985–997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Schluter J, Schoech AP, Foster KR, Mitri S. The Evolution of Quorum Sensing as a Mechanism to Infer Kinship. PLOS Comput Biol. 2016;12(4):e1004848 10.1371/journal.pcbi.1004848 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Queller DC. Genetic relatedness in viscous populations. Evol Ecol. 1994;8(1):70–73. 10.1007/BF01237667 [DOI] [Google Scholar]
- 49. Gardner A, West SA. Spite and the scale of competition. J Evol Biol. 2004;17(6):1195–1203. 10.1111/j.1420-9101.2004.00775.x [DOI] [PubMed] [Google Scholar]
- 50. Qi F, Merritt J, Lux R, Shi W. Inactivation of the ciaH Gene in Streptococcus mutans Diminishes Mutacin Production and Competence Development, Alters Sucrose-Dependent Biofilm Formation, and Reduces Stress Tolerance. Infect Immun. 2004;72(8):4895–4899. 10.1128/IAI.72.8.4895-4899.2004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Merritt J, Kreth J, Shi W, Qi F. LuxS controls bacteriocin production in Streptococcus mutans through a novel regulatory component. Mol Microbiol. 2005;57(4):960–969. 10.1111/j.1365-2958.2005.04733.x [DOI] [PubMed] [Google Scholar]
- 52. Hense BA, Schuster M. Core Principles of Bacterial Autoinducer Systems. Microbiol Mol Biol Rev. 2015;79(1):153–169. 10.1128/MMBR.00024-14 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Whiteley M, Diggle SP, Greenberg EP. Progress in and promise of bacterial quorum sensing research. Nature. 2017;551(7680):nature24624 10.1038/nature24624 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54. Krin E, Chakroun N, Turlin E, Givaudan A, Gaboriau F, Bonne I, et al. Pleiotropic Role of Quorum-Sensing Autoinducer 2 in Photorhabdus luminescens. Appl Environ Microbiol. 2006;72(10):6439–6451. 10.1128/AEM.00398-06 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55. Be’er A, Zhang HP, Florin EL, Payne SM, Ben-Jacob E, Swinney HL. Deadly competition between sibling bacterial colonies. Proc Natl Acad Sci U S A. 2009;106(2):428–433. 10.1073/pnas.0811816106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56. Mavridou DAI, Gonzalez D, Kim W, West SA, Foster KR. Bacteria Use Collective Behavior to Generate Diverse Combat Strategies. Curr Biol. 2018;28(3):345–355.e4. 10.1016/j.cub.2017.12.030 [DOI] [PubMed] [Google Scholar]
- 57. Pugsley AP. Autoinduced synthesis of colicin E2. Mol Gen Genet. 1983;190(3):379–383. 10.1007/bf00331062 [DOI] [PubMed] [Google Scholar]
- 58. Ghazaryan L, Soares MIM, Gillor O. Auto-regulation of DNA degrading bacteriocins: molecular and ecological aspects. Antonie van Leeuwenhoek. 2014;105(5):823–834. 10.1007/s10482-014-0136-1 [DOI] [PubMed] [Google Scholar]
- 59. Alkhatib Z, Abts A, Mavaro A, Schmitt L, Smits SHJ. Lantibiotics: How do producers become self-protected? J Biotechnol. 2012;159(3):145–154. 10.1016/j.jbiotec.2012.01.032 [DOI] [PubMed] [Google Scholar]
- 60. Blanchard AE, Liao C, Lu T. An Ecological Understanding of Quorum Sensing-Controlled Bacteriocin Synthesis. Cel Mol Bioeng. 2016; p. 1–12. [Google Scholar]
- 61. Hibbing ME, Fuqua C, Parsek MR, Peterson SB. Bacterial competition: surviving and thriving in the microbial jungle. Nat Rev Microbiol. 2010;8(1):15–25. 10.1038/nrmicro2259 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62. Frigo M, Johnson SG. The design and implementation of FFTW3. Proc IEEE Inst Electr Electron Eng. 2005;93(2):216–231. 10.1109/JPROC.2004.840301 [DOI] [Google Scholar]
- 63. Makarova K, Slesarev A, Wolf Y, Sorokin A, Mirkin B, Koonin E, et al. Comparative genomics of the lactic acid bacteria. Proc Natl Acad Sci U S A. 2006;103(42):15611–15616. 10.1073/pnas.0607117103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64. Puigbò P, Lobkovsky AE, Kristensen DM, Wolf YI, Koonin EV. Genomes in turmoil: quantification of genome dynamics in prokaryote supergenomes. BMC Biol. 2014;12(1):66 10.1186/s12915-014-0066-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65. Czárán TL, Hoekstra RF, Pagie L. Chemical warfare between microbes promotes biodiversity. Proc Natl Acad Sci U S A. 2002;99(2):786–790. 10.1073/pnas.012399899 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66. Dykes GA, Hastings JW. Selection and fitness in bacteriocin–producing bacteria. Proc R Soc B: Biol Sci. 1997;264(1382):683–687. 10.1098/rspb.1997.0097 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67. Bewick S, Staniczenko PPA, Li B, Karig DK, Fagan WF. Invasion speeds in microbial systems with toxin production and quorum sensing. J Theor Biol. 2017;420:290–303. 10.1016/j.jtbi.2017.01.034 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All relevant data are within the manuscript and its Supporting Information files.