Abstract
Background
Antimicrobial resistance is a global health problem that demands all possible means to control it. Mathematical modelling is a valuable tool for understanding the mechanisms of AMR development and spread, and can help us to investigate and propose novel control strategies. However, it is of vital importance that mathematical models have a broad utility, which can be assured if good modelling practice is followed.
Objective
The objective of this study was to provide a comprehensive systematic review of published models of AMR development and spread. Furthermore, the study aimed to identify gaps in the knowledge required to develop useful models.
Methods
The review comprised a comprehensive literature search with 38 selected studies. Information was extracted from the selected papers using an adaptation of previously published frameworks, and was evaluated using the TRACE good modelling practice guidelines.
Results
None of the selected papers fulfilled the TRACE guidelines. We recommend that future mathematical models should: a) model the biological processes mechanistically, b) incorporate uncertainty and variability in the system using stochastic modelling, c) include a sensitivity analysis and model external and internal validation.
Conclusion
Many mathematical models of AMR development and spread exist. There is still a lack of knowledge about antimicrobial resistance, which restricts the development of useful mathematical models.
Background
The discovery of antimicrobials in medicine in the 1920s was regarded as a miracle. Since then, millions of lives have been saved as a result of this treatment. However, history has shown that the introduction of any kind of antimicrobial compound into human or veterinary medicine is swiftly followed by emerging resistance to that compound [1]. Antimicrobial resistance (AMR) is threatening our ability to treat common infectious diseases, resulting in prolonged illness, disability and death [2]. Multidrug and even pan-resistant organisms are now a worldwide problem. Despite the difficulty in estimating the actual costs of AMR, the true economic burden is substantial [3]. The estimated economic consequences of AMR in Europe in 2007 were at least €1.5 billion, while they were estimated to be $55 billion in the US in 2000 (cited from Gandra et al., 2014 [3]). It is therefore of utmost importance to limit the emergence and spread of AMR.
AMR is spreading globally - not just in the human population, but also in animal populations and the environment. Furthermore, there is consistent evidence that an exchange of bacteria resistant to antimicrobials and AMR determinants exists between these different compartments [4]. AMR determinants have been shown to survive in environments such as sludge and wastewater treatment systems [5, 6], thus allowing for the transmission of infectious bacteria and accelerating the problem of AMR.
Mathematical models have become important decision support tools in medicine and public health [7]. They have helped in improving our understanding of the development, emergence and spread of AMR [7, 8]. In addition, they can identify gaps in our knowledge, and direct research towards missing information for important parameters and processes in the modelled system. However, in 2006, Opatowski et al. [7] published a review on mathematical models on AMR and concluded that there was still a need for major improvements of AMR models such as regarding implementing important features of pathogen including resistance mechanisms and inter-species cooperation. Continual evaluation of published mathematical models is therefore necessary for us to recognise the progress in AMR modelling. Gaps in our knowledge can be identified, and this can be used to set the agenda and form suitable hypotheses for future research in the fight against AMR.
Grimm et al. [9] updated the TRACE paradigm that was established in 2010 with the aim of developing guidelines to produce useful models. The TRACE paradigm includes eight elements that, when followed, ensure that models are clearly communicated when published. These elements are: 1) Problem formulation (clear formulation of the objective and a description of the context of the model); 2) Model description (written description of model elements to allow readers to understand and replicate the model); 3) Data evaluation (an assessment of the quality of data used to parameterise the model); 4) Conceptual model evaluation (a list and explanation of the most important conceptual design decisions); 5) Implementation verification (internal validation of the model, testing for programming errors and assessing model performance); 6) Model output verification (external validation, testing whether the model output matches the observations); 7) Model analysis (mainly sensitivity analysis); 8) Model output corroboration (a comparison of model output with data that were not used to create the model). For a full description of the TRACE elements, see Grimm et al. [9].
Since the comprehensive systematic review of mathematical models between 1993 and 2006 was conducted by Temime et al. [10], a number of additional reviews have been published [7, 8, 11]. However, these reviews either focused on models linking antibiotic use to AMR [11] or modelling AMR in populations (humans and bacteria) and hospitals [7], and did not include exclusively within-host models [8]. These systematic reviews did not examine models of AMR in relation to animal populations and the environment. However, a comprehensive review of mathematical models of AMR should consider models of all relevant populations and ecosystems in order to target the AMR problem from a One-Health perspective. In this way, researchers from different fields could benefit from experiences and advances in the other fields.
The objective of this review was to assess the usefulness of mathematical and simulation models of AMR development and/or spread in individuals and/or populations of humans, animals and bacteria, as well as in the environment. We also aimed to identify gaps in the knowledge needed to provide useful models of AMR. The assessment was achieved using a systematic review. The published models were then summarised and compared using an adapted version of previously developed frameworks [7, 8]. Furthermore, the strengths and weaknesses of the models were discussed using the TRACE paradigm [9] .
Methods
This is a systematic review following the PRISMA guidelines [12] without the use of an existing review protocol.
Selection of papers and search criteria
The search was performed in PubMed and Web of Science on 6th February 2017. We used the following search terms:
In PubMed three searches were performed:
((((((((antimicrobial) OR antibiotic) OR antibacterial) AND “last 10 years”[PDat])) AND resistan*) AND model[Title]) AND “last 10 years”[PDat] AND English[lang]).
((((((((antimicrobial) OR antibiotic) OR antibacterial) AND “last 10 years”[PDat])) AND resistan*) AND model[Title]) AND “last 10 years”[PDat] AND English[lang]).
In Web of Science three searches were performed:
TS = (resistan*) AND (TS = (antibacterial) OR TS = (antimicrobial) OR TS = (antibiotic)) AND TITLE: (model*) ENGLISH, ARTICLE, REVEIW, 2006–2017 & TS = (resistan*)
(TS = (antibacterial) OR TS = (antimicrobial) OR TS = (antibiotic)) AND TITLE: (population dynamic*) ENGLISH, ARTICLE, REVIEW, 2006–2017
TS = (resistan*) AND (TS = (antibacterial) OR TS = (antimicrobial) OR TS = (antibiotic)) AND TITLE: (simulat*) ENGLISH, ARTICLE, REVIEW, 2006–2017
We checked for duplicates between the two databases, and excluded papers based on titles. More papers were excluded after the abstracts of all papers were screened. Finally, following full screening of the papers, some were deemed not to fulfil the inclusion criteria and were therefore excluded (Fig. 1). The screening of abstracts and full papers was carried out by three of the authors, with each person reading 2/3 of the abstracts and 2/3 of the full papers.
Papers were included if they: 1) presented not previous published mathematical models that represented the development and/or spread of AMR; 2) modelled AMR in bacteria, humans, animal or the environment, and 3) included the effect of antimicrobial compounds. Papers that focused on only the spread of a specific resistant bacterial pathogen were not included. In addition, papers based solely on statistical analysis were also excluded, as this review focuses on mathematical models.
Previously published reviews of mathematical models of AMR were identified during the review process. The reference lists of these reviews were scrutinised to identify additional papers that might fit the inclusion criteria. These are referred to as “papers identified by other means”.
Analysing the papers
Three of the authors read the selected papers. Each person read a random sample of 2/3 of the papers (as described above), while ensuring that each paper was read by two authors. Information about the papers was extracted and sorted into five constructs (model description, modelling technique, modelling pathways, model specifications and model validation).
Relevant information for each of the five constructs was extracted from the papers. This information is described in Table 1. Furthermore, information on the following descriptive parameters was extracted from the papers: programming software, year of the publication of the paper, and the country of affiliation of the first author.
Table 1.
Construct | Attributes | Levels | Comments |
---|---|---|---|
Model description | Modelled process | Spread of AMR Development of AMR Spread and development of AMR |
Other types of AMR processes were for example fitness cost and difference in resistance due to the age of bacteria. |
Model type | Agent based Nested model Individual based Population Other models |
Other model types were: Beverton-Holt, cellular automata, band-pass, or chemostat model. | |
Population | Animal species Bacteria Humans |
No specified host was used in cases where only the bacterial population was modelled. | |
Environment | River Slurry Cellular automata Community Farm Hospital Human Animal species In vitro Not specified |
Hospital refers to both human and veterinary hospitals. | |
Modelling techniques | Simulation / analytic | Simulation Analytic Analytic & simulation |
|
Uncertainty display | Deterministic Stochastic Deterministic & stochastic |
Both deterministic and stochastic were used for example in the case of nested models and papers comparing deterministic and stochastic models. | |
Modelling population interactions | Mixing of population | Homogenous mixing Heterogeneous mixing Homogenous & heterogeneous mixing Not relevant |
Both heterogeneous and homogenous mixing refers to e.g. rivers and network models with homogenous mixing at the nodes but heterogeneous between nodes. Not relevant may refer to development of specific traits such as efflux pumps. |
Co-existence levela | No conversion Single strain Uni-directional Bi-directional |
Uni-directional was defined as a one-way conversion from resistant strain/carrier to sensitive strain/carrier or vice versa, whereas bi-directional conversion was possible in case of a two-way conversion. In case of no conversion, only competition between strains was possible. | |
Model specification | AMR display | Genotypic AMR Phenotypic AMR Genotypic & phenotypic AMR Other types of AMR |
Other types of AMR describing a more molecular AMR mechanism were for example modelling of efflux pumps or plasmids. |
Number of resistant strains | Single resistant strain Multiple resistant strains |
Multiple resistance means that two or more strains of the same bacterial species resistant to antimicrobials were modelled | |
Bacterial species | Specified Not specified |
If specified, the specific species was noted | |
Dosing of the antimicrobial | Constant dosing Other dosing |
Other dosing was for example specific treatment strategy or spatial distribution | |
Antimicrobial compound | Single, not specified Single, specified Multiple, not specified Multiple, specified |
If specified, the specific compound was noted | |
Immune system | Yes No Not relevant |
Not relevant describes situations where the model did not incorporate a human or animal host with a functioning immune system. | |
Model validation | Model validation | Literature No validation |
|
Sensitivity analysis | Yes No |
||
Bifurcation analysis | Yes No |
AMR Antimicrobial resistance; athe co-existence level was described according to Spicknall et al. [8], modified to population leve
Model usefulness and documentation
We used the TRACE framework for good practice in model development and documentation developed by Grimm et al. [9] to evaluate the conformity of the models to the TRACE guidelines. These guidelines ensure that useful models are produced.
Studies were initially evaluated according to the constructs described in Table 1. Hereafter, studies that had verified the model and conducted sensitivity analysis – hence complying with two of the TRACE criteria [9] (Criteria 6 and 7) – were identified. These studies were further evaluated to assess whether they fulfilled the remaining criteria.
Results
Exclusion of papers
Studies that were excluded based on their title mainly included models of pathogen spread and the mode of action of antimicrobial compounds. The main reason for excluding studies based on the abstract or the full paper was that the study described statistical models of AMR spread and development. Another reason for exclusion was that the studies described a model of resistant bacteria without any susceptible counterpart, therefore merely describing a model of bacterial spread within a population. The exclusion of papers is described in Fig. 1.
Assessing the included papers
The vast majority of the models were population models (77%), while a small number were individual- or agent-based models. Only one was a nested model, in which individuals (pigs) and the bacterial populations inside them were modelled (Table 2).
Table 2.
Modelled process | Model type | Population | Environment | Reference no. |
---|---|---|---|---|
Development of AMR | Individual based | Bacteria | Not specified | [66] |
Population | Bacteria | Human | [53, 67] | |
In vitro | [19, 58] | |||
Pig | [14, 51] | |||
River | [17] | |||
Not specified | [16, 49, 68, 29, 18] | |||
Human | Not specified | [32] | ||
Other typesa | Bacteria | In vitro | [59] | |
Not specified | [69] | |||
Spread of AMR | Agent based | Bacteria | Not specified | [57] |
Individual based | Dog | Hospital | [13] | |
Population | Bacteria | Slurry | [64] | |
Not specified | [30] | |||
Human | Community | [31, 48] | ||
Hospital | [47] | |||
Pig | Farm | [54] | ||
Development and spread of AMR | Agent based | Bacteria | In vitro | [60] |
Nested | Pig & bacteria | Farm | [27] | |
Population | Bacteria | River | [63] | |
Human | Hospital | [33, 46, 50, 56] | ||
Hospital & community | [20] | |||
Not specified | [15, 34, 55] | |||
Other typesa | Bacteria | In vitro | [61] | |
Cellular automata | [70] |
Analytical solutions were used in eight models, while numeric simulations were used in 16 models. In 14 models, analytical solutions were obtained using numeric simulations. There were 29 models for which the uncertainty was modelled deterministically, a further four were stochastic, and five used both stochastic and deterministic uncertainty display (Table 3).
Table 3.
Simulation or analytic | Uncertainty display | Reference no. |
---|---|---|
Analytic | Deterministic | [18, 29, 30, 34, 48, 49, 59, 61] |
Simulation | Deterministic | [17, 19, 31, 33, 50, 54, 63, 64, 67, 70] |
Stochastic | [13, 51, 60, 66] | |
Deterministic & stochastic | [20, 27] | |
Analytic and simulation | Deterministic | [14–16, 32, 46, 47, 53, 55, 58, 68, 69] |
Deterministic & stochastic | [57, 58] |
It was not relevant to describe the mixing of the population for four of the papers, as they focused on development of AMR without population mixing. The majority of the models used a homogenous mixing of the population (25 papers, 66%). There was no conversion from resistant strain to sensitive or vice versa in seven of the published models (18%), of which five described only a single strain infection and five modelled more than one strain without conversion between resistant and sensitive strains (Table 4).
Table 4.
Mixing of population | Co-existing level | Reference no. |
---|---|---|
Homogeneous | No conversion | [14, 51, 58] |
Single strain | [19, 29, 30] | |
Uni-directional | [15, 31, 33, 46–48, 53, 57, 59, 64] | |
Bi-directional | [18, 34, 50, 54–56, 66, 67] | |
Heterogeneous | No conversion | [16] |
Single strain | [60] | |
Uni-directional | [70] | |
Bi-directional | [13] | |
Homogeneous & heterogeneous | No conversion | [27] |
Uni-directional | [61] | |
Bi-directional | [17, 20, 63] | |
Not relevant | Single strain | [69] |
Uni-directional | [32, 49, 68] |
Phenotypic AMR in single strains was modelled in the majority (11 models, 29%) of the models. Only nine models included the effect of the immune system, and 11 of the models used a constant effect of antimicrobial compound (Table 5).
Table 5.
AMR display | Number of resistant strains | Bacterial species | Modelling of antimicrobial dosing | Antimicrobial compound | Immune system | Reference |
---|---|---|---|---|---|---|
Genotypic | Single | Not specified | Not constant | Single, not specified | Not relevant | [18] |
Phenotypic | Single | Specified | Constant | Single, specified | Not relevant | [16] |
Multiple, specified | Yes | [32, 53] | ||||
Not constant | Single, specified | No | [14, 34] | |||
Not relevant | [19, 58] | |||||
Single, not specified | No | [13] | ||||
Multiple, not specified | Yes | [15] | ||||
No | [48] | |||||
Not relevant | [64] | |||||
Not specified | Constant | Single, specified | Not relevant | [30] | ||
Single, not specified | Yes | [49] | ||||
No | [67] | |||||
Not constant | Single, specified | Not relevant | [63] | |||
Single, not specified | Yes | [46, 70] | ||||
No | [20, 31, 54] | |||||
Not relevant | [57, 69] | |||||
Multiple, specified | Not relevant | [17] | ||||
Multiple, not specified | No | [35] | ||||
Multiple | Specified | Constant | Single, not specified | No | [27] | |
Not constant | Single, specified | No | [51] | |||
Multiple, specified | No | [47] | ||||
Not relevant | [60] | |||||
Not specified | Constant | Single, not specified | Not relevant | [61] | ||
Not constant | Multiple, not specified | Yes | [33, 50, 56] | |||
No | [55] | |||||
Geno- and phenotypic | Multiple | Not specified | Not constant | Single, not specified | Not relevant | [66] |
Other | Single | Specified | Constant | Multiple, specified | Not relevant | [29] |
Not specified | Constant | Single, not specified | Not relevant | [59] | ||
Multiple | Not specified | Constant | Single, not specified | Not relevant | [68] |
AMR antimicrobial resistance
Validation of the models was not reported in 27 of the papers (71%). Three models were validated based on the literature and ten models were validated based on data. Sensitivity analysis was carried out in 27 papers, while 11 papers did not report conducting a sensitivity analysis. Four of the papers reported no validation, sensitivity analysis or bifurcation analysis (Table 6).
Table 6.
Model usefulness and documentation
The papers frequently lacked proper discussion and evaluation of the model assumptions, the usefulness of the data for input parameters and the implications of model conclusions in relation to real-life situations. Only eight papers [13–20] verified the model and conducted sensitivity analysis, thus complying with two of the TRACE criteria [9] (Criteria 6 and 7, Table 6). We identified three papers [14, 17, 18] that satisfied all TRACE criteria except element 5, as none of the studies confirmed the internal validity of the models. Furthermore, these three studies could have provided a better evaluation of the implications of data for input parameters and model assumptions (Table 7).
Table 7.
Study | Problem formulation | Model description | Data evaluation | Conceptual model evaluation | Implementation verification | Model output corroboration |
---|---|---|---|---|---|---|
Suthar et al., 2014 [13] | Yes | Yes | Yes | No | No | Yes |
Nguyen et al., 2014 [14] | Yes | Yes | Yes | Yes | No | Yes |
Ibargüen-Mondragón et al., 2016 [15] | Yes | Yes | No | No | No | No |
Bhagunde, Nikolaou, and Tam, 2015 [16] | Yes | Yes | No | Not completely | No | Not completely |
Hellweger, 2013 [17] | Yes | Yes | Yes | Yes | No | Yes |
zur Wiesch, Engelstädter, and Sebastian Bonhoeffer, 2010 [18] | Yes | Yes | Yes | Yes | No | Yes |
Tam et al., 2007 [19] | Yes | Yes | No | Not completely | No | Not completely |
Kouyos, zur Wiesch, and Bonhoeffer, 2011 [20] | Yes | Not completely | Not completely | Not | No | Yes |
For a complete description of the TRACE elements see Grimm et al. [9]. The two TRACE elements model output verification and model analysis were fulfilled by all eight studies as this was a selection criterion for the comparison with the TRACE elements
Description of comparison papers
A special class of papers relating to quantitative comparisons of mathematical models of AMR was identified. Two papers compared the predictions of individual-based models [21] and stochastic models [22] to deterministic differential equation models. Both papers concluded that the deterministic approximation is valid when the number of simulated individuals is sufficiently large and the research question is not driven by single events (i.e. extinction events).
One paper [23] compared SIR models of four, six, eight and 12 compartments to include dual infection and time lag between treatment and AMR development. The inclusion of dual infections covers situations where patients may recover to a state with a coexistence of strains or strain takeover by the sensitive or resistant strain, depending on parameters. These results were independent of the complexity of the model.
One paper [24] compared six different deterministic differential pharmacodynamic models and the ability of statistical methods to identify data simulated from the six models as belonging to the correct one. They concluded that datasets containing only counts of bacteria did not provide sufficient information to identify the correct model. Additional experiments must be undertaken to determine which class of pharmacodynamic models best describe the data.
Discussion
Recently, Heesterbeek et al. [25] reviewed the importance of mathematical modelling of infectious disease dynamics in terms of improving public health. The authors concluded that, mathematical models can provide inside that can be used in public health policies through the use of new data.
AMR is a major threat to public health, and the fight against it could benefit from the use of mathematical modelling. It could play an important role in providing an insight into the dynamics of AMR, quantifying the effect of factors that influence it and providing tools for its control and prevention. Furthermore, modelling can present an opportunity to elucidate potential gaps in our knowledge.
The reviewed papers varied in their choice of model structure and complexity – from simple deterministic models to advanced mechanistic models (agent-based, individual and nested models). However, they generally provided little justification for the model type and structure that was chosen. In addition, the majority of studies focused on modelling only one unit (Table 2), a single strain of a pathogen (Table 5), assumed homogeneous mixing (Table 4), and ignored uncertainty and stochasticity in the development and/or spread of AMR (Table 3). AMR is a multifactorial problem with several elements – including external factors and interactions within and between populations (microbiota, animal and human populations) – able to affect its development and spread [26]. This creates nonlinearity, heterogeneity, and stochasticity that should be considered when mathematical models of AMR are developed. Opatowski et al. [7] wrote that models should take into account the specific pathogen characteristics such as the resistance mechanism of the pathogen and cooperation among species. They concluded that this would provide major improvements of models.. However, in the 6 years since their review was published, only one paper has described a truly nested model [27] (Table 2), modelling multiple bacterial strains within individuals (pigs) that interact as a population with a heterogeneous structure. Unfortunately, this model was not validated and does not allow conversion of the pathogens. Furthermore, one article [28] published a framework to cope with multiple nested layers from the genetic composition of cells, to the environment of cells, the host of the cells, and the environment of the host. This type of models is clearly something to be striving for in the future as the AMR problem is highly complex, and the interaction on many levels require a deep understanding. It would also be very helpful if the community could commit to using this type of standard models, so that the huge work of parameterise these models could begin. That in the future we could stand on the shoulders of each other instead of trying to building new models for every single problem.
Mechanistic modelling using stochastic processes can describe complex heterogeneous structures and processes, multiple pathogens/genes simultaneously, and model biological interactions that may affect AMR such as the immune system, the dosing effect of antibiotics, the microbiome and variabilities involved in the system. In addition, these models can provide insights into the temporal dynamics of AMR, both in the individual and the population. Arepeva et al. [11] also point to the advantage of this class of models over simpler types of models such as deterministic differential equations. Nine models used analytical solutions to solve the modelled system (Table 2), providing extensive mathematical solutions with a limited interpretation of the applicability of the outcomes to real life. In fact, only two papers [29, 30] attempted to validate the models using data. Analytical solutions can be useful when trying to avoid time-consuming and computer-intensive simulations. Nevertheless, from a practical point of view, the high complexity of AMR and limited translation of analytical solutions to real life can call the usefulness of this approach to solve and/or limit the AMR problem into question.
Ideally, models of AMR should be validated by data. However, many of the published models represent hypothetical situations in hospitals or communities with no supporting data [31–35]. Such models are only useful in the event that a similar hospital or environment can be located. If this is the case, experiments or observational studies can be carried out to validate the models. In addition, there seems to be a lack of knowledge of how to implement different typical parameters and how to relate these to reality. For instance, what is the carrying capacity of a human patient for different types of AMR bacteria or genes, and how do levels of AMR relate to transmission rates under different circumstances in a hospital or community? This highlights the necessity for further fundamental and conceptual research to provide information and data to develop useful simulation models of AMR processes.
Validation is an essential factor when developing a mathematical model. Validation can be both internal (conducted to ensure that the model is doing what it should) and external (conducted to assess whether the model outcomes resemble real life). Models were externally validated in only 13 of the studies; ten studies used data and three were dependent on literature. The absence of validation in many of the published models (Table 5) could be due to a lack of usable data. There is a large gap in our knowledge when it comes to the dynamics of AMR inside a host, especially in terms of genotypic AMR. Interestingly, none of the studies indicated that internal validation had been conducted. Several methods can be used to internally validate the models, such as the rationalism method, tracing method and face validity [36]. Internal validation is important to ensure that the code is free from errors, satisfying the fifth criteria of the TRACE method [9]. It is possible that internal validation has been conducted, even if it is not mentioned in the paper. Nevertheless, we believe that it is important to describe the methods and steps used for internal validation in order to ensure confidence in the predictions. A lack of model validation may increase the risk of erroneous outcomes and conclusions, which in turn may reduce any confidence the scientific community and decision makers have in the predictions. Strict internal validation of the models must therefore be conducted and reported. Furthermore, additional research should be conducted to provide data to externally validate the models, resulting in models that can provide trustworthy recommendations. There exist papers on mathematical models where the TRACE criteria are fulfilled. A good example hereof is written by Foddai et al. [37].
The vast majority of the papers focused on modelling AMR in relation to humans, either directly by modelling human populations (in hospitals or communities) or in bacteria related directly to human health. Only four models relating to animals were conducted (Table 1). Animals might constitute a reservoir of AMR that can be spread to humans through their products (e.g. meat [38–41]), the environment (faeces used as fertilisers [41–43]), or direct contact [41, 44, 45], so more attention should be paid to improving our understanding of AMR dynamics within livestock production systems and the environment.
All studies included in this review report that an increase in antimicrobial use increases AMR in general. Some papers report that certain strategies show relatively smaller increases in AMR, which could be due to reducing contact rates or cycling different kinds of antimicrobial products [13, 15, 20, 27, 31–34, 46–56]. One paper reported a decrease in AMR when using an antimicrobial against which bacteria have no resistance [35]. However, as the authors report, such a property is transient and will diminish in time proportional to the extent to which that drug is used. Some papers construct several pathways to achieving AMR (i.e. hospital- versus community-acquired AMR) and deduce the parameter values at which the R0 (basic reproduction number, denoting how infectious the disease is) is above 1 [20, 31, 48, 52, 55, 35, 57]. However, no papers actually fit epidemiological data to determine parameters or validate their model. There are many studies looking at the epidemiological spread of specific resistant pathogens (e.g. MRSA), but these studies were excluded from this review, as we are interested in the spread of resistance rather than specific pathogens. In stating that there are no data of epidemiological spread, we mean spread of resistance between bacteria in an in vivo situation. There is an abundance of papers describing spread in in vitro experiments [19, 58–61], yet we believe that such parameters can at best be a starting point for estimating parameters in vivo, as the natural environment is much more complex and competitive than a petri dish.
To improve our understanding of AMR, we might need to specifically understand the mechanisms that generate resistance. Some papers in our review modelled specific mechanisms (i.e. efflux pumps, senescence, indoles, or influence of the normal flora) [29, 53, 59, 61]. However, only one of these papers was actually validated by data [29]. Modelling specific mechanisms might be a way to better understand the behaviours and interactions of bacteria using these methods, and it may also give us a better understanding of how AMR interacts when multidrug resistance is considered.
The environmental impact of AMR was modelled in four papers: three of the papers modelled rivers and described the accumulation and survival of AMR [17, 62, 63]. One of the papers also included the effects of metals on the development of AMR [17]. One paper described AMR bacteria growth in slurry [64], showing that AMR bacteria can thrive in this medium. The aggregation and possible growth of AMR bacteria in the environment might be of great concern if bacteria are exposed to a mixture of AM from several sources e.g. in rivers or slurry, they may acquire multiple resistances. If there is a chance that these can then transfer back into the animal or human population, these types of models may be very useful.
The studies originated from 16 different countries and were published in 30 different journals. This indicates that a relatively large number of journals are interested in modelling AMR. Furthermore, it highlights that mathematical modelling is a relevant subject for a broad section of the scientific community. When screening and excluding papers, we might have excluded papers based on a misinterpretation of the title or abstract. However, to minimise such mistakes, we strived to include papers in cases where there was any doubt.
The majority of the studies modelled phenotypic AMR, while few models represented genotypic AMR (Table 5). Modelling genotypic AMR can be more complicated as many genes can be linked to a specific antibiotic, and the relationship between gene abundance and antibiotic use seems to be more complex than first anticipated [65]. Modelling genotypic AMR requires the relevant genes for the modelled AMR to be represented, as well as circumstances allowing for the genetic AMR to be expressed as phenotypic AMR, leading to a spread of the resistant pathogen within the population. Published models of genotypic AMR do not link this AMR type to the development of phenotypic AMR and the subsequent spread of the resistant pathogen between individuals [18]. This is perhaps due to a lack of information on the necessary circumstances for the phenotypic expression of genetic resistance determinants, thus emphasising the need for more research to better understand this process. Understanding the process is essential in the prevention of AMR development and spread.
In our opinion, the following elements should be considered when developing future models of AMR:
Modelling the biological processes mechanistically. This allows heterogeneous processes and structures to be modelled and provides an insight into the ‘how and why’ of AMR occurrence, transfer and persistence.
Incorporating the uncertainty and variability of the system using stochastic modelling.
Extensive sensitivity analysis and model validation (both internal and external) using data that can support model development, parameterisation and validation.
The current study provides a comprehensive review of published models of AMR spread and development since 2006. Although the study focuses on providing insights into the technical elements of and differences between the models, it also provides an insight into the elements that should be included when AMR is modelled.
Conclusions
Many mathematical models of AMR development and spread exist. However, there is still a lack of knowledge regarding the underlying mechanisms at work, thus limiting the true usefulness of the developed models. Furthermore, few models complied with the TRACE criteria. Future AMR models should elucidate the dynamics and variability of AMR occurrence and spread in order to investigate ways of effectively influencing these dynamics to prevent and control AMR. In addition, it is of utmost importance to focus research on providing data to parameterise and validate AMR models in order to extract useful conclusions from them. There is a need for more rigorous model development and testing and more abundant experimental and observational data to support model validation.
Acknowledgments
Funding
This study was funded by the Danish Veterinary and Food administration. The funding party played no role in the design of this study.
Availability of data and materials
This review was based on data extracted from published papers available in the public domain.
Abbreviation
- AMR
Antimicrobial resistance
Authors’ contributions
ACB, KG, and TH completed the review, ACB, KG, TH, NT and AF designed the study and wrote the manuscript. All authors approved the submission of the manuscript.
Ethics approval and consent to participate
The study did not require consent of participants.
Consent for publication
The study did not require consent for publication.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Anna Camilla Birkegård, Email: acbir@dtu.dk.
Tariq Halasa, Email: tahbh@vet.dtu.dk.
Nils Toft, Email: ntoft@vet.dtu.dk.
Anders Folkesson, Email: afol@dtu.dk.
Kaare Græsbøll, Email: kagr@dtu.dk.
References
- 1.Clatworthy AE, Pierson E, Hung DT. Targeting virulence: a new paradigm for antimicrobial therapy. Nat Chem Biol. 2007;3:541–548. doi: 10.1038/nchembio.2007.24. [DOI] [PubMed] [Google Scholar]
- 2.Neu HC. The crisis in antibiotic resistance. Science (80- ) 1992;257:1064–1073. doi: 10.1126/science.257.5073.1064. [DOI] [PubMed] [Google Scholar]
- 3.Gandra S, Barter DM, Laxminarayan R. Economic burden of antibiotic resistance: how much do we really know? Clin Microbiol Infect. 2014;20:973–980. doi: 10.1111/1469-0691.12798. [DOI] [PubMed] [Google Scholar]
- 4.Martinez JL. Environmental pollution by antibiotics and by antibiotic resistance determinants. Environ Pollut. 2009;157:2893–2902. doi: 10.1016/j.envpol.2009.05.051. [DOI] [PubMed] [Google Scholar]
- 5.Zhang T, Zhang X-X, Ye L. Plasmid metagenome reveals high levels of antibiotic resistance genes and Mobile genetic elements in activated sludge. PLoS One. 2011;6:e26041. doi: 10.1371/journal.pone.0026041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Miller JH, Novak JT, Knocke WR, Pruden A. Survival of antibiotic resistant bacteria and horizontal gene transfer control antibiotic resistance gene content in anaerobic digesters. Front Microbiol. 2016;7 MAR:1–11. doi: 10.3389/fmicb.2016.00263. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Opatowski L, Guillemot D, Boëlle P-Y, Temime L. Contribution of mathematical modeling to the fight against bacterial antibiotic resistance. Curr Opin Infect Dis. 2011;24:279–287. doi: 10.1097/QCO.0b013e3283462362. [DOI] [PubMed] [Google Scholar]
- 8.Spicknall IH, Foxman B, Marrs CF, Eisenberg JNS. A modeling framework for the evolution and spread of antibiotic resistance: literature review and model categorization. Am J Epidemiol. 2013;178:508–520. doi: 10.1093/aje/kwt017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Grimm V, Augusiak J, Focks A, Frank BM, Gabsi F, Johnston ASA, et al. Towards better modelling and decision support: documenting model development, testing, and analysis using TRACE. Ecol Model. 2014;280:129–139. doi: 10.1016/j.ecolmodel.2014.01.018. [DOI] [Google Scholar]
- 10.Temime L, Hejblum G, Setbon M, Valleron AJ. The rising impact of mathematical modelling in epidemiology: antibiotic resistance research as a case study. Epidemiol Infect. 2008;136:289–298. doi: 10.1017/S0950268807009442. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Arepeva M, Kolbin A, Kurylev A, Balykina J, Sidorenko S. What should be considered if you decide to build your own mathematical model for predicting the development of bacterial resistance? Recommendations based on a systematic review of the literature. Front Microbiol. 2015;6 APR. [DOI] [PMC free article] [PubMed]
- 12.Moher D, Liberati a, Tetzlaff J, Altman DG, Grp P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement (reprinted from annals of internal medicine) Phys Ther. 2009;89:873–880. [PubMed] [Google Scholar]
- 13.Suthar Neeraj, Roy Sandip, Call Douglas R., Besser Thomas E., Davis Margaret A. An Individual-Based Model of Transmission of Resistant Bacteria in a Veterinary Teaching Hospital. PLoS ONE. 2014;9(6):e98589. doi: 10.1371/journal.pone.0098589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Nguyen TT, Guedj J, Chachaty E, de Gunzburg J, Andremont A, Mentré F. Mathematical modeling of bacterial kinetics to predict the impact of antibiotic colonic exposure and treatment duration on the amount of resistant Enterobacteria excreted. PLoS Comput Biol. 2014;10:1–10. doi: 10.1371/journal.pcbi.1003840. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ibargüen-Mondragón E, Romero-Leiton JP, Esteva L, Burbano-Rosero EM. Mathematical modeling of bacterial resistance to antibiotics by mutations and plasmids. J Biol Syst. 2016;24:129–146. doi: 10.1142/S0218339016500078. [DOI] [Google Scholar]
- 16.Bhagunde PR, Nikolaou M, Tam VH. Modeling heterogeneous bacterial populations exposed to antibiotics: the logistic-dynamics case. AICHE J. 2015;61:2385–2393. doi: 10.1002/aic.14882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Hellweger FL. Simple model of tetracycline antibiotic resistance in aquatic environment: accounting for metal Coselection. J Environ Eng. 2013;139:913–921. doi: 10.1061/(ASCE)EE.1943-7870.0000696. [DOI] [Google Scholar]
- 18.Zur Wiesch PS, Engelstädter J, Bonhoeffer S. Compensation of fitness costs and reversibility of antibiotic resistance mutations. Antimicrob Agents Chemother. 2010;54:2085–2095. doi: 10.1128/AAC.01460-09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Tam VH, Schilling AN, Poole K, Nikolaou M. Mathematical modelling response of Pseudomonas aeruginosa to meropenem. J Antimicrob Chemother. 2007;60:1302–1309. doi: 10.1093/jac/dkm370. [DOI] [PubMed] [Google Scholar]
- 20.Kouyos Roger D., Abel zur Wiesch Pia, Bonhoeffer Sebastian. On Being the Right Size: The Impact of Population Size and Stochastic Effects on the Evolution of Drug Resistance in Hospitals and the Community. PLoS Pathogens. 2011;7(4):e1001334. doi: 10.1371/journal.ppat.1001334. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.D’Agata EMC, Magal P, Olivier D, Ruan S, Webb GF. Modeling antibiotic resistance in hospitals: the impact of minimizing treatment duration. J Theor Biol. 2007;249:487–499. doi: 10.1016/j.jtbi.2007.08.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Boëlle P-Y, Thomas G. Resistance to antibiotics: limit theorems for a stochastic SIS model structured by level of resistance. J Math Biol. 2016;73:1353–1378. doi: 10.1007/s00285-016-0996-2. [DOI] [PubMed] [Google Scholar]
- 23.Beams AB, Toth DJA, Khader K, Adler FR. Harnessing intra-host strain competition to limit antibiotic resistance: mathematical model results. Bull Math Biol. 2016;78:1828–1846. doi: 10.1007/s11538-016-0201-1. [DOI] [PubMed] [Google Scholar]
- 24.Jacobs M, Grégoire N, Couet W, Bulitta JB. Distinguishing antimicrobial models with different resistance mechanisms via population Pharmacodynamic modeling. PLoS Comput Biol. 2016;12:1–19. doi: 10.1371/journal.pcbi.1004782. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Heesterbeek H, Anderson RM, Andreasen V, Bansal S, De Angelis D, Dye C, et al. Modeling infectious disease dynamics in the complex landscape of global health. Science (80- ) 2015;347:aaa4339. doi: 10.1126/science.aaa4339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Zur Wiesch PA, Kouyos R, Engelstädter J, Regoes RR, Bonhoeffer S. Population biological principles of drug-resistance evolution in infectious diseases. Lancet Infect Dis. 2011;11:236–247. doi: 10.1016/S1473-3099(10)70264-4. [DOI] [PubMed] [Google Scholar]
- 27.Græsbøll Kaare, Nielsen Søren Saxmose, Toft Nils, Christiansen Lasse Engbo. How Fitness Reduced, Antimicrobial Resistant Bacteria Survive and Spread: A Multiple Pig - Multiple Bacterial Strain Model. PLoS ONE. 2014;9(7):e100458. doi: 10.1371/journal.pone.0100458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Campos M, Llorens C, Sempere JM, Futami R, Rodriguez I, Carrasco P, et al. A membrane computing simulator of trans-hierarchical antibiotic resistance evolution dynamics in nested ecological compartments (ARES) Biol Direct. 2015;10:1–13. doi: 10.1186/s13062-015-0070-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Bootsma MCJ, van der Horst MA, Guryeva T, ter Kuile BH, Diekmann O. Modeling non-inherited antibiotic resistance. Bull Math Biol. 2012;74:1691–1705. doi: 10.1007/s11538-012-9731-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Nikolaou M, Tam VH. A new modeling approach to the effect of antimicrobial agents on heterogeneous microbial populations. J Math Biol. 2006;52:154–182. doi: 10.1007/s00285-005-0350-6. [DOI] [PubMed] [Google Scholar]
- 31.Levin BR, Baquero F, Johnsen PJ. A model-guided analysis and perspective on the evolution and epidemiology of antibiotic resistance and its future. Curr Opin Microbiol. 2014;19:83–89. doi: 10.1016/j.mib.2014.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Daşbaşı B, Öztürk İ. Mathematical modelling of bacterial resistance to multiple antibiotics and immune system response. Springerplus. 2016;5:408. doi: 10.1186/s40064-016-2017-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Joyner ML. Modeling the differences in the development of a new antibiotic class versus the development of a next generation antibiotic on the total resistance in a hospital setting. J Biol Syst. 2012;20:109–132. doi: 10.1142/S0218339012500039. [DOI] [Google Scholar]
- 34.McBryde ES, McElwain DLS. A mathematical model investigating the impact of an environmental reservoir on the prevalence and control of vancomycin-resistant enterococci. J Infect Dis. 2006;193:1473–1474. doi: 10.1086/503439. [DOI] [PubMed] [Google Scholar]
- 35.Haber M, Levin BR, Kramarz P. Antibiotic control of antibiotic resistance in hospitals: a simulation study. BMC Infect Dis. 2010;10. [DOI] [PMC free article] [PubMed]
- 36.Halasa T, Nielen M, Huirne RBM, Hogeveen H. Stochastic bio-economic model of bovine intramammary infection. Livest Sci. 2009;124:295–305. doi: 10.1016/j.livsci.2009.02.019. [DOI] [Google Scholar]
- 37.Foddai A, Enøe C, Krogh K, Stockmarr A, Halasa T. Stochastic simulation modeling to determine time to detect bovine viral diarrhea antibodies in bulk tank milk. Prev Vet Med. 2014;117:149–159. doi: 10.1016/j.prevetmed.2014.07.007. [DOI] [PubMed] [Google Scholar]
- 38.World Health Organization. Tackling antibiotic resistance from a food safety perspective in Europe. WHO Libr Cat Publ Data. 2011;:1–88. www.euro.who.int/en/publications/abstracts/tackling-antibiotic-resistance-from-a-food-safety-perspective-in-europe.
- 39.Barza M. Potential mechanisms of increased disease in humans from antimicrobial resistance in food animals. Clin Infect Dis. 2002;34(Suppl 3):S123–S125. doi: 10.1086/340249. [DOI] [PubMed] [Google Scholar]
- 40.Hammerum AM, Heuer OE. Human health hazards from antimicrobial resistant Escherichia coli of animal origin. Clin Infect Dis. 2009;48:916–921. doi: 10.1086/597292. [DOI] [PubMed] [Google Scholar]
- 41.Marshall BM, Levy SB. Food animals and antimicrobials: impacts on human health. Clin Microbiol Rev. 2011;24:718–733. doi: 10.1128/CMR.00002-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Sengeløv G, Agersø Y, Halling-Sørensen B, Baloda SB, Andersen JS, Jensen LB. Bacterial antibiotic resistance levels in Danish farmland as a result of treatment with pig manure slurry. Environ Int. 2003;28:587–595. doi: 10.1016/S0160-4120(02)00084-3. [DOI] [PubMed] [Google Scholar]
- 43.Agersø Y, Sengeløv G, Jensen LB. Development of a rapid method for direct detection of tet(M) genes in soil from Danish farmland. Environ Int. 2004;30:117–122. doi: 10.1016/S0160-4120(03)00156-9. [DOI] [PubMed] [Google Scholar]
- 44.Moodley A, Guardabassi L. Transmission of IncN plasmids carrying blaCTX-M-1 between commensal Escherichia coli in pigs and farm workers. Antimicrob Agents Chemother. 2009;53:1709–1711. doi: 10.1128/AAC.01014-08. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Nijsten R, London N, van den Bogaard A, Stobberingh E. Resistance in faecal Escherichia coli isolated from pigfarmers and abattoir workers. Epidemiol Infect. 1994;113:45–52. doi: 10.1017/S0950268800051451. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Friedman A, Ziyadi N, Boushaba K. A model of drug resistance with infection by health care workers. Math Biosci Eng MBE. 2010;7:779–792. doi: 10.3934/mbe.2010.7.779. [DOI] [PubMed] [Google Scholar]
- 47.Wang X, Liu S, Guo H. A nosocomial-pathogens-infections model with impulsive antibiotics treatment on multiple bacteria. Appl Math Comput. 2017;296:64–87. doi: 10.1016/j.amc.2016.10.013. [DOI] [Google Scholar]
- 48.Rodrigues P, Gomes MGM, Rebelo C. Drug resistance in tuberculosis-a reinfection model. Theor Popul Biol. 2007;71:196–212. doi: 10.1016/j.tpb.2006.10.004. [DOI] [PubMed] [Google Scholar]
- 49.Ibargüen-Mondragón E, Mosquera S, Cerón M, Burbano-Rosero EM, Hidalgo-Bonilla SP, Esteva L, et al. Mathematical modeling on bacterial resistance to multiple antibiotics caused by spontaneous mutations. Biosystems. 2014;117:60–67. doi: 10.1016/j.biosystems.2014.01.005. [DOI] [PubMed] [Google Scholar]
- 50.Joyner ML, Manning CC, Canter BN. Modeling the effects of introducing a new antibiotic in a hospital setting: a case study. Math Biosci Eng. 2012;9:601–625. doi: 10.3934/mbe.2012.9.601. [DOI] [PubMed] [Google Scholar]
- 51.Ahmad A, Zachariasen C, Christiansen LE, Græsbøll K, Toft N, Matthews L, et al. Modeling the growth dynamics of multiple Escherichia coli strains in the pig intestine following intramuscular ampicillin treatment. BMC Microbiol. 2016;16:205. doi: 10.1186/s12866-016-0823-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Graef JR, Kong L, Wang M. Stationary solution of a stochastic nosocomial epidemic model in hospital intensive care units. Stoch Anal Appl. 2014;32:840–850. doi: 10.1080/07362994.2014.938861. [DOI] [Google Scholar]
- 53.Alavez-Ramírez J, Castellanos JRA, Esteva L, Flores JA, Fuentes-Allen JL, García-Ramos G, et al. Within-host population dynamics of antibiotic-resistant M. tuberculosis. Math Med Biol. 2007;24:35–56. doi: 10.1093/imammb/dql026. [DOI] [PubMed] [Google Scholar]
- 54.Abatih EN, Alban L, Ersbøll AK, Lo Fo Wong DM. Impact of antimicrobial usage on the transmission dynamics of antimicrobial resistant bacteria among pigs. J Theor Biol. 2009;256:561–573. doi: 10.1016/j.jtbi.2008.10.017. [DOI] [PubMed] [Google Scholar]
- 55.Sun H-R, Lu X, Ruan S. Qualitative analysis of models with different treatment protocols to prevent antibiotic resistance. Math Biosci. 2010;227:56–67. doi: 10.1016/j.mbs.2010.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Obolski U, Hadany L. Implications of stress-induced genetic variation for minimizing multidrug resistance in bacteria. BMC Med. 2012;10. [DOI] [PMC free article] [PubMed]
- 57.Gehring R, Schumm P, Youssef M, Scoglio C. A network-based approach for resistance transmission in bacterial populations. J Theor Biol. 2010;262:97–106. doi: 10.1016/j.jtbi.2009.09.002. [DOI] [PubMed] [Google Scholar]
- 58.Yurtsev EA, Chao HX, Datta MS, Artemova T, Gore J. Bacterial cheating drives the population dynamics of cooperative antibiotic resistance plasmids. Mol Syst Biol. 2013;9:683. doi: 10.1038/msb.2013.39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.de Leenheer P, Dockery J, Gedeon T, Pilyugin SS. Senescence and antibiotic resistance in an age-structured population model. J Math Biol. 2010;61:475–499. doi: 10.1007/s00285-009-0302-7. [DOI] [PubMed] [Google Scholar]
- 60.Murphy JT, Walshe R, Devocelle M. Modeling the population dynamics of antibiotic-resistant bacteria: an agent-based approach. Int J Mod Phys C. 2009;20:435–457. doi: 10.1142/S0129183109013765. [DOI] [Google Scholar]
- 61.Wang W, Zou X. Modeling the role of altruism of antibiotic-resistant bacteria. J Math Biol. 2014;68:1317–1339. doi: 10.1007/s00285-013-0668-4. [DOI] [PubMed] [Google Scholar]
- 62.Mostefaoui IM. Mathematical analysis of a model describing the number of antibiotic resistant bacteria in a polluted river. Math Methods Appl Sci. 2014;37:1956–1973. doi: 10.1002/mma.2949. [DOI] [Google Scholar]
- 63.Hellweger FL, Ruan X, Sanchez S. A simple model of tetracycline antibiotic resistance in the aquatic environment (with application to the Poudre River) Int J Environ Res Public Health. 2011;8:480–497. doi: 10.3390/ijerph8020480. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Baker M, Hobman JL, Dodd CER, Ramsden SJ, Stekel DJ. Mathematical modelling of antimicrobial resistance in agricultural waste highlights importance of gene transfer rate. FEMS Microbiol Ecol. 2016;92:1–10. doi: 10.1093/femsec/fiw040. [DOI] [PubMed] [Google Scholar]
- 65.Birkegård AC, Halasa T, Græsbøll K, Clasen J, Folkesson A, Toft N. Association between selected antimicrobial resistance genes and antimicrobial exposure in Danish pig farms. Sci Rep. 2017;7:9683. doi: 10.1038/s41598-017-10092-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Schulman LS. Bacterial resistance to antibodies: a model evolutionary study. J Theor Biol. 2017;417:61–67. doi: 10.1016/j.jtbi.2017.01.022. [DOI] [PubMed] [Google Scholar]
- 67.Kim J, Lee DH, Song YS, Kang SW, Kim SW. The within-host population dynamics of normal flora in the presence of an invading pathogen and antibiotic treatments. J Microbiol Biotechnol. 2007;17:146–153. [PubMed] [Google Scholar]
- 68.Song HX, Peng YY, Zhu ZF. Competition between plasmid-bearing and plasmid-free organisms in the host: population dynamics and antibiotic resistance. Med Princ Pract. 2006;15:436–442. doi: 10.1159/000095490. [DOI] [PubMed] [Google Scholar]
- 69.Nemzer LR. A model of band-pass phenotypic resistance in a modified Beverton-Holt framework. Math Biosci. 2014;252:7–13. doi: 10.1016/j.mbs.2014.03.003. [DOI] [PubMed] [Google Scholar]
- 70.Kier LB. Modeling bacterial infection phenomena. Curr Comput Aided Drug Des. 2015;11:321–324. doi: 10.2174/1573409912666151218155921. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
This review was based on data extracted from published papers available in the public domain.