Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2013 Jan 28;8(1):e55017. doi: 10.1371/journal.pone.0055017

Application of a Stochastic Modeling to Assess the Evolution of Tuberculous and Non-Tuberculous Mycobacterial Infection in Patients Treated with Tumor Necrosis Factor Inhibitors

Elena Agliari 1,2,*, Lorenzo Asti 3, Adriano Barra 4, Rossana Scrivo 5, Guido Valesini 5, Robert S Wallis 6
Editor: Pere-Joan Cardona7
PMCID: PMC3557254  PMID: 23383039

Abstract

In this manuscript we apply stochastic modeling to investigate the risk of reactivation of latent mycobacterial infections in patients undergoing treatment with tumor necrosis factor inhibitors. First, we review the perspective proposed by one of the authors in a previous work and which consists in predicting the occurrence of reactivation of latent tuberculosis infection or newly acquired tuberculosis during treatment; this is based on variational procedures on a simple set of parameters (e.g. rate of reactivation of a latent infection). Then, we develop a full analytical study of this approach through a Markov chain analysis and we find an exact solution for the temporal evolution of the number of cases of tuberculosis infection (re)activation. The analytical solution is compared with Monte Carlo simulations and with experimental data, showing overall excellent agreement. The generality of this theoretical framework allows to investigate also the case of non-tuberculous mycobacteria infections; in particular, we show that reactivation in that context plays a minor role. This may suggest that, while the screening for tuberculous is necessary prior to initiating biologics, when considering non-tuberculous mycobacteria only a watchful monitoring during the treatment is recommended. The framework outlined in this paper is quite general and could be extremely promising in further researches on drug-related adverse events.

Introduction

Over the last decades the improved understanding of the pathogenesis of chronic inflammatory diseases, together with a major advance in biotechnology, have accelerated the development of biological therapies, designed to neutralize specific targets that mediate and sustain the clinical manifestations of diseases. These compounds, mainly monoclonal antibodies (mAb) and fusion proteins, introduced a breakthrough in the management of different conditions including inflammatory rheumatologic disorders [1]. In this context, the first setting of application of the biological agents was rheumatoid arthritis (RA), a chronic autoimmune disease affecting approximately Inline graphic of the adult population [2]. If the disease is not treated adequately, progressive deformity can lead to loss of quality of life and reduce average life expectancy by about a decade [2]. Studies on the pathogenic mechanisms of RA have revealed that tumor necrosis factor (TNF) is a cytokine playing a critical role in the inflammatory cascade that results in the irreversible joint damage typical of the disease [3]. Following these discoveries, a series of clinical trials in patients with RA showed the therapeutic benefit of TNF blockade [4]. As a consequence, five biological agents engineered to block TNF actions are currently available: infliximab, adalimumab, golimumab, certolizumab pegol (all of them mAb), and etanercept (a receptor fusion protein) [5]. While being highly effective, TNF blockers have raised concerns about the potential for an increased susceptibility to infections, in particular the reactivation of latent tuberculosis (TB) infection [6][10]. Mycobacterium tuberculosis, the cause of human TB, can result in a metastable clinical latency lasting for decades. Much has been speculated about the structure of granuloma which should contain Mycobacteria, since murine models indicated that TNF was necessary for both formation and maintenance of granulomas [11]. However, subsequent studies on zebrafish model [12], monkeys [13], and humans [14][17] challenged these data, demonstrating that the crucial role of TNF in the granuloma was indeed macrophage activation and stimulation of chemokine production. The reactivation of latent TB infection has been associated with all TNF inhibitors, hence pre-initiation screening procedures have been recommended, which have successfully reduced the number of reported cases [18], although current screening tools lack sensitivity and specificity [19], [20].

TNF blockers seem to increase also the risk of other granulomatous diseases, but little is known about the emergence of illness due to non-tuberculous Mycobacteria (NTM). These are a huge ensemble of pathogens (e.g. M. avium, M. abscessus, and so on [21]) and up to date, approximately Inline graphic different mycobacterial species are considered to be etiological agents of human diseases and this number seems still growing [21]. Most cases these days occur in hosts with relatively intact immune responses. However, RA and other chronic diseases with pulmonary manifestations can predispose a person to NTM pulmonary disease [22] expressing as a possible serious complication, especially in immunosuppressed subjects. Thus, it is of utmost importance to study also the risk related to NTM, in the perspective to understand if a proper screening may be helpful in conferring a wider protection to the patients. This is particularly true, in that the TNF blockers appear to predispose both to disseminated and localized disease [21], [23], but also because these infections are increasing in prevalence, especially among women, which are more frequently affected by RA than men. In the present state of the art, the scenario for NTM diseases, with respect to TNF-blocking drugs, seems different from the TB counterpart: in particular, through extensive experimental screening, both Wallis and coworkers [10], and Winthrop and coworkers [23], [24] evidenced that latency and reactivation do not seem to play a crucial role in this context, yet a clear-cut picture is still missing.

Now, as far as TB is concerned, data collected through the Adverse Event Reporting System of the US Food and Drug Administration (FDA) in the time-window Inline graphic, related to the two test-case drugs with a different mechanism of action, i.e. infliximab and etanercept, highlight that TB infections involve Inline graphic over Inline graphic patients treated with infliximab and Inline graphic over Inline graphic patients receiving etanercept [10]. Therefore, the question is: As the latency in TB can last decades, are these infections (in patients under therapy) new ones or are they reactivation of previously encountered pathogens due to a suppressed immune system? This kind of question underlies the awareness of a real need and disposal for extensive pre-screening procedures. Unfortunately, the answer is by far not trivial as, for TB, there are no secure pathways to discriminate between a new infection or the raise of a previous one. Moreover, a clear methodology for finding latencies is still lacking. Furthermore, the rarity and different sizes of this infection in different countries (ranging from Inline graphic over Inline graphic in Sweden up to Inline graphic over Inline graphic in Romania [8]) implies that data analysis and its subsequent interpretation must be carefully performed.

As for NTM, still from FDA, through the post-marketing surveillance system (MedWatch) and through a further survey within the Emerging Infections Network of the Infectious Diseases Society of America (IDSA), Winthrop and coworkers reported a detailed study of possible correlations between the usage of TNF blockers and the emergence of NTM diseases: over a time-window of Inline graphic years, they highlighted a higher prevalence of NTM diseases in patients treated with infliximab rather than etanercept [24].

In order to investigate possible correlations between the incidence of infections by such Mycobacteria and biological therapy, one could rely directly on the molecular details of TNF processing signal (which has been, at least partially, elucidated, see e.g. [25]), coupled to the underlying infliximab and etanercept mechanism of action, which could be achievable directly through molecular immunology approach. Beyond these “standard” strands, a completely different route can also be performed: Given the relative large amount of collected data, the problem can be considered from a purely inferential viewpoint, by-passing the underlying molecular immunology know-how (see also [26], [27]). According to this perspective, in Ref. [9], [10], an abstract (logical) environment for TB case has been defined, where patients can occupy one of the (following) five different states: Inline graphic No infection, Inline graphic New infection, Inline graphic Latency, Inline graphic Reactivation of a previous TB infection, Inline graphic Post first TB encounter. Clearly, the patients starting the therapy (and hence belonging to the survey) can correspond to either state Inline graphic or Inline graphic, because all the other states imply quantifiable sickness and the patient would then be treated for TB rather than RA. Then, at the end of the survey, a fraction of these patients will be in an illness state, i.e. either state Inline graphic or Inline graphic. The transition rates between different states are assumed as free-parameters, whose values are estimated through numerical simulations: the best estimate is the one able to reproduce, with the smallest error, the experimental data. Remarkably, the probability of latent TB reactivation in patients treated with infliximab turned out to be an order of magnitude per unit of time higher than the same probability for patients trated with etanercept [9].

Here, we first formalize this approach in terms of Markov chains and we write the related Master equation in continuous-time limit, then we solve the model analytically and study its properties in full details. In this way we get the explicit expression for the number of patients Inline graphic exhibiting a TB (re)activation, as a function of time Inline graphic. One step forward, we check the robustness of our results through extensive Monte Carlo simulations and over the clinical data of the TB scenario, finding overall excellent agreement among all our results (and previous literature). Moreover, we find that different magnitudes for the probability of reactivation correspond to qualitative different behaviors for Inline graphic (on the proper timescale), that is, the number of patients displaying active infection increases exponentially in time when using infliximab and linearly in time when using etanercept.

The analytical expression for the whole evolution of the system implies a great feasibility of the technique itself (e.g. we have the whole set of first integrals and a clear picture of all the hidden symmetries) and also allows to address, in complete generality, several instances. In particular, we can finally consider generic NTM infections, where, interestingly, the scenario appears quite different from the TB counterpart: clinical data suggest that Inline graphic (on the proper timescale) grows quadratically with time and this is recovered by our analytical picture only under the assumption of a negligible role played by latency reactivation. We check these findings also through extensive Monte Carlo runs, which are in full agreement too. Remarkably, this is very consistent with the present state of the art in the medical literature dealing with NTM.

As a final result, there are two types of conclusions which stem from our work: The former belongs to the world of modelers, while the latter to the world of clinicians.

From a mathematical perspective, the encouraging results of this approach may pave the way for the development of handily and fruitful instruments for physicians.

Much more carefully, in the clinician’s counterpart, as this approach bypasses the whole underlying biological complexity, it may contribute to confirm, from a theoretical perspective, the current understanding of adverse events coupled to TNF-inhibitors and the consequent real need for screening procedures before undergoing biological therapies.

Materials and Methods

In this section we formalize the scheme introduced in [9] and aimed to reproduce data of TB onset in patients treated with TNF inhibitors, with particular attention on infliximab (an anti-TNF mAb) and etanercept (a soluble TNF receptor). Seeking for clarity, in this section we mention only applications to the TB case, although, as we will see in the second part of the paper, the approach is rather robust and can be successfully applied to the NTM case, too.

The model, whose structure is depicted in Figure 1, consists in identifying a set of possible states for the patient subjected to biological treatments, and in fixing the likelihood for the patient to change his/her state within a proper unit time. Of course, on large samples, some patients may experience sudden incidents (e.g. death for other causes) or some others may assume both the drugs: the analysis has been previously purified from these cases [9], [10].

Figure 1. Symbolic representation of the Markov chain under investigation.

Figure 1

States are represented as circles and numbered from Inline graphic to Inline graphic according to the scheme outlined in the Materials and Methods section. The arrows Inline graphic represent the transition probabilities connecting two different states, while Inline graphic and Inline graphic represent the initial conditions on the states Inline graphic.

The clinical states available to a test-patient are taken as follows (see Figure Inline graphic):

0 : Absence of infection;

1 : New infection (that after a time Inline graphic can give rise either to active TB or latent infection);

2 : Latent infection;

3 : Reactivated TB after latency;

4 : Active TB (that progresses from new infection within a time Inline graphic, without an intervening period of latency).

Moreover, each patient is assumed to change his/her state, following the corresponding transition probabilities, which constitute the model parameter set, and are meant over a proper unit time Inline graphic. Using Inline graphic to label the time, these probabilities are:

L : Probability of having a latent infection at the beginning of the observation (Inline graphic), while, obviously, Inline graphic is the probability of not having any infection at that moment;

N : Probability of TB infection during the observational time;

P : Probability of a new TB infection to become active TB after a time Inline graphic; as a consequence, Inline graphic is the probability of this new infection to give rise to a latent infection;

R : Probability of reactivation of a latent TB infection.

We stress that such probabilistic framework is based on purely clinical variables.

On the experimental side, the available data consist in a collection of times (one for each patient) corresponding to the onset of TB (in its active phase, namely a detectable scenario), after the beginning of the treatment with TNF blockers. As a consequence, the only states which are possible to observe are the states Inline graphic and Inline graphic. Unfortunately, as discussed in the introduction, these states (that account for ill patients) are not distinguishable one respect to the other by simply looking at the data (hence motivating both earlier studies [9], [10] and our machinery), however, some progress can be made using stochastic extremization. The idea resembles the standard maximum likelihood and consists in finding the best values for free parameters such that the theoretical curves collapse over the experimental data [28].

As already outlined, following this procedure, the main result in [9] is that the principal difference between infliximab and etanercept treatments resides in different management of latent TB, i.e. on Inline graphic. The former seems to enhance reactivation one order of magnitude more than the latter.

Markov Chains and Master Equations

The model described in the previous section can be translated into a set of differential equations coding for the temporal evolution of the probability of patient’s states (which can be compared to the corresponding fractions over a sample of patients given the large collection of data).

Being the states discrete, this can be accomplished in complete generality using Markov chains, namely a (discrete-time) probabilistic framework where the probability of being in a given state at a given time Inline graphic depends only on the probability distribution over all the states at the previous time step Inline graphic, and on the transition rates linking these states.

It is instructive to consider the illustrative Markov chain with only three states (Inline graphic, Inline graphic and Inline graphic), non-null transition rates Inline graphic and Inline graphic and time step Inline graphic, shown in Figure 2.

Figure 2. Toy Markov chain.

Figure 2

From the state Inline graphic there is a potential flux of probability at rate Inline graphic toward the state Inline graphic, hence we expect that, after a proper amount of time, a fraction of the probability Inline graphic will be drained from Inline graphic to Inline graphic. The same holds for the situation linking Inline graphic to Inline graphic. After an infinite time the probability of having the patient in the state Inline graphic is one, while it is zero for the states Inline graphic.

Note that, in the model, the probabilities of going from Inline graphic to Inline graphic and from Inline graphic to Inline graphic exist but not the opposite (Inline graphic) hence, if the initial state is all concentrated in Inline graphic, there will be no evolution, while if the starting point is spread among Inline graphic and Inline graphic, after enough time, the probability distribution will be peaked on Inline graphic only (but in its finite temporal evolution resides our interest).

Now, the probability of remaining-at/moving-into the state Inline graphic in the time interval Inline graphic is given by the probability of already being in Inline graphic (hence Inline graphic) plus the probability of arriving in Inline graphic from Inline graphic times the probability of being in Inline graphic at the previous step (hence Inline graphic) minus the probability of leaving Inline graphic to Inline graphic times the probability of being in Inline graphic at the previous step (hence Inline graphic); this concept can be written as follows:

graphic file with name pone.0055017.e083.jpg (1)

Now, the mathematics for continuous variable differential equations is much more handily and does not change significantly the perspective if the time step is small with respect to the global time window; indeed, both experimental data sets considered here (for TB cases [10] and for NTM cases [23]) fulfill this requirement and thus we are allowed to consider the time as a continuous variable. This can be achieved straightforwardly starting from the previous equation using a limit procedure:

graphic file with name pone.0055017.e084.jpg

The evolution for the probability Inline graphic is then ruled by the following differential equation, namely a “Master equation”, which acts as a continuous counterpart of the Markov chain in the discrete-time case:

graphic file with name pone.0055017.e086.jpg (2)

In general, for a system which can be in one of Inline graphic arbitrary states, we need a Inline graphic transition-rate matrix Inline graphic (where Inline graphic is the rate for the transition from state Inline graphic to state Inline graphic) and the Master equation takes the form

graphic file with name pone.0055017.e093.jpg (3)

Note that we use the symbol Inline graphic above the functions meaning their temporal derivative. Finally, we switch to a form where the explicit timescale Inline graphic of the process appears directly in the equation, that is

graphic file with name pone.0055017.e096.jpg (4)

where Inline graphic stands for the probability of transition from state Inline graphic to Inline graphic along the time interval Inline graphic.

Master Equations for the Model

Keeping in mind Figure 1, we can write down the system of differential equations describing the evolution of the five states earlier introduced as follows:

graphic file with name pone.0055017.e101.jpg (5)

with initial conditions

graphic file with name pone.0055017.e102.jpg (6)

The numbers indexing the probabilities mirror the enumeration of the previous section, that is, Inline graphic stands for the probability that a patient has never been affected by the infection, and so on. The parameter Inline graphic represents the typical time for a patient experiencing a new infection to either develop the disease or to fall into a latent state and it should be chosen according to the natural time-scale of the process described. For instance, for the TB case, the data collected suggest that Inline graphic is order of a few months [10], [29], and we set Inline graphic for the sake of simplicity and in agreement with previous works [9], [10].

Note that, as patients affected by active TB do not start RA therapy, we set Inline graphic. Furthermore, the parameter Inline graphic tunes the initial amount of latent-TB patients with respect to free-TB patients, such that for Inline graphic all patients are healthy, while for Inline graphic all patients display a latent TB infection; as we have no ways to discriminate between healthy and latent-infected patients, Inline graphic is taken as a free parameter which can be estimated a posteriori comparing the solution of (5) with available data.

The solution of the system (5) can be easily obtained using first order ordinary differential equations theory and reads off as

graphic file with name pone.0055017.e112.jpg (7)

Of course, since the total amount of patients is conserved, Inline graphic is an integral of motion, that is

graphic file with name pone.0055017.e114.jpg (8)

Beyond Inline graphic, the system ( ) admits another integral of motion Inline graphic, namely

graphic file with name pone.0055017.e117.jpg (9)

This means that the rate of growth for patients in the latency branch (i.e. in states Inline graphic) equals the rate of growth for the rest of infected patients (i.e. in state Inline graphic) weighted by a factor Inline graphic, so that the smaller Inline graphic and the larger the difference between the related rates. The knowledge of integrals of motion can be very useful as they allow to obtain information in a very simple way; for instance, should Inline graphic drop, then Inline graphic would also decrease (or, analogously, Inline graphic would increase) in order to maintain Inline graphic constant. Given Inline graphic and Inline graphic, other integrals of motion, which are combination of Inline graphic and Inline graphic, can be trivially built. For example, Inline graphic fulfills.

graphic file with name pone.0055017.e131.jpg (10)

We underline that this kind of investigation can be accomplished only through an analytical study of the system.

As discussed above, the fraction of active TB cases is given by the sum of the fraction of cases of direct TB after infection and of the fraction of cases with reactivated TB; namely, calling Inline graphic the total fraction of cases, we have:

graphic file with name pone.0055017.e133.jpg (11)

In the above quantity, the time dependence appears only through three different exponential decay terms Inline graphic, which vanish at infinite time, so that the solution becomes a constant term equal to 1, meaning that, if we wait for a sufficient long (possibly infinite) time, all patients become sick (although, obviously, they can possibly die earlier due to reasons not related to RA/TB). In order to deepen the temporal evolution of these probabilities at relatively short times, it is useful to use a little bit of algebraic manipulation to distinguish constant terms from decaying terms, in such a way that we get

graphic file with name pone.0055017.e135.jpg (12)

where the three constants Inline graphic, Inline graphic and Inline graphic are related to the physiological parameters by

graphic file with name pone.0055017.e139.jpg (13)

Of course, from Inline graphic one can derive the effective number of cases multiplying Inline graphic by the overall number of treated patients.

Before turning attention to the fitting procedure, we stress that the analytical solution in Eq. (7) was successfully checked through numerical methods, i.e. fourth-order Runge-Kutta algorithm and Monte Carlo simulations (notice that here, with Monte Carlo simulation we mean a simulation in which a set of virtual patients evolves in time following the Markov chain of Figure 1, giving a sample of the evolution of the fraction of cases during time. In our simulations we set Inline graphic virtual patients).

Results

The TB-infection Case

Having obtained the complete solution of the model and exploiting the available information on parameters, we now look for proper approximations able to highlight the effective behavior of Inline graphic in cases of practical interest, starting with the TB scenario.

In particular, Eq. (12) can be reduced to a simpler form if we note that the probability Inline graphic of TB infection is much smaller than all the other parameters, in agreement with studies on TB and with results found in [9] and, a posteriori, in the current paper (see Table 1).

Table 1. TB-infection case: Best-fit coefficients.

TB-infection case: Best-fit coefficients.
L (4.52±0.65) 10−4
N (2.88±0.23) 10−6
R INF (2.12±0.19) 10−1
P INF (9.76±0.82) 10−1
R ETA (2.24±0.15) 10−2
P ETA (8.03±0.71) 10−1

Best fit parameters obtained through the maximum likelihood method (see Eqs. 15, 16, respectively). Here we used Inline graphic, consistently with clinical data. The fit was accomplished with the constraint that the parameters Inline graphic and Inline graphic are the same for both therapies, as they are drug-independent. The average relative error on these parameters is Inline graphic.

Hence, as a first approximation step, we assume Inline graphic and Inline graphic such that we can expand the solution, at the first order in Inline graphic and Inline graphic, as follows:

graphic file with name pone.0055017.e153.jpg
graphic file with name pone.0055017.e154.jpg
graphic file with name pone.0055017.e155.jpg

notice that here and in the following we use the “big-O” Landau notation to characterize the growth rate of functions; more precisely, being Inline graphic and Inline graphic two arbitrary functions, we say Inline graphic as Inline graphic if there exists a positive real number Inline graphic such that Inline graphic.

By plugging the previous expressions into Eq. 12, with some algebra and retaining only up-to-linear terms in Inline graphic or Inline graphic, we get

graphic file with name pone.0055017.e164.jpg
graphic file with name pone.0055017.e165.jpg (14)

Let us now move further and focus on the exponential terms. First, we notice that Inline graphic and, consequently, we can neglect the term Inline graphic, as it decays much faster that both Inline graphic and Inline graphic. Moreover, since the time range considered is Inline graphic months and Inline graphic is expected to be Inline graphic, we can expand Inline graphic as Inline graphic, and considering only the leading dependence on Inline graphic, we get

graphic file with name pone.0055017.e176.jpg (15)

As for Inline graphic, a similar approximation (Inline graphic) can be adopted as long as Inline graphic so to obtain the following linear approximation.

graphic file with name pone.0055017.e180.jpg (16)

Notice that a smaller (larger) estimate for Inline graphic would simply require a stricter (softer) condition on Inline graphic and on Inline graphic for the related linear expansions to hold (on the same time range); the model would not be affected and the parameters coupled with time, i.e. Inline graphic, would be accordingly rescaled. As shown in Figure 3, the approximation (16) is rather good only for etanercept-treated patients, for which the best fit yields Inline graphic. On the other hand, if we consider infliximab-treated patients, the approximation (16) does not fit data, while using (15) we get a good overlap with data and the best fit yields Inline graphic, confirming that now Inline graphic is no longer small over the time window. All best-fit coefficients are reported in Table Inline graphic, and the related errors are shown in Figure 4.

Figure 3. Comparison between experimental, analytical and numerical results for the TB-infection case.

Figure 3

Cumulative number of patients undergoing active TB-infection. Experimental data from [9] (Inline graphic for infliximab-treated patients and Inline graphic for etanercept-treated patients) are compared with the approximated analytical solution (see Eq. 15 and Eq. 16, respectively, solid curves) and with data from numerical simulation (dashed curves). The parameters used to draw the analytical curves correspond to the best-fit coefficients and are reported in Table 1. Notice that here we consider the extensive number of patients affected by TB over a population of Inline graphic treated patients, according to experimental results.

Figure 4. Deviations between experimental, analytical and numerical results for the TB-infection case.

Figure 4

Absolute difference between experimental data and theoretical data reported in Fig. 3; the same legend holds.

We can estimate how sensitive Inline graphic is with respect to the system parameters by deriving its analytic expression (see Eq. 12) with respect to Inline graphic, respectively; in this way we get that, in the regime Inline graphic, the most relevant parameter affecting the behavior of Inline graphic is Inline graphic. Another argument in favor of this claim is that, in the zero approximation of the solution (i.e. neglecting even terms Inline graphic), Inline graphic does not appear at all.

In order to get further insight on the effect of infliximab and of etanercept on TB incidence, in Fig. 5 we plotted the model predictions for the percentage of patients having TB because of new infections (Inline graphic) or reactivations (Inline graphic).

Figure 5. Probabilities Inline graphic and Inline graphic versus time for the TB-infection case.

Figure 5

The probability Inline graphic of being in state Inline graphic (TB reactivation) and Inline graphic of being in state Inline graphic (Post Inline graphic TB) are calculated from Eq. 7, using the parameters of Table Inline graphic. In the main plot we compare the ratio Inline graphic obtained from infliximab (Inline graphic) and etanercept (Inline graphic) parameters. In the inset, we depict each single probability, namely Inline graphic for infliximab (dark Inline graphic) and for etanercept (dark Inline graphic), Inline graphic for infliximab (bright Inline graphic) and for etanercept (bright Inline graphic); notice that the two sets of data for Inline graphic are partially overlapped. Lines are guide for the eye.

To summarize, our results confirm that, in the present context, the most important difference between therapies based on infliximab or etanercept is that the former enhances TB reactivation more than the latter, in fact, we found Inline graphic, in agreement with [9]. Such a discrepancy implies even a qualitatively different behavior of Inline graphic over the time-window considered: the number of infliximab-treated patients experiencing a TB infections grows exponentially in time, while for etanercept-treated patient the growth is linear.

The NTM-infection Case

The analytical expression for Inline graphic, (see Eqs. 7 and 11) holds for a general environment schematizable as in Fig. 1; in the last paragraph we used the details of TB infections to implement convenient approximations. We now turn to NTM-infections in patients treated with infliximab and etanercept and look for proper approximations able to highlight the characteristic features of such case. The experimental data we refer to are those reported in [23] and collected over the period Inline graphic. Overall, there were Inline graphic reports of NTM infections in patients who were receiving anti-TNF therapy. Most reports were for patients receiving infliximab (Inline graphic) or etanercept (Inline graphic) and here we shall focus just on these drugs.

Some remarks are in order here to merge mathematically the TB and NTM scenarios.

First, it is important to notice that patients affected by NTM lung infections typically suffer through long periods of illness before a clinical diagnosis is made. To comply with the actual state of the art on the involved time-scales we follow M. Iseman and T. Marras [29] that we quote: “Preliminary prevalence estimates have been made, assuming that the disease duration for TB is Inline graphic months and for pulmonary NTM is within the range of Inline graphic to Inline graphic years” (Inline graphic to Inline graphic months), hence for NTM the timescale is at least one order of magnitude larger than in the TB counterpart.

Another important point is that available data on NTM-diseases related to drug therapies lack the size of the survey, namely the number of patients participating to the screening, consequently, we can quantify the (cumulative) amount of sick patients, but we do not know their percentage. This is not a serious deficiency since, while we do not have access to the very reactivation probabilities Inline graphic or Inline graphic, their ratio (which cancels out both time-scales and survey-size) still retains a quantitative information content.

As a result of the first remark, the (average) exit time from state Inline graphic, i.e. Inline graphic, is comparable to the experimental time window, and one can expand the solution reported Eq. 7 at second order in Inline graphic as

graphic file with name pone.0055017.e236.jpg (17)
graphic file with name pone.0055017.e237.jpg (18)

We notice that, at this stage of expansion, Inline graphic grows quadratically with time, while Inline graphic presents two contributes growing, respectively, linearly and quadratically with time, the former being the leading one.

Such expressions must now be compared with experimental data, which display a purely quadratic growth in time, i.e. compatible with Inline graphic (see Fig. 6). In order for the comparison to hold, one must therefore drop the linear coefficient, and this implies Inline graphic (or Inline graphic which is conceptually pretty similar). With this choice of parameters we get.

graphic file with name pone.0055017.e243.jpg (19)

and this form successfully fits experimental data, as shown in Figure 6; the best-fit coefficients are reported in Table 2, and the related errors are shown in Figure 7.

Figure 6. Comparison between experimental, analytical and numerical results for the NTM-infection case.

Figure 6

Cumulative number of patients undergoing active NTM-infection. Experimental data from [23] (Inline graphic for infliximab-treated patients and Inline graphic for etanercept-treated patients) are compared with the approximated analytical solution (see Eq. Inline graphic, solid curves) and with data from numerical simulation (dashed curves). The parameters used to draw the analytical curves correspond to the best-fit coefficient and are reported in Table Inline graphic. Notice that here we consider the extensive number of patients affected by NTM over the whole population of treated patients, according to experimental results.

Table 2. NTM-infection case: Best-fit coefficients.

NTM-infection case: Best-fit coefficients.
NP INF Inline graphic
NP ETA Inline graphic

Best fit parameters obtained through the maximum likelihood method (see Eq. 19). Here we used Inline graphic, consistently with clinical data. Notice that here parameters only count through the combination Inline graphic, and, again, Inline graphic was thought as drug-independent. Moreover, in this case available data are extensive, so that the explicit number of overall treated patients Inline graphic has been introduced. The average relative error on these parameters is Inline graphic.

Figure 7. Deviations between experimental, analytical and numerical results for the NTM-infection case.

Figure 7

Absolute difference between experimental data and theoretical data reported in Fig. 5; the same legend holds.

The functional form of Inline graphic highlights why finding an estimate of the parameters is extremely difficult through blind numerical extremization, without any explicit analytical hint: The latency-branch turns out to be negligible in NTM-context and this results in a coupling of the parameters Inline graphic and Inline graphic as only a single probability streaming toward Inline graphic survives. Therefore the two parameters alone are undetectable.

Using the coefficients of Table 2 in numerical simulations we obtain results in excellent agreement with real data and analytical ones. Notice that, impressively, the fit is very good although here the optimization relies only on one parameter.

We stress that the qualitative difference between the behaviors of Inline graphic in the case of TB and NTM infection (see Eqs. 15 and 19) mainly stems from a significant gap in the related disease duration (few months versus several years). In the latter case Inline graphic is relatively large to allow the expansion of the exponential functions into a polynomial form, while for TB this can be accomplished only under the condition of small enough R. Such expansions do not significantly alter the predicted values of the fit parameters, as long as the underlying assumptions are consistent with facts.

To summarize, the theoretical framework developed evidences that the rate of reactivation Inline graphic is vanishing: This issue makes the fraction Inline graphic of reactivation cases negligible, while the number of activation cases grows quadratically with time through the contribution of only Inline graphic, consistently with the actual understanding of NTM-pathology achieved through standard pathways. Moreover, differently from the TB case, in the NTM scenario no qualitative difference can be detected between infliximab and etanercept: The parabolic behavior for Inline graphic seems robust.

Discussion

In the last decades, several tools and concepts stemmed from the fields of stochastic mathematics and theoretical physics have been proposed to help the investigation of the immunological world, ranging from kinetic theories [30], to associative neural networks [31], [32], to cellular automata and more [33], [34].

Along the same line, in these notes we formalized and extended a stochastic approach to data analysis (originally introduced in [7][10]) for evidencing underlying correlations between adverse events and therapies based on immunosuppressants. In particular, the focus of our investigation concerns the risk of reactivation of latent mycobacterial infection in patients undergoing treatment with TNF-inhibitors.

We gave a clear and complete mathematical backbone to this approach, building it on explicit Markov processes, whose continuous-time limit yields the Master equation governing the evolution of the expected fraction of patients Inline graphic exhibiting an active infection. We also solved the Master equation in all details finding an analytical expression for Inline graphic Such mathematical developments make the original approach much more versatile and general: For instance, handling the complete (mathematical) solution allows to better account for reasonable approximations, tackling their control quantitatively (e.g. finding the proper timescales involved in the process or the integrals of motion constraining the evolution of the system). Furthermore, we can finally consider, within the same framework, different problems. In particular, we focused on TB and NTM infections emerging during anti-TNF therapies (infliximab and etanercept) according to data reported in [9], [23].

In the former case, we recovered previous findings showing that the rate of reactivation Inline graphic of TB from a latent state to an active state plays a crucial role: being Inline graphic we get qualitatively different behaviors for Inline graphic. More precisely, once fixed the observational time-window, for infliximab Inline graphic grows exponentially with time, while for etanercept it grows linearly with time. Hence, these results sustain the need, for patients candidate to TNF blockers, to perform an accurate TB screening at baseline, irrespective of the type of antiTNF. Indeed, screening may decrease the risk of TB reactivation in such patients, while it is less clear what should be done to prevent NTM disease occurrence or progression in patients taking biologic agents. Importantly, for this purpose, we found that the comparison with experimental data allows to infer that reactivation plays a very minor role for both the therapies and that Inline graphic grows quadratically with time.

We checked our results also against Monte Carlo simulation with excellent agreement.

Furthermore, our results are all consistent with recent experimental data and seem to indicate that TB and NTM infections are sustained by different pathogenetic mechanisms.

Non-tuberculous Mycobacteria are present in large numbers in the environment, including fresh water, aerosols, biofilms, and soils [35]. There are thus many opportunities for acquisition of NTM infection during ordinary daily activities, although the true incidence is not known. In contrast, nearly all transmission of Mycobacterium tuberculosis infection results from inhalation cough-generated aerosols from persons with active pulmonary TB. The annual risk of TB infection (ARTI) can be calculated from age-specific rates of tuberculin skin test reactivity; in most instances it is directly related to TB prevalence. Thus, although the ARTI may reach Inline graphic in highly TB-endemic regions such as South Africa, it is as low as Inline graphic in much of Northern Europe and North America [36][38]. These epidemiologic findings are consistent with the results of our mathematical model, and underscore the interplay of microbial and host biology in determining the relative contributions of reinfection and reactivation to mycobacterial pathogenesis.

Hence, while the screening for TB is necessary prior to initiating biologics, when considering NTM only a watchful monitoring during the treatment is recommended. This finding is particularly relevant, since it allows to avoid screening for NTM infection, which is complicated by the poor sensitivity of chest radiograph and more expensive and invasive techniques, such as chest computed tomography scan and/or bronchoscopy, should be used.

It is worth stressing that this methodology, being based on very standard stochastic procedures, has the advantage to hold beyond the test case of Mycobacteria. We hope that this test-case may shed light to future developments of this sideline approach in figuring out adverse events of biological therapies.

Funding Statement

This research was sponsored by the FIRB grant RBFR08EKEV from Ministero dell’ Instruzione Università Ricerca and by Sapienza Università di Roma. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1. Tracey D, Klareskog L, Sasso E, Salfeld J, Tak P (2008) Tumor necrosis factor antagonist mechanisms of action: a comprehensive review. Pharmacol Ther 117: 244–279. [DOI] [PubMed] [Google Scholar]
  • 2. Lee D, Weinblatt M (2001) Rheumatoid arthritis. The Lancet 358: 903–911. [DOI] [PubMed] [Google Scholar]
  • 3. Choy E, Panayi G (2001) Cytokine pathways and joint inflammation in rheumatoid arthritis. N Engl J Med 344: 907–916. [DOI] [PubMed] [Google Scholar]
  • 4. Elliott M, Maini R, Feldmann M (1995) TNF alpha blockade in rheumatoid arthritis: rationale, clinical out-comes and mechanisms of action. Int J Immunopharmacol 17: 141–145. [DOI] [PubMed] [Google Scholar]
  • 5. Tak P, Kalden J (2011) Advances in rheumatology: new targeted therapeutics. Arthritis Res Ther 13: 1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Gardam M, Keystone E, Menzies R, Manners S, Skamene E, et al. (2003) Anti-tumour necrosis factor agents and tuberculosis risk: Mechanisms of action and clinical management. Lancet Infect Dis 3: 148–155. [DOI] [PubMed] [Google Scholar]
  • 7. Wallis R, Ehlers S (2005) Tumor necrosis factor and granuloma biology: Explaining the differential infection risk of etanercept and infliximab. Semin Arthritis Rheum 34: 34–38. [DOI] [PubMed] [Google Scholar]
  • 8. Wallis R (2008) Tumour necrosis factor antagonists: structure, function, and tuberculosis risks. Lancet Infect Dis 8: 601–611. [DOI] [PubMed] [Google Scholar]
  • 9. Wallis R (2008) Mathematical modeling of the cause of tuberculosis during tumor necrosis factor blockade. Arthritis Rheum 58: 947–952. [DOI] [PubMed] [Google Scholar]
  • 10. Wallis R, Broder M, Wong Y, Hanson M, Beenhouwer D (2004) Granulomatous infectious diseases associated with tumor necrosis factor antagonists. Clin Infect Dis 38: 1261–1265. [DOI] [PubMed] [Google Scholar]
  • 11. Plessner H, Lin PL, Kohno T, Louie JS, Kirschner D, et al. (2007) Neutralization of tumor necrosis factor (TNF) by antibody but not tnf receptor fusion molecule exacerbates chronic murine tuberculosis. J Infect Dis 195: 1643–50. [DOI] [PubMed] [Google Scholar]
  • 12. Clay H, Volkman H, Ramakrishnan L (2008) Tumor necrosis factor signaling mediates resistance to mycobacteria by inhibiting bacterial growth and macrophage death. Immunity 29: 283–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Lin P, Myers A, Smith L, Bigbee C, Bigbee M, et al. (2010) TNF neutralization results in disseminated disease during acute and latent M. tuberculosis infection with normal granuloma structure. Arthritis Rheum 62: 340–350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Keane J, Gershon S, Wise R, Mirabile-Levens E, Kasznica J, et al. (2001) Tuberculosis associated with infliximab, a tumor necrosis factor alpha-neutralizing agent. N Engl J Med 345: 1098–104. [DOI] [PubMed] [Google Scholar]
  • 15. Iliopoulos A, Kedikoglou S, Laxanis S, Kourouklis S, Katsaros E (2006) A case of tuberculous meningoencephalitis in a patient with Behcet’s disease. Clin Rheumatol 25: 121–2. [DOI] [PubMed] [Google Scholar]
  • 16. Liberopoulos E, Drosos A, Elisaf M (2002) Exacerbation of tuberculosis enteritis after treatment with infliximab. Am J Med 113: 615. [DOI] [PubMed] [Google Scholar]
  • 17. Verhave JC, van Altena R, Wijnands M, Roerdink H (2008) Tuberculous peritonitis during infliximab therapy. Neth J Med 66: 77–80. [PubMed] [Google Scholar]
  • 18. Schiff M, Burmester G, Kent J, Pangan A, Kupper H, et al. (2006) Safety analysis of adalimumab (humiraæ) in global clinical trials and US postmarketing surveillance of patients with rheumatoid arthritis. Ann Rheum Dis 65: 889–894. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Scrivo R, Sauzullo I, Mengoni F, Iaiani G, Vestri A, et al. (2012) Serial interferon- release assays for screening and monitoring of tuberculosis infection during treatment with biologic agents. Clin Rheumatol 31: 1567–1575. [DOI] [PubMed] [Google Scholar]
  • 20.Scrivo R, Sauzullo I, Mengoni F, Priori R, Coppola M, et al. (2012) Mycobacterial IFN-gamma release variations during long-term treatment with TNF blockers: lack of correlation with clinical outcome. J Rheumatol (in press). [DOI] [PubMed]
  • 21.Wagner D, Young L (2003) Nontuberculous mycobacteria infections: a clinical review. Infection 31. [DOI] [PubMed]
  • 22. Griffith D, Aksamit T, Brown-Elliott B, Catanzaro A, Daley C, et al. (2007) An official ats/idsa statement: diagnosis, treatment, and prevention of nontuberculous mycobacterial diseases. Am J Respir Crit Care Med 175: 367–416. [DOI] [PubMed] [Google Scholar]
  • 23. Winthrop K, Chang E, Yamashita S, Iademarco M, LoBue P (2009) Nontuberculous mycobacteria infections and anti-tumor necrosis factor-α therapy. Emerg Infect Dis 15: 1556–1561. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Winthrop K, Yamashita S, Beekman S, Polgreen P (2008) Mycobacterial and other serious infections in patients receiving anti-TNF and other newly approved biological therapies; case-finding via the emerging infectious network. Clin Infect Dis 46: 1738–1740. [DOI] [PubMed] [Google Scholar]
  • 25. Peschon J, Torrance D, Stocking K, Glaccum M, Otten C, et al. (1998) TNF receptor-deficient mice reveal divergent roles for p55 and p75 in several models of inflammation. J Immunol 160: 943–948. [PubMed] [Google Scholar]
  • 26. Marino S, Sud D, Plessner H, Lin P, Chan J, et al. (2007) Differences in reactivation of tuberculosis induced from anti-tnf treatments are based on bioavailability in granulomatous tissue. PLoS Computational Biology 3: 1909–1924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Fallahi-Sichani M, Flynn J, Linderman J, Kirschner D (2012) Differential Risk of Tuberculosis Reactivation among Anti-TNF Therapies Is Due to Drug Binding Kinetics and Permeability. The J Immun 188: 3169–78. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Pearson RK (1952) Exploring Data in Engineering, the Sciences, and Medicine. Oxford University Press.
  • 29. Iseman M, Marras T (2008) The importance of nontubercolous mycobacterial lung disease. Am J Respir Crit Care Med 178: 999–1001. [DOI] [PubMed] [Google Scholar]
  • 30. Bellomo N, Delitala M (2008) From the mathematical kinetic, and stochastic game theory, to modelling mutations, onset, progression and immune competition of cancer cells. Phys Life Rev 5: 18–206. [Google Scholar]
  • 31. Agliari E, Barra A, Gervasi Vidal K, Guerra F (2012) Can persistent Epstein-Barr virus infection induce chronic fatigue syndrome as a Pavlov reflex of the immune response? J Biol Dyn 6: 740–762. [DOI] [PubMed] [Google Scholar]
  • 32. Agliari E, Barra A, Guerra F, Moauro F (2011) A thermodynamic perspective of immune capabilities. J Theor Biol 287: 48–63. [DOI] [PubMed] [Google Scholar]
  • 33. Paulsson J (2005) Models of stochastic gene expression. Phys Life Rev 2: 157–175. [Google Scholar]
  • 34. Cooper E (2010) Evolution of immune system from self not-self to danger to artificial immune system. Phys Life Rev 7: 55–78. [DOI] [PubMed] [Google Scholar]
  • 35. Falkinham JI (2002) Nontuberculous mycobacteria in the environment. Clin Chest Med 23: 529–551. [DOI] [PubMed] [Google Scholar]
  • 36. Sutherland I, Bleiker M, Meijer J, Styblo K (1983) The risk of tuberculous infection in the Netherlands from 1967 to 1979. Tubercle 64: 241–253. [DOI] [PubMed] [Google Scholar]
  • 37. Shanaube K, Sismanidis C, Ayles H, Beyers N, Schaap A, et al. (2009) Annual risk of tuberculous infection using different methods in communities with a high prevalence of TB and HIV in Zambia and South Africa. PLoS One 4: e7749. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Daniel T, Debanne S (1997) Estimation of the annual risk of tuberculosis infection for white men in the United States. J Infect Dis 175: 1535–1537. [DOI] [PubMed] [Google Scholar]

Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES