Skip to main content
Antimicrobial Agents and Chemotherapy logoLink to Antimicrobial Agents and Chemotherapy
. 2020 Mar 24;64(4):e02070-19. doi: 10.1128/AAC.02070-19

Extension of Pharmacokinetic/Pharmacodynamic Time-Kill Studies To Include Lipopolysaccharide/Endotoxin Release from Escherichia coli Exposed to Cefuroxime

Anders Thorsted a, Eva Tano b, Kia Kaivonen a, Jan Sjölin b, Lena E Friberg a,, Elisabet I Nielsen a,
PMCID: PMC7179275  PMID: 31988100

The release of inflammatory bacterial products, such as lipopolysaccharide (LPS)/endotoxin, may be increased upon the administration of antibiotics. An improved quantitative understanding of endotoxin release and its relation to antibiotic exposure and bacterial growth/killing may be gained by an integrated analysis of these processes. The aim of this work was to establish a mathematical model that relates Escherichia coli growth/killing dynamics at various cefuroxime concentrations to endotoxin release in vitro.

KEYWORDS: LPS, pharmacokinetics/pharmacodynamics, cefuroxime, endotoxin, time-kill

ABSTRACT

The release of inflammatory bacterial products, such as lipopolysaccharide (LPS)/endotoxin, may be increased upon the administration of antibiotics. An improved quantitative understanding of endotoxin release and its relation to antibiotic exposure and bacterial growth/killing may be gained by an integrated analysis of these processes. The aim of this work was to establish a mathematical model that relates Escherichia coli growth/killing dynamics at various cefuroxime concentrations to endotoxin release in vitro. Fifty-two time-kill experiments informed bacterial and endotoxin time courses and included both static (0×, 0.5×, 1×, 2×, 10×, and 50× MIC) and dynamic (0×, 15×, and 30× MIC) cefuroxime concentrations. A model for the antibiotic-bacterium interaction was established, and antibiotic-induced bacterial killing followed a sigmoidal Emax relation to the cefuroxime concentration (MIC-specific 50% effective concentration [EC50], maximum antibiotic-induced killing rate [Emax] = 3.26 h−1 and γ = 3.37). Endotoxin release was assessed in relation to the bacterial processes of growth, antibiotic-induced bacterial killing, and natural bacterial death and found to be quantitatively related to bacterial growth (0.000292 endotoxin units [EU]/CFU) and antibiotic-induced bacterial killing (0.00636 EU/CFU). Increased release following the administration of a second cefuroxime dose was described by the formation and subsequent antibiotic-induced killing of filaments (0.295 EU/CFU). Release due to growth was instantaneous, while release due to antibiotic-induced killing was delayed (mean transit time of 7.63 h). To conclude, the in vitro release of endotoxin is related to bacterial growth and antibiotic-induced killing, with higher rates of release upon the killing of formed filaments. Endotoxin release over 24 h is lowest when antibiotic exposure rapidly eradicates bacteria, while increased release is predicted to occur when growth and antibiotic-induced killing occur simultaneously.

TEXT

Gram-negative bacterial infections constitute a serious health problem and are associated with high mortality rates in the intensive care unit (1, 2). A large portion of the outer plasma membrane of Gram-negative bacteria consists of lipopolysaccharide (LPS)/endotoxin (3, 4). Innate immune cell recognition of endotoxin will alert host defenses and establish an inflammatory response aimed at the infection, but this response might be dysregulated, leading to tissue and organ injury in the host (5). In piglets, the immune response has been shown to intensify with increased endotoxin exposure and/or rate of delivery (6, 7). However, while a correlation between endotoxemia and patient mortality has been shown in some studies (8, 9), the overall evidence is inconclusive (10, 11), and the prognostic value of endotoxemia remains unresolved (12).

According to guidelines, empirical intravenous administration of one or multiple broad-spectrum antibiotics should be initiated within 1 h of the recognition of sepsis to cover all likely pathogens (13). The mechanism of action for antibiotic-induced bacterial death directly influences endotoxin release (14), with β-lactams known to be potent inducers of release (15). The β-lactams target the penicillin-binding proteins (PBPs), important enzymes (transpeptidases) that catalyze cross-linking reactions during bacterial cell wall synthesis (16). As specificity for a single PBP is rare, antibiotic-induced killing is the result of combined PBP inhibition and differentiated effects across the concentration gradient (17, 18). PBPs 1 to 3 are of primary importance for bacterial survival, and as general Gram-negative examples, inhibition of Escherichia coli-specific PBPs 1 to 3 results in bacterial lysis, the formation of spheroplasts, and the formation of long filaments, respectively (19). Individual microbial growth without an increase in CFU (i.e., biomass increase due to filament formation) is observed for antibiotics that primarily bind PBP-3, such as the second-generation cephalosporin cefuroxime and antibiotics commonly used for the treatment of sepsis, such as piperacillin-tazobactam, cefotaxime, and meropenem (17, 19, 20). PBP-3 binding may lead to a large endotoxin release upon final bacterial lysis (10, 19), with filament formation found to generally occur at concentration ranges above the pathogen MIC (21). As PBP-1 binding (i.e., lysis) occurs at higher antibiotic concentrations than PBP-3 binding, extensive filament production might occur at clinically relevant concentrations for less susceptible microorganisms (17, 18, 21).

Mathematical models that simultaneously describe bacterial growth and antibiotic-induced killing over time have been developed and help to facilitate a quantitative understanding of antibiotic-bacterium interactions (22). Such models typically describe exponential bacterial growth up to a maximum capacity and account for antibiotic-induced killing and natural bacterial death (23). This quantification and separation of antibiotic-bacterial processes could be utilized in the quantification of endotoxin release. Quantitative models find additional value when used in prediction, for instance, of scenarios of interest to study further experimentally, for optimization of doses and/or sampling times, or for hypothesis generation through increased system understanding.

In this work, we aim to quantify the in vitro release of endotoxin from E. coli exposed to both static and dynamic concentrations of cefuroxime, a PBP-3-active β-lactam antibiotic. Processes accounting for bacterial dynamics (such as growth and antibiotic-induced kill) were linked to endotoxin release, resulting in an integrated mathematical model with a specific focus on the time course of endotoxin release, and release for a number of clinically used cefuroxime regimens was predicted.

RESULTS

The mathematical framework was established based on newly generated static time-kill experiments (n = 28) and data from previously reported dynamic time-kill experiments (n = 24) (24).

The antibiotic cefuroxime was one of the most commonly used antibiotics in Swedish hospitals at the time of the dynamic experiments (25) and was chosen for consistency in the generation of the new static data. Static study data contributed 382 CFU counts (8 below the limit of detection [LOD]; on average, 2.3 counts per time point) and 168 endotoxin concentrations (all quantified). Approximate observed start inocula were 3 × 103, 4 × 105, and 4.5 × 107 CFU/ml, with data illustrated in Fig. 1. The expected relationship between antibiotic exposure and bacterial killing was observed, with 2× MIC needed for a bactericidal effect with a medium/low start inoculum and a reduced killing effect at a higher start inoculum. The endotoxin level increased approximately 1 log-fold at high drug exposures and significantly more in controls and 0.5× and 1× MIC experiments. The dynamic study data consisted of 439 counts of CFU (4 below the LOD; on average, 4 counts per time point) and 102 measurements of endotoxin (all quantified) with an approximate start inoculum of 2.5 × 106 CFU/ml. Rapid initial killing was followed by significant variability in bacterial regrowth (around 12 h) and was mirrored in the time course of endotoxin. A schematic of the final model framework is presented in Fig. 2.

FIG 1.

FIG 1

Overview of available data (points) from individual experiments (connected with lines), showing the time courses of CFU (top) and endotoxin units (EU) (bottom). The studies were performed with static or dynamic cefuroxime concentrations at various starting inocula, and the color and shape of the points refer to cefuroxime exposure, as indicated in the key. The horizontal dashed lines indicate the lower limit of detection (10 CFU/ml). PK, pharmacokinetics.

FIG 2.

FIG 2

Schematic of the final model, linking the antibiotic concentration-time course (CAB) to the bacterial dynamics represented by the S (susceptible), R (resting), and F (filament) states, with the antibiotic stimulating killing of the S (and F) population(s) through a sigmoidal Emax relationship to cefuroxime exposure (CAB). The increase in the LPS/endotoxin concentration (CETX) was driven by the growth of the bacteria in S (direct contribution to CETX) and by the antibiotic-induced killing of bacteria in S and F (delayed contribution to CETX through transit compartments 1 [Tr1] and 2 [Tr2]). See Table 1 for parameter estimates.

Bacterial dynamics.

The bacterial dynamics were well characterized by the model structure previously described (23), with a few adaptations. The model fit improved significantly when estimating separate 50% effective concentration (EC50) values for MIC values of 2 and 4 mg/liter (difference in objective function value [ΔOFV] = −87.20), with estimates of 2.93 and 4.88 mg/liter. The transition from a susceptible state (S) to a resting bacterial state (R) was coupled to a step function, with an estimated threshold (TSR) of total bacteria (S + R), according to the following equation:

SRstep=(S+R)10(S+R)10+TSR10 (1)

where the power of 10 produces an on-off relation and the value of SRstep (0 to 1) is multiplied on the transition function, as indicated in Fig. 2 (ΔOFV = −37.97). The high TSR estimate (7 × 107 CFU/ml) keeps most bacteria in the susceptible state and reflects that rapid killing was initially observed in high-inoculum experiments. Finally, a mixture model with two populations (ΔOFV = −33.43) identified 43% of the dynamic experiments as having a 36% higher elimination rate (kel) for cefuroxime than the planned 0.426 h−1 (the remaining experiments had the intended kel).

Endotoxin release with static cefuroxime concentrations.

An increase in the endotoxin concentration was observed across all experiments, including controls, indicating that release occurs during normal growth and antibiotic-induced bacterial killing. The statistically most significant effect, based on equations 5 to 7, was observed when binary fission (dividing bacteria) was driving the increase in endotoxin (kG,ETX, ΔOFV = −1,086.68), improving further with the addition of an effect from antibiotic-induced bacterial killing (kK,ETX, ΔOFV = −84.67). A contribution from natural bacterial death was significant (kD,ETX, ΔOFV = −7.67 [P < 0.01]) but was omitted due to high uncertainty in the parameter estimate.

Endotoxin release with dynamic cefuroxime concentrations and filament formation.

While release following the first cefuroxime dose was well described by applying the model developed based on static data (with endotoxin eliminated at the rate kel), the increased release following the second dose could not be adequately captured. As the formation of filaments was the most likely mechanism, susceptible bacteria were allowed to transition to a filamentous state (F) at certain antibiotic concentrations (equation 8) centered on bacterial MIC times an estimate of 5.90 (ΔOFV = −117.20, for two additional parameters). The release of endotoxin from filaments is described by equations 9 and 10.

Final model and predictions.

A delay in endotoxin release following antibiotic-induced killing of susceptible and filamentous bacteria (one transit compartment with a mean transit time of 7.63 h) significantly improved the fit (ΔOFV = −165.09). No improvement was observed with a delay of endotoxin release due to bacterial growth. The contribution to endotoxin release was as follows: 0.000292 endotoxin units (EU) per grown (kG,ETX) CFU, 0.00636 EU per killed susceptible (kK,ETX) CFU, and 0.295 EU per killed filamentous (kF,ETX) CFU. Parameter estimates and their uncertainty are presented in Table 1, and model fits for CFU and endotoxin time courses are shown in Fig. 3 for static cefuroxime concentrations and in Fig. 4 for dynamic cefuroxime concentrations.

TABLE 1.

Overview of parameters in the final model with values estimated on all data (including both static and dynamic cefuroxime concentrations)a

Parameter (unit) Parameter description Estimate (RSE [%])
kgrowth (h−1) Bacterial growth rate 1.45 (5.1)
kdeath (h−1) Bacterial natural death rate 0.179 (fix)
Bmax (CFU/ml) Bacterial system capacity 1.42 × 108 (19)
TSR (CFU/ml) Threshold for transition from S state to R state 7.01 × 107 (14)

Emax (h−1)
Maximum antibiotic-induced killing rate 3.26 (3.8)
EC50 (mg/liter) Potency for drug effect (MIC dependent)
MIC = 2 mg/liter 2.93 (2.7)
MIC = 4 mg/liter 4.88 (11)
γ Sigmoidal Hill coefficient 3.37 (25)
kdeg (h−1) Degradation rate of antibiotic (both systems) 0.026 (fix)
kel (h−1) Elimination rate (dynamic system) 0.462 (fix)
Mix Fraction of experiments with typical elimination 0.574 (24)
Offset Proportional change for atypical elimination 1.36 (4.7)
kG,ETX (EU/CFU) LPS/endotoxin from bacterial growth (S) 0.000292 (11)
kK,ETX (EU/CFU) LPS/endotoxin from antibiotic-killed bacteria (S) 0.00636 (25)
kFK,ETX (EU/CFU) LPS/endotoxin from antibiotic-killed filaments (F) 0.295 (43)
ktr,ETX (h−1) Transit rate for LPS/endotoxin release (S + F) 0.131 (27)
θMIC,F Concentration × MIC for filament formation 5.90 (8.2)
ω2 CFU unexplained residual variance 0.409 (12)
ωrepl2 CFU replication error (plate spread) variance 0.0363 (16)
ω2 LPS/endotoxin unexplained residual variance 0.164 (13)
a

EU, endotoxin units; F, filament biomass state; R, resting state; RSE, relative standard error; S, susceptible state.

FIG 3.

FIG 3

Visual predictive checks for the time courses of CFU (a) and endotoxin units (EU) (b) in the experiments with static cefuroxime concentrations. The red circles correspond to the observed data, while the long-dashed lines correspond to the median simulated data. The shaded area between the two short-dashed lines corresponds to the 95% confidence interval (CI) around the simulated median data. The horizontal dashed line in panel a indicates the lower limit of detection (10 CFU/ml).

FIG 4.

FIG 4

Visual predictive checks for the time courses of CFU (a) and endotoxin units (b) in the experiments with dynamic cefuroxime concentrations. The red circles correspond to the observed data, while the long-dashed lines correspond to the median simulated data. The shaded area between the two short-dashed lines corresponds to the 95% CI around the simulated median data. The horizontal dashed line in panel a indicates the lower limit of detection (10 CFU/ml).

The treatment regimens used in the predictions resulted in typical cefuroxime exposure, CFU, and endotoxin release time courses, as shown in Fig. 5. When CFU are rapidly reduced, endotoxin concentrations reach approximately 104 to 5 × 104 EU/ml, much lower than the control levels of approximately 3 × 105 EU/ml, even though regimens with a 750-mg dose show slightly higher endotoxin release than other doses due to less rapid killing. With increasing MICs, the lower cefuroxime-induced killing of bacteria leads to endotoxin release from bacterial growth and antibiotic-induced killing simultaneously, producing a higher endotoxin concentration of between approximately 105 and 5 × 105 EU/ml.

FIG 5.

FIG 5

Prediction from the final model of LPS/endotoxin release under various cefuroxime treatment regimens during infection of pathogens with three MIC values (2, 8, and 32 mg/liter) (shown in the key) at an inoculum of 106 CFU/ml. Treatment regimens shown are constant infusion (CI) preceded by a 4-min infusion of 750 mg and 30-min infusions of 750 mg given every 6 h (q6h) and 750 and 1,500 mg given every 8 h (q8h). The horizontal dashed line in panel b indicates the lower limit of detection (10 CFU/ml).

DISCUSSION

The presented work establishes a new mathematical model that can be used for the exploration of endotoxin release in the context of antibiotic administration or bacterial growth, by the quantitative link of release to the two processes of bacterial growth and antibiotic-induced killing. Three E. coli strains exposed to the β-lactam antibiotic cefuroxime in setups with static or dynamic concentrations (24) and various inoculum sizes provided sufficient data (Fig. 1) to establish the novel model framework presented in Fig. 2.

The dynamics between cefuroxime and bacteria were described by a previously reported model structure (22, 23), with reasonable parameter estimates, in relation to both the data and previously reported values for the maximum antibiotic-induced killing rate (Emax) (23), bacterial system capacity (Bmax) (23), and bacterial growth rate (kgrowth) (26). In addition to separate EC50 estimates for MIC values of 2 and 4 mg/liter (2.93 and 4.88 mg/liter, also parameterized so that EC50 estimates are proportional to the MIC) (26), a high γ of 3.37 was estimated, likely true for β-lactams where thresholds (e.g., fT>MIC [time of a 24-h period that the drug concentration exceeds the MIC of the free, unbound fraction of the drug under steady-state pharmacokinetic conditions]) are often linked to the effect (27). Further adaptations were needed to fit the high-inoculum (107 CFU/ml) and high-exposure (50× MIC) data, achieved with the inclusion of a step function (equation 1) to limit the transition of susceptible bacteria to the resting state at low bacterial counts. This is in line with work on persisters (represented by part of the resting state), which exhibit a sharp increase in the mid- to late exponential growth phase in E. coli (28). The threshold estimate of approximately 7 × 107 CFU/ml may be considered high compared to the maximum system capacity of 1.42 × 108 CFU/ml but considerably improved the fit of observed rapid kill at a high inoculum. Considerable variability in regrowth in the dynamic experiments has been reported previously (29) but may in part be attributed to experimental variability (such as pump performance, indicated in some dynamic experiments). The model described two subpopulations, with some experiments assigned a 36% increased (estimated) kel, with a strong probability of assignment (0.95 to 0.99) across dynamic experiments (30, 31). While not measured, the optimal solution would have been to develop a model for the cefuroxime concentrations (24).

The model that accounts for endotoxin concentrations was developed by quantitatively relating the generated and killed CFU, through processes of bacterial growth and antibiotic-induced killing, to endotoxin release, assuming that endotoxin did not degrade at 37°C during the experiments. Endotoxin is regarded as extremely heat stable (3, 32, 33), and with the constant concentrations observed between 6 and 24 h in the high-exposure experiments (10× and 50× MIC), in light of the rapid reduction in CFU, degradation under the reported experimental conditions is unlikely. Linking release to growth is sensible, as control experiments achieve high endotoxin concentrations after 24 h, and it is probable that the process of binary fission leads to shedding of endotoxins into the solution (34). The instantaneous endotoxin release due to bacterial growth may be explained as occurring only during the separation into two bacteria. The delayed and prolonged release following antibiotic-induced kill, reported previously to be between 0.5 and 6 h (35, 36), shows that endotoxin release from a single CFU following lysis is a delayed process.

A linear relationship between the log10 CFU reduction and log10 increase in endotoxin has previously been proposed (37). However, control experiments demonstrate that growing bacteria rapidly lead to an increase in endotoxin (0.000292 EU per new CFU), although the curve eventually plateaus as growth becomes limited due to the capacity of the system. Antibiotic-induced killing produces a larger release (0.00636 EU per killed CFU), which is expected and was shown previously for β-lactam antibiotics that exert bactericidal effects (36).

While not quantified in the present study, a previous assessment of similar β-lactam antibiotics (ceftazidime and cefotaxime) demonstrated that long filaments are formed at concentrations at and above the pathogen MICs for various E. coli isolates, including the ATCC 25922 reference strain used in the present study (21). The incorporated filament formation is predicted to occur more extensively in the dynamic experiments with less initial kill (15× MIC), as more bacteria are available for transition into the filamentous state at relevant concentrations in the dynamic cefuroxime concentration-time profile. As the formed filaments vary in length and, thus, endotoxin content (21), the estimated release of 0.295 EU per antibiotic-killed filament (46 times higher than an antibiotic-killed susceptible bacterium) is based on an empirical relation without clear mechanistic interpretation. Indeed, the estimate of 0.295 EU/CFU is negatively correlated with the number of filamentous bacteria, governed by the transition of bacteria from the susceptible state to the filamentous state, with an assumed peak of 1. While the assessment of different peak rates (0.5, 2, and 4) illustrated this, it is noteworthy that estimates of θMIC-F, kG,ETX, and kK,ETX remained close to the reported final values. However, extensive filament formation at clinically relevant concentrations for the treatment of intermediate or less susceptible bacteria (represented by high MICs of 8 and 32 mg/liter, which were not studied experimentally in the present work) (21) may be extended to an expectation of an increased release of endotoxins, as demonstrated in Fig. 5. It should be noted that the predictions are based on the extrapolation of EC50s estimated for relatively susceptible bacteria (MICs of 2 and 4 mg/liter) to high MICs, and even though a strong EC50-MIC correlation has been shown in previous studies (26, 38), the fact that less susceptible strains were not studied is a limitation. Nevertheless, increased release of endotoxins may be added to the list of hazards facing patients suffering from infections with intermediate or less susceptible bacteria.

Even though a single bacterial species (E. coli) and antibiotic (cefuroxime) were used, the structural model obtained in this work could be generalized and applied to other Gram-negative bacteria and antibiotics of the β-lactam class. While the point estimates for endotoxin release per CFU and the relative contribution of filaments to overall release are expected to depend strongly on the drug-bug PBP specificity (17, 33) and, thus, vary within and between antibiotic classes, the overall findings are expected to be generalizable for β-lactams and Gram-negative species.

Although preclinical relations between antibiotic-induced endotoxin release and mortality have been established (39), this connection has been difficult to observe in clinical practice. Problematic assaying of endotoxin and the diagnostic relevance of endotoxemia in the clinic, discussed previously (40, 41), represent possible causes of these difficulties. Complexities such as variability in endotoxin heterogeneity, content across strains, and the release of other associated bacterial products add to the problem, in addition to underlying patient heterogeneity (infecting organisms, comorbidities, and immune status, etc.).

While the use of three strains adds to the generalizability of the established model, examining one strain under both static and dynamic setups would have added value by allowing examination of the potential system effects on both growth and endotoxin release. The developed model could be informed by new static experiments with less susceptible bacteria or with cefuroxime concentrations in the range predicted to induce filament formation, in addition to quantification of the number of produced filaments. An additional aspect would be the inclusion of data from combination treatment, as the addition of an aminoglycoside with the second cefuroxime dose has been shown to reduce the release of endotoxin (24), with less visible filament formation due to inhibition of protein synthesis. Antibiotic-induced endotoxin release has also been studied in the context of bacteriophage therapy, with observations of increased survival (42) and diminished endotoxin release (43) compared to conventional antibiotics and controls. The addition of such data with a different interaction between “drug” and bacteria would provide an extended model.

In conclusion, processes of bacterial growth and antibiotic-induced bacterial killing were successfully tied to endotoxin release and quantified in a mathematical model. Experiments with observed (but not quantified) filament formation were incorporated and recognized as having increased endotoxin release upon kill. Taken together, endotoxin release over 24 h is lowest when antibiotic exposure rapidly eradicates the bacteria and highest at doses that lead to fluctuating concentrations around the MIC, allowing for simultaneous division, drug-induced kill, and, potentially, filament formation.

MATERIALS AND METHODS

Time-kill experiments with static cefuroxime concentrations were designed for the purpose of this study and complemented with previously reported time-kill experiments using dynamic concentrations (24).

In vitro experiments.

Test strains were inoculated in pyrogen-free glass tubes containing brain heart infusion broth prior to experiments and incubated for 4.5 h at 35°C to bring the bacteria into the logarithmic growth phase.

In the time-kill experiments with static antibiotic concentrations, a clinical E. coli strain (B09-118-22; MIC of 2 mg/liter) was exposed to six cefuroxime concentrations (0×, 0.5×, 1×, 2×, 10×, and 50× MIC) across three starting inocula (approximately 103, 105, and 107 CFU/ml). Experiments were performed in duplicate in brain heart infusion broth at 37°C, with samples for CFU counts and endotoxin analysis drawn before and 1, 2, 4, 6, and 24 h after the addition of the antibiotic.

The study with dynamic antibiotic concentrations, described previously (24), involved a clinical E. coli strain (B049-3036; MIC of 2 mg/liter) and a reference E. coli strain (ATCC 25922; MIC of 4 mg/liter). Experiments were repeated six and eight times for each strain (durations of 14 to 18 h), in addition to controls (durations of 4 to 6 h), and were performed at 37°C in a kinetic system (29) consisting of a spinner flask fitted with a pump and filter membrane (0.45 μm) to prevent the elimination of bacteria. Bacteria were added to the system at 0 h (starting inoculum of approximately 106 CFU/ml), followed by cefuroxime at 0 h and at approximately 12 h to achieve a peak concentration of 60 mg/liter (15× or 30× MIC). The pump was configured to yield a cefuroxime half-life (t1/2) of 1.5 h (kel of 0.462 h−1), akin to that in patients (24, 44). Samples for CFU counts and endotoxin analysis were taken before and 2 and 4 h after the addition of the antibiotic.

For both experimental setups, samples were seeded onto at least two Columbia agar plates and incubated at 35°C for 48 h before viable counting of the bacteria (with a limit of detection [LOD] of 10 CFU/ml). For quantification of endotoxin, measured in endotoxin units (EU) per milliliter, samples were filtered and frozen at −70°C before being analyzed in duplicate with the kinetic chromogenic Limulus amebocyte lysate (LAL) assay (45).

Software and model selection.

The generated data were analyzed in NONMEM 7.4.3 (46), using the Laplacian estimation method to obtain maximum likelihood estimates and incorporate CFU observations below the LOD (10 CFU/ml) by the use of M3 (47). For CFU, all replicate plate counts were included in the modeling, and L2 functionality was used to split CFU residual errors into sample- and replicate-specific errors (23). Additive residual errors to the log10 of predictions were used for both CFU counts and endotoxin samples.

Comparisons between two competing nested models were done using the likelihood ratio test based on the OFVs, a statistical measure to judge model fit, which is assumed to be χ2 distributed and where a ΔOFV of −3.84 is significant at a P value of 0.05 for one additional parameter. Additional diagnostics consisted of residual goodness of fit, simulation-based visual predictive checks (VPCs) (31, 48), and reasonable parameter estimates.

Modeling of bacterial dynamics.

Modeling of bacterial dynamics started from a previously reported model describing Streptococcus pyogenes and cefuroxime in a static in vitro system (23). The model consists of differential equations describing antibiotic concentration (CAB), susceptible bacteria (S), and resting bacteria (R), with the model prediction of CFU per milliliter equal to the sum of S and R, as shown in the following equations:

dCABdt=(kdeg+kel)×CAB (2)
dSdt=kdeath×SkSR×S+kRS×R+kgrowth×S(Emax×CABγEC50γ+CABγ)×S (3)
dRdt=kdeath×R+kSR×SkRS×R (4)

where kdeg, kel, kdeath, and kgrowth are first-order rate constants describing antibiotic degradation, antibiotic elimination, natural bacterial death, and bacterial growth, respectively, and kSR describes the rate at which bacteria transform from the growing drug-susceptible state (S) into the resting state (R). The rate depends on total viable bacteria in the system (S + R) and is parameterized as (kgrowthkdeath)/Bmax × (S + R), where Bmax represents the system capacity. With this model implementation, the resting state of the bacteria is included in order to describe the observed biphasic killing behavior and inoculum effect. Parameters related to antibiotic effect refer to the maximum drug-induced killing rate (Emax), potency as the concentration for a half-maximum killing rate (EC50), and the Hill coefficient (γ). Previously reported values were used and fixed for kdeath (0.179 h−1), kRS (0 h−1), and kdeg (0.026 h−1) (23).

For the study using dynamic cefuroxime concentrations, the pump was configured to simulate a kel of 0.462 h−1, which, after the addition of kdeg, results in a final simulated half-life of 1.42 h. The inclusion of strains with various MICs led to an assessment of specific fixed effects for potency (EC50). Variable bacterial regrowth was observed following washout of the first cefuroxime dose and may be attributed to experimental variability (clogging and/or leakage affecting the kel of the drug from the system). This was assessed with a mixture model, which can describe two or more discrete populations with the likelihood determining the most probable kel for each experiment (30).

Adaptations such as a delay in bacterial growth and/or antibiotic-induced kill, correlation between bacterial MIC and EC50, or application of a threshold value for allowing the transition of susceptible bacteria into the resting bacterial state were also assessed.

Modeling of endotoxin release.

The bacterial model was extended to endotoxin samples from experiments with static cefuroxime concentrations, with liberated endotoxin related to bacterial processes of (i) binary fission (growth [G]), (ii) antibiotic-induced killing (K), and (iii) natural bacterial death (D), described in the following equations:

dGdt=kG,ETX×kgrowth×Skel×G (5)
dKdt=kK,ETX×(Emax×CABγEC50γ+CABγ)×Skel×K (6)
dDdt=kD,ETX×kdeath×(S+R)kel×D (7)

where the release of endotoxin from the respective population of CFU was scaled by the constants kG,ETX, kK,ETX, and kD,ETX (representing EU per CFU). Endotoxin was assumed to be stable during the experimental duration (i.e., no degradation), with kel representing the elimination rate (set to zero in static experiments).

In the dynamic in vitro model, extensive formation of bacterial filaments was reported following the second antibiotic dose, accompanied by a large increase in the endotoxin concentration (24). The dynamic cefuroxime profile was assumed to include concentrations at which the affinity for PBP-3 led to bacterial elongation (i.e., constant CFU but increased biomass). Upon the administration of the second dose, elevated concentrations and affinity for PBP-1 then liberated an increased amount of endotoxin from the filaments (19). A Gaussian function (describing a bell-shaped curve) was assessed as follows:

kfilament [f(CAB)]=e(CABθMIC,F×MIC)22×12 (8)

where the first-order rate constant kfilament, ranging from 0 to 1, facilitates the transition from the susceptible bacterial state (S) to a filamentous state (F), centered around an antibiotic concentration given by the pathogen MIC times an estimated parameter, θMIC,F, described according to

dFdt=(Emax×CABγEC50γ+CABγ)×Fkdeath×F+kfilament×S+kgrowth×F (9)
dFKdt=kF,ETX×(Emax×CABγEC50γ+CABγ)×Fkel,ETX×FK (10)

where equation 9 describes the formation of filaments. The additional growth in F (kgrowth, the same value as in equation 3 for S) would not contribute to the observed bacterial counts (S + R + F) but represents an increase in biomass, which leads to increased endotoxin release upon antibiotic-induced killing of the filaments. Similar to equations 5 to 7, the number of EU released per killed filament (described by kF,ETX) is shown in equation 10.

Taken together, the model prediction of EU per milliliter becomes the sum of the endotoxin concentration observed at baseline and bacterial endotoxin release from growth (G), antibiotic-induced killing of susceptible bacteria (K), natural death (D), and antibiotic-induced killing of filaments (FK).

Based on the final model, endotoxin release for an assumed infection (49) of 106 CFU/ml and the corresponding in vitro endotoxin baseline were predicted by utilizing a population pharmacokinetic model for cefuroxime (44) and assuming an unbound fraction of 0.67 (50). As estimates of endotoxin clearance are not available for humans, kel was set to zero to illustrate cumulative endotoxin release. Clinical regimens were chosen based on Summary of Product Characteristics (SmPC) recommendations (51) and consisted of a continuous infusion of 3,000 mg/24 h preceded by a 4-min infusion of 750 mg, a 30-min infusion of 750 mg given every 6 h, and 30-min infusions of 750 or 1,500 mg given every 8 h. Three MICs (2, 8, and 32 mg/liter) were used to illustrate endotoxin release under various combinations of antibiotic-induced killing and microbial growth, with EC50s scaled proportionally to the MIC.

ACKNOWLEDGMENT

This work was in part funded by the Joint Programming Initiative on Antimicrobial Resistance (JPIAMR), grant no. 2015-06826, under the Swedish Research Council (VR).

REFERENCES

  • 1.Vincent JL, Rello J, Marshall J, Silva E, Anzueto A, Martin CD, Moreno R, Lipman J, Gomersall C, Sakr Y, Reinhart K, EPIC II Group of Investigators . 2009. International study of the prevalence and outcomes of infection in intensive care units. JAMA 302:2323–2329. doi: 10.1001/jama.2009.1754. [DOI] [PubMed] [Google Scholar]
  • 2.Arefian H, Heublein S, Scherag A, Brunkhorst FM, Younis MZ, Moerer O, Fischer D, Hartmann M. 2017. Hospital-related cost of sepsis: a systematic review. J Infect 74:107–117. doi: 10.1016/j.jinf.2016.11.006. [DOI] [PubMed] [Google Scholar]
  • 3.Henderson JC, Zimmerman SM, Crofts AA, Boll JM, Kuhns LG, Herrera CM, Trent MS. 2016. The power of asymmetry: architecture and assembly of the Gram-negative outer membrane lipid bilayer. Annu Rev Microbiol 70:255–278. doi: 10.1146/annurev-micro-102215-095308. [DOI] [PubMed] [Google Scholar]
  • 4.Nau R, Eiffert H. 2002. Modulation of release of proinflammatory bacterial compounds by antibacterials: potential impact on course of inflammation and outcome in sepsis and meningitis. Clin Microbiol Rev 15:95–110. doi: 10.1128/cmr.15.1.95-110.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, Hotchkiss RS, Levy MM, Marshall JC, Martin GS, Opal SM, Rubenfeld GD, van der Poll T, Vincent JL, Angus DC. 2016. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA 315:801–810. doi: 10.1001/jama.2016.0287. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Lipcsey M, Larsson A, Eriksson MB, Sjolin J. 2006. Inflammatory, coagulatory and circulatory responses to logarithmic increases in the endotoxin dose in the anaesthetised pig. J Endotoxin Res 12:99–112. doi: 10.1179/096805106X89053. [DOI] [PubMed] [Google Scholar]
  • 7.Lipcsey M, Larsson A, Eriksson MB, Sjolin J. 2008. Effect of the administration rate on the biological responses to a fixed dose of endotoxin in the anesthetized pig. Shock 29:173–180. doi: 10.1097/SHK.0b013e318067dfbc. [DOI] [PubMed] [Google Scholar]
  • 8.Brandtzaeg P, Kierulf P, Gaustad P, Skulberg A, Bruun JN, Halvorsen S, Sorensen E. 1989. Plasma endotoxin as a predictor of multiple organ failure and death in systemic meningococcal disease. J Infect Dis 159:195–204. doi: 10.1093/infdis/159.2.195. [DOI] [PubMed] [Google Scholar]
  • 9.Opal SM, Scannon PJ, Vincent JL, White M, Carroll SF, Palardy JE, Parejo NA, Pribble JP, Lemke JH. 1999. Relationship between plasma levels of lipopolysaccharide (LPS) and LPS-binding protein in patients with severe sepsis and septic shock. J Infect Dis 180:1584–1589. doi: 10.1086/315093. [DOI] [PubMed] [Google Scholar]
  • 10.Lepper PM, Held TK, Schneider EM, Bolke E, Gerlach H, Trautmann M. 2002. Clinical implications of antibiotic-induced endotoxin release in septic shock. Intensive Care Med 28:824–833. doi: 10.1007/s00134-002-1330-6. [DOI] [PubMed] [Google Scholar]
  • 11.Holzheimer RG. 2001. Antibiotic induced endotoxin release and clinical sepsis: a review. J Chemother 13(Special Issue No. 1):159–172. doi: 10.1179/joc.2001.13.Supplement-2.159. [DOI] [PubMed] [Google Scholar]
  • 12.Hurley JC, Guidet B, Offenstadt G, Maury E. 2012. Endotoxemia and mortality prediction in ICU and other settings: underlying risk and co-detection of Gram negative bacteremia are confounders. Crit Care 16:R148. doi: 10.1186/cc11462. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Rhodes A, Evans LE, Alhazzani W, Levy MM, Antonelli M, Ferrer R, Kumar A, Sevransky JE, Sprung CL, Nunnally ME, Rochwerg B, Rubenfeld GD, Angus DC, Annane D, Beale RJ, Bellinghan GJ, Bernard GR, Chiche J-D, Coopersmith C, De Backer DP, French CJ, Fujishima S, Gerlach H, Hidalgo JL, Hollenberg SM, Jones AE, Karnad DR, Kleinpell RM, Koh Y, Lisboa TC, Machado FR, Marini JJ, Marshall JC, Mazuski JE, McIntyre LA, McLean AS, Mehta S, Moreno RP, Myburgh J, Navalesi P, Nishida O, Osborn TM, Perner A, Plunkett CM, Ranieri M, Schorr CA, Seckel MA, Seymour CW, Shieh L, Shukri KA, et al. 2017. Surviving Sepsis Campaign. International guidelines for management of sepsis and septic shock: 2016. Crit Care Med 45:486–552. doi: 10.1097/CCM.0000000000002255. [DOI] [PubMed] [Google Scholar]
  • 14.Jackson JJ, Kropp H. 1996. Differences in mode of action of beta-lactam antibiotics influence morphology, LPS release and in vivo antibiotic efficacy. J Endotoxin Res 3:201–218. doi: 10.1177/096805199600300306. [DOI] [Google Scholar]
  • 15.Prins JM, van Deventer SJ, Kuijper EJ, Speelman P. 1994. Clinical relevance of antibiotic-induced endotoxin release. Antimicrob Agents Chemother 38:1211–1218. doi: 10.1128/aac.38.6.1211. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Holtje JV. 1998. Growth of the stress-bearing and shape-maintaining murein sacculus of Escherichia coli. Microbiol Mol Biol Rev 62:181–203. doi: 10.1128/MMBR.62.1.181-203.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Kocaoglu O, Carlson EE. 2015. Profiling of beta-lactam selectivity for penicillin-binding proteins in Escherichia coli strain DC2. Antimicrob Agents Chemother 59:2785–2790. doi: 10.1128/AAC.04552-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Curtis NA, Orr D, Ross GW, Boulton MG. 1979. Competition of beta-lactam antibiotics for the penicillin-binding proteins of Pseudomonas aeruginosa, Enterobacter cloacae, Klebsiella aerogenes, Proteus rettgeri, and Escherichia coli: comparison with antibacterial activity and effects upon bacterial morphology. Antimicrob Agents Chemother 16:325–328. doi: 10.1128/aac.16.3.325. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Fontana R, Cornaglia G, Ligozzi M, Mazzariol A. 2000. The final goal: penicillin-binding proteins and the target of cephalosporins. Clin Microbiol Infect 6(Suppl 3):34–40. doi: 10.1111/j.1469-0691.2000.tb02038.x. [DOI] [PubMed] [Google Scholar]
  • 20.Breilh D, Texier-Maugein J, Allaouchiche B, Saux MC, Boselli E. 2013. Carbapenems. J Chemother 25:1–17. doi: 10.1179/1973947812Y.0000000032. [DOI] [PubMed] [Google Scholar]
  • 21.Buijs J, Dofferhoff AS, Mouton JW, Wagenvoort JH, van der Meer JW. 2008. Concentration-dependency of beta-lactam-induced filament formation in Gram-negative bacteria. Clin Microbiol Infect 14:344–349. doi: 10.1111/j.1469-0691.2007.01940.x. [DOI] [PubMed] [Google Scholar]
  • 22.Nielsen EI, Friberg LE. 2013. Pharmacokinetic-pharmacodynamic modeling of antibacterial drugs. Pharmacol Rev 65:1053–1090. doi: 10.1124/pr.111.005769. [DOI] [PubMed] [Google Scholar]
  • 23.Nielsen EI, Viberg A, Lowdin E, Cars O, Karlsson MO, Sandstrom M. 2007. Semimechanistic pharmacokinetic/pharmacodynamic model for assessment of activity of antibacterial agents from time-kill curve experiments. Antimicrob Agents Chemother 51:128–136. doi: 10.1128/AAC.00604-06. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Goscinski G, Tano E, Lowdin E, Sjolin J. 2007. Propensity to release endotoxin after two repeated doses of cefuroxime in an in vitro kinetic model: higher release after the second dose. J Antimicrob Chemother 60:328–333. doi: 10.1093/jac/dkm190. [DOI] [PubMed] [Google Scholar]
  • 25.Hanberger H, Skoog G, Ternhag A, Giske CG. 2014. Antibiotic consumption and antibiotic stewardship in Swedish hospitals. Ups J Med Sci 119:154–161. doi: 10.3109/03009734.2014.909911. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Khan DD, Lagerback P, Cao S, Lustig U, Nielsen EI, Cars O, Hughes D, Andersson DI, Friberg LE. 2015. A mechanism-based pharmacokinetic/pharmacodynamic model allows prediction of antibiotic killing from MIC values for WT and mutants. J Antimicrob Chemother 70:3051–3060. doi: 10.1093/jac/dkv233. [DOI] [PubMed] [Google Scholar]
  • 27.Drusano GL. 2004. Antimicrobial pharmacodynamics: critical interactions of ‘bug and drug’. Nat Rev Microbiol 2:289–300. doi: 10.1038/nrmicro862. [DOI] [PubMed] [Google Scholar]
  • 28.Keren I, Kaldalu N, Spoering A, Wang Y, Lewis K. 2004. Persister cells and tolerance to antimicrobials. FEMS Microbiol Lett 230:13–18. doi: 10.1016/S0378-1097(03)00856-5. [DOI] [PubMed] [Google Scholar]
  • 29.Lowdin E, Odenholt I, Bengtsson S, Cars O. 1996. Pharmacodynamic effects of sub-MICs of benzylpenicillin against Streptococcus pyogenes in a newly developed in vitro kinetic model. Antimicrob Agents Chemother 40:2478–2482. doi: 10.1128/AAC.40.11.2478. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Carlsson KC, Savic RM, Hooker AC, Karlsson MO. 2009. Modeling subpopulations with the $MIXTURE subroutine in NONMEM: finding the individual probability of belonging to a subpopulation for the use in model analysis and improved decision making. AAPS J 11:148–154. doi: 10.1208/s12248-009-9093-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Arshad U, Chasseloup E, Nordgren R, Karlsson MO. 2019. Development of visual predictive checks accounting for multimodal parameter distributions in mixture models. J Pharmacokinet Pharmacodyn 46:241–250. doi: 10.1007/s10928-019-09632-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Miyamoto T, Okano S, Kasai N. 2009. Inactivation of Escherichia coli endotoxin by soft hydrothermal processing. Appl Environ Microbiol 75:5058–5063. doi: 10.1128/AEM.00122-09. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Dofferhoff AS, Nijland JH, de Vries-Hospers HG, Mulder PO, Weits J, Bom VJ. 1991. Effects of different types and combinations of antimicrobial agents on endotoxin release from gram-negative bacteria: an in-vitro and in-vivo study. Scand J Infect Dis 23:745–754. doi: 10.3109/00365549109024303. [DOI] [PubMed] [Google Scholar]
  • 34.Mattsby-Baltzer I, Lindgren K, Lindholm B, Edebo L. 1991. Endotoxin shedding by enterobacteria: free and cell-bound endotoxin differ in Limulus activity. Infect Immun 59:689–695. doi: 10.1128/IAI.59.2.689-695.1991. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.van Langevelde P, Kwappenberg KM, Groeneveld PH, Mattie H, van Dissel JT. 1998. Antibiotic-induced lipopolysaccharide (LPS) release from Salmonella typhi: delay between killing by ceftazidime and imipenem and release of LPS. Antimicrob Agents Chemother 42:739–743. doi: 10.1128/AAC.42.4.739. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Hurley JC. 1992. Antibiotic-induced release of endotoxin: a reappraisal. Clin Infect Dis 15:840–854. doi: 10.1093/clind/15.5.840. [DOI] [PubMed] [Google Scholar]
  • 37.Goscinski G, Lundholm M, Odenholt I, Sjölin J. 2003. Variation in the propensity to release endotoxin after cefuroxime exposure in different Gram-negative bacteria: uniform and dose-dependent reduction by the addition of tobramycin. Scand J Infect Dis 35:40–46. doi: 10.1080/0036554021000026983. [DOI] [PubMed] [Google Scholar]
  • 38.Nielsen EI, Khan DD, Cao S, Lustig U, Hughes D, Andersson DI, Friberg LE. 2017. Can a pharmacokinetic/pharmacodynamic (PKPD) model be predictive across bacterial densities and strains? External evaluation of a PKPD model describing longitudinal in vitro data. J Antimicrob Chemother 72:3108–3116. doi: 10.1093/jac/dkx269. [DOI] [PubMed] [Google Scholar]
  • 39.Morrison DC, Bucklin SE, Leeson MC, Norimatsu M. 1996. Contribution of soluble endotoxin released from Gram-negative bacteria by antibiotics to the pathogenesis of experimental sepsis in mice. J Endotoxin Res 3:237–243. doi: 10.1177/096805199600300309. [DOI] [Google Scholar]
  • 40.Munford RS. 2016. Endotoxemia—menace, marker, or mistake? J Leukoc Biol 100:687–698. doi: 10.1189/jlb.3RU0316-151R. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Hurley JC, Nowak P, Ohrmalm L, Gogos C, Armaganidis A, Giamarellos-Bourboulis EJ. 2015. Endotoxemia as a diagnostic tool for patients with suspected bacteremia caused by Gram-negative organisms: a meta-analysis of 4 decades of studies. J Clin Microbiol 53:1183–1191. doi: 10.1128/JCM.03531-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Matsuda T, Freeman TA, Hilbert DW, Duff M, Fuortes M, Stapleton PP, Daly JM. 2005. Lysis-deficient bacteriophage therapy decreases endotoxin and inflammatory mediator release and improves survival in a murine peritonitis model. Surgery 137:639–646. doi: 10.1016/j.surg.2005.02.012. [DOI] [PubMed] [Google Scholar]
  • 43.Dufour N, Delattre R, Ricard JD, Debarbieux L. 2017. The lysis of pathogenic Escherichia coli by bacteriophages releases less endotoxin than by beta-lactams. Clin Infect Dis 64:1582–1588. doi: 10.1093/cid/cix184. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Asín-Prieto E, Soraluce A, Trocóniz IF, Campo Cimarras E, Sáenz de Ugarte Sobrón J, Rodríguez-Gascón A, Isla A. 2015. Population pharmacokinetic models for cefuroxime and metronidazole used in combination as prophylactic agents in colorectal surgery: model-based evaluation of standard dosing regimens. Int J Antimicrob Agents 45:504–511. doi: 10.1016/j.ijantimicag.2015.01.008. [DOI] [PubMed] [Google Scholar]
  • 45.Lindsay GK, Roslansky PF, Novitsky TJ. 1989. Single-step, chromogenic Limulus amebocyte lysate assay for endotoxin. J Clin Microbiol 27:947–951. doi: 10.1128/JCM.27.5.947-951.1989. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Beal SL, Sheiner LB, Boeckmann AJ, Bauer RJ (ed). 2018. NONMEM 7.4.3 users guides (1989–2018). Icon Development Solutions, Hanover, MD. [Google Scholar]
  • 47.Beal SL. 2001. Ways to fit a PK model with some data below the quantification limit. J Pharmacokinet Pharmacodyn 28:481–504. doi: 10.1023/a:1012299115260. [DOI] [PubMed] [Google Scholar]
  • 48.Bergstrand M, Hooker AC, Wallin JE, Karlsson MO. 2011. Prediction-corrected visual predictive checks for diagnosing nonlinear mixed-effects models. AAPS J 13:143–151. doi: 10.1208/s12248-011-9255-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.König C, Simmen HP, Blaser J. 1998. Bacterial concentrations in pus and infected peritoneal fluid—implications for bactericidal activity of antibiotics. J Antimicrob Chemother 42:227–232. doi: 10.1093/jac/42.2.227. [DOI] [PubMed] [Google Scholar]
  • 50.Gonzalez D, Schmidt S, Derendorf H. 2013. Importance of relating efficacy measures to unbound drug concentrations for anti-infective agents. Clin Microbiol Rev 26:274–288. doi: 10.1128/CMR.00092-12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Flynn Pharma Ltd. 2018. Cefuroxime sodium for injection 750mg. Flynn Pharma Ltd, Dublin, Ireland: https://www.medicines.org.uk/emc/product/149/smpc. Accessed 14 August 2019. [Google Scholar]

Articles from Antimicrobial Agents and Chemotherapy are provided here courtesy of American Society for Microbiology (ASM)

RESOURCES