Abstract
Simulation of combination therapies is challenging due to computational complexity. Either a simple model is used to simulate the response for many combinations of concentration to generate a response surface but parameter variability and uncertainty are neglected and the concentrations are constant—the link to the doses to be administered is difficult to make—or a population pharmacokinetic/pharmacodynamic model is used to predict the response to combination therapy in a clinical trial taking into account the time‐varying concentration profile, interindividual variability (IIV), and parameter uncertainty but simulations are limited to only a few selected doses. We devised new algorithms to efficiently search for the combination doses that achieve a predefined efficacy target while taking into account the IIV and parameter uncertainty. The result of this method is a response surface of confidence levels, indicating for all dose combinations the likelihood of reaching the specified efficacy target. We highlight the importance to simulate across a population rather than focus on an individual. Finally, we provide examples of potential applications, such as informing experimental design.
Study Highlights.
WHAT IS THE CURRENT KNOWLEDGE ON THE TOPIC?
Population simulation of PKPD models and response surface analysis currently co‐exist as distinct methods for model‐based combination therapy assessment. Each method is tailored to address specific questions but neglects important aspects of the other method.
WHAT QUESTION DID THIS STUDY ADDRESS?
The two challenges of applying population simulation and response surface analysis jointly are: How to informatively summarize the output of population simulation such that it can be interpreted in a response surface, and how to perform the computations efficiently?
WHAT DOES THIS STUDY ADD TO OUR KNOWLEDGE?
Population simulation results can be informatively summarized by the confidence level to reach a prespecified efficacy target. We propose two algorithms to compute confidence level response surfaces with a fraction of the computing time required by brute force.
HOW MIGHT THIS CHANGE DRUG DISCOVERY, DEVELOPMENT, AND/OR THERAPEUTICS?
We provide a general framework of how to incorporate variability and parameter uncertainty into response surface analysis and show how response surface analysis has an application in a clinical context.
INTRODUCTION
Combination therapies of two or more partner drugs are the standard in many indications, such as malaria, 1 bacterial infections, 2 , 3 or cancer. 4 , 5 Different benefits arise from the use of combinations. For example, the emergence of resistance is slowed down or existing resistances are overcome by tackling the disease on independent mechanisms of action 6 , 7 or the joint effect may be reaching the therapeutic target at overall lower doses, reducing treatment cost and toxicity. Population pharmacokinetic/pharmacodynamic (PK/PD) models of combination therapies are an emerging field. Applications range from semimechanistic drug‐drug interaction modeling 3 , 8 , 9 to dose optimization. 10 , 11 , 12 Especially the latter application, as well as model‐based prediction of clinical trial results, rely on model simulations which are impeded by the combinatorial complexity of combination therapies.
The two main approaches for simulation‐based combination therapy assessment are: (1) response surface and isobolographic analysis, 13 , 14 and (2) population simulation, 15 both suffering from shortcomings. For the former, response surfaces and isoboles are useful tools to establish a comprehensive overview of the treatment and to explore drug‐drug interactions. However, they usually are evaluated for concentration‐response rather than dose‐response relationships, 4 , 9 , 16 neglecting effects governed by PKs and PDs. Furthermore, they are calculated only for a unique set of parameters, neglecting both interindividual variability (IIV) and parameter uncertainty. This hampers their application in the clinical setting. The second method, population simulation using nonlinear mixed effects (NLMEs) PK/PD models, accounts for PKs and PDs and allows the calculation of clinical efficacy end points, including their confidence intervals. However, it is often performed only for relatively few doses. 3 , 8 , 16 , 17 Global trends and dosing opportunities might thus be overlooked.
We propose fast new algorithms based on both population simulation and response surface analysis to fully characterize the dose‐response of combination therapies taking into account PKs, PDs, parameter uncertainty, and IIV. By focusing on a predefined efficacy target, like responder rate of 95%, the number of simulations can be reduced down to 10% of a brute force approach. The output is a confidence level response surface and confidence level isoboles which show all the minimum combination doses that achieve the target of interest, here, 95% responder rate, at any given confidence level, for instance, at a confidence level of 80%. We apply the methodology to malaria and antibiotics research as examples and discuss how these simulations can inform further the drug‐development process.
METHODS
Including parameter uncertainty in a response surface analysis has to overcome two main challenges which are highlighted in the top row of Figure 1. First, to summarize the variability of the predicted efficacy end point due to IIV and parameter uncertainty into an output which is easy to interpret and can be visualized as heatmap. Second, to keep the computing time reasonable.
FIGURE 1.

Overview of methods. (a) Success rate distributions resulting from parameter uncertainty, simulated at different doses. The efficacy target, a success rate of 90%, is highlighted as the red horizontal line. Shaded green areas of violin plots correspond to the fraction of populations meeting the efficacy target criterion. (b) Confidence level of reaching the efficacy target at a given dose. The confidence level corresponds to the green shaded areas in panel a. The confidence level is known exactly at only seven doses. (c) The dose‐success rate relationship for one population is shown as the dashed black line. The effective dose (dashed green line) indicates where success rates achieve the efficacy target (red horizontal line). Circles denote the iterations of a binary search algorithm which, in this case, finds the effective dose within five iterations, amounting to seven function evaluations. (d) The effective dose allows to classify any dose into non‐efficacious (red area) or efficacious (green area) via a simple “less than” operation. (e) Distribution of effective doses resulting from parameter uncertainty. (f) Confidence levels as cumulative distribution function of effective doses. The confidence level is known exactly at a much higher resolution but the computations took as many function evaluations as in panel b. (g) Newly developed algorithm “fastIsoboles,” which extends one‐dimensional binary search to finding arbitrary curves in two dimensions. The effective isobole (i.e., all dose combinations achieving the efficacy target), is shown as the green curve. (h) Classification of dose combinations into efficacious or nonefficacious solely based on the information contained in the effective isobole. (i) Distribution of effective isoboles resulting from parameter uncertainty. (j) Confidence level response surface resulting from aggregating the distribution of effective isoboles with the “aggregateIsoboles” algorithm. The highly resolved confidence level response surface was obtained at a fraction of the computational cost of the brute force approach
The first issue is solved by introducing an efficacy target (e.g., reaching 90% treatment success rate, as sketched in Figure 1a,b), where success rate distributions resulting from parameter uncertainty are compared to the efficacy target at different doses. The likelihood of achieving the efficacy target (i.e., the confidence level), can be obtained from the quantiles of the simulated distributions. The confidence level as model output is informative in terms of efficacy as well as parameter uncertainty. For combination therapies, the confidence level response surface could be obtained in a brute‐force manner from simulations at different dose combinations.
The second issue of computational cost is addressed by efficient algorithms. The idea of the procedure is outlined by example of monotherapy in Figure 1c–f and generalized to combination therapy in Figure 1g–j. For each realization of parameters from the uncertainty distribution, the effective dose reaching the efficacy target can be found by line search algorithms, such as bisection 18 (Figure 1c), as long as the dose‐response curve is monotonously increasing. The effective dose separates the dosing space into efficacious and nonefficacious regions (Figure 1d): checking whether a dose is greater than the effective dose fully informs about clinical success. Due to parameter uncertainty, the effective dose itself follows a distribution, exemplified in Figure 1e. The confidence level is then readily derived from the cumulative distribution function of effective doses. The resolution of the dose‐confidence level relationship in Figure 1f is far greater than in Figure 1b, but was achieved with similar computational effort.
The method of effective doses is generalized to combination therapy with newly developed algorithms. The effective dose itself is replaced by the effective isobole (i.e., the curve connecting all doses achieving the efficacy target, shown in Figure 1g as the green curve). The fastIsoboles algorithm, described below, replaces the bisection method. The monotonicity assumption is generalized by requiring that for each efficacy level, all corresponding dose combinations are connected by a single isobole curve. The effective isobole therefore separates the dosing space into nonefficacious and efficacious dose combinations, highlighted in Figure 1h. Parameter uncertainty implies a distribution of effective isoboles, which is shown in Figure 1i, and the resulting confidence level response surface from the generalization of the cumulative distribution function is shown in Figure 1j. This step is performed by the second new algorithm, aggregateIsoboles, by assessing the fraction of populations for which a dose combination is “above” the respective effective isobole.
Both the brute force and the effective isoboles approach require an NLME PK/PD model to compute success rates and their confidence intervals via population simulation. In this work, we assume model parameters were estimated via maximum likelihood estimation and refer to the asymptotic distribution of estimators as parameter uncertainty distribution, quantifying how well parameters are identified. Due to the mixture of parameter uncertainty and IIV, population simulation involves a two‐step Monte‐Carlo sampling process. 19 Precise mathematical formulations are detailed in the Supplementary Information Text S1. First, a set of population parameters is drawn from the parameter uncertainty distribution. This set of parameters defines the realization of a population and parametrizes a multivariate distribution of individual parameters. In the next step, N sup j , parameter sets of individual subjects are sampled conditioned on the population parameter realization. This two‐step parameter sampling procedure is repeated for a number of populations, N pop, generating the population ensemble, the highest level in the hierarchical sampling process. The relevant model outputs for individuals are the PD outputs deciding over treatment success or failure. For a population, the relevant output is the success rate, denoting the fraction of individuals with successful treatment and for the population ensemble, the relevant output in this work is the confidence level of reaching the efficacy target.
fastIsoboles algorithm
The fastIsoboles algorithm indicated in Figure 1g is used to efficiently compute the effective isobole of each population. It is a generalization of the bisection method 18 to two dimensions and is depicted in Figure 2. In contrast to usual optimization or root‐finding algorithms, which converge toward one point in the explored space, this algorithm converges to a whole curve, the effective isobole. The input requirements are the objective function for calculating the success rate y = f (AMT1 and AMT2), where AMTi denotes the dose of drug , the efficacy target and the boundaries of the dosing space to be searched. In the example shown in Figure 2, the efficacy target is success rate and maximal doses are set to AMT1 max = 1000 mg and AMT2 max = 1000 mg. The following steps outline the algorithm, a more detailed and mathematically precise description is available in Text S1.
The algorithm is initialized by evaluating the success rate at the nine regularly interspaced grid points covering the whole dosing space shown in Figure 2a as colored tiles.
The effective isobole is estimated from all evaluated doses by two‐dimensional linear interpolation via the R‐routine contourLines. 20 In Figure 2a, the isobole estimate of the first iteration is depicted as the black line.
The grid resolution is doubled, introducing potential new dose combinations to be evaluated shown as crosses in Figure 2a. However, the success rate is only evaluated at a dose combination if the distance between the current estimate of the isobole path and the grid point is smaller than the current grid resolution, saving simulation at uninformative doses. The green ribbon encloses all points evaluated in the next iteration. Figure 2b shows the intermediate result at iteration 2.
Repeat steps 2 and 3 until convergence or a predefined maximum number of iterations have been reached. Figure 2c shows the result at iteration 6.
FIGURE 2.

The fastIsoboles algorithm. (a) The algorithm is initialized at nine evenly spaced doses where the objective function is evaluated. The black curve represents the current approximation of the effective isobole of the 95% success rate efficacy target via 2D‐linear interpolation. Dose combinations to be evaluated in the next iteration are indicated by the crosses enclosed by the ribbon. (b) The algorithm at iteration two, with the updated dose combinations and updated approximation of the isobole. (c) The terminated algorithm at iteration six with highly resolved isobole
The number of evaluated doses grows exponentially with iteration number. Therefore, only a low number of iterations less than seven is feasible in practice. Seven iterations correspond to a resolution of doses per drug, which will be sufficient in most cases. For the realistic case examples we tested, convergence with respect to the Fréchet distance 21 , 22 is demonstrated in Text S1 meaning that the maximum distance of any point on the estimated isobole from the true isobole is given by at iteration number . Therefore, proximity to the true isobole is guaranteed along the whole estimated isobole by the Fréchet distance metric. As bisection which converges to exactly one root in the interval, fastIsoboles converges to one isobole only, therefore is only applicable to “monotonous” surfaces with one contour line per effect level. An extended discussion of convergence, computational complexity, and limitations is given in Text S1.
aggregateIsoboles algorithm
The effective isobole divides the dosing space into two distinct regions indicated in Figure 1h: in the region enclosed by the isobole and the mono‐dose axes, the success rate is below the efficacy target, whereas in the outside region, the success rate is at least the efficacy target. Figure 3 shows how the confidence level response surface is recovered from the distribution of effective isoboles. The steps of the procedure are as follows:
Computationally, the effective isobole is represented as an ordered list of points through which it passes. Augmenting this list with the origin of the dosing space yields a polygon enclosing the region in which the efficacy target is not reached, indicated in Figure 3a.
For each point of a finely resolved grid, use a fast dedicated algorithm 23 , 24 to determine whether the respective dose combination lies outside or within this polygon (i.e., reaches the efficacy target or not). Encode the respective regions with 0 (efficacy target not reached) or 1 (efficacy target achieved or exceeded). In Figure 3b, treatment failure is colored red and success is color coded as green. The recommended resolution of the sampling grid is twice the final resolution of the fastIsoboles algorithm.
Repeat steps 1 and 2 for all populations of the population ensemble and average the treatment successes for each grid point. The fraction of populations achieving the efficacy target corresponds to the confidence level of achieving the efficacy target.
From the confidence level response surface, isoboles corresponding to different confidence levels can readily be obtained via linear interpolation. The response surface and an exemplary confidence level isobole is visualized in Figure 3c.
FIGURE 3.

Confidence level response surface. (a) For each population, the effective isobole (EI; black curve) and the segments from the origin up to the intersect of the axes with the isobole (grey) are connected to form a polygon enclosing the dose combinations at which the treatment goal was not achieved. (b) Translation into binary values across all dose combinations. All dose combinations enclosed by the isobole and coordinate axes are shown in red and are coded as zero (for failure: efficacy target is not achieved), all other dose combinations are colored in green and are coded as one (for success: efficacy target is achieved or exceeded). (c) Averaging the binary values from the previous step over all populations for each dose combination results in the confidence level response surface. The 95% confidence level isobole is indicated as black curve
In summary, naively extending the methodology of population simulation to combination therapies requires aggregation of simulation results and is impeded by combinatorial complexity. By pre‐specifying an efficacy target, simulations can be summarized by the confidence level of reaching the efficacy target. Simulations can be focused on the most informative dose combinations close to the effective isobole to reduce the computational cost to obtain the full confidence level response surface with a fraction of the simulations compared to the brute‐force approach.
RESULTS
Malaria model
Description of the PK/PD model and simulations
A current goal in malaria research is the development of novel combination therapies ideally reducing the current 3‐day therapies to a single dose. Administration schemes with single doses rather than the current schemes with repeated doses improve patient compliance and in return are expected to slow down the emergence of resistance due to treatment failures cause by early abandonment of treatment. 25 , 26 , 27 The efficacy target is a cure rate of at least 95% across the population. 27
An example is shown for malaria where the population PK/PD model is parameterized based on a combination of preclinical and clinical data, and is described in detail including model equations in Text S2. Briefly, plasma concentrations of either drug are described by a two‐compartmental linear elimination model. The parasite population is growing exponentially and killed with a rate depending on the drug concentration with a sigmoidal relationship. Treatment is successful if the parasite concentration in blood is below the limit of quantification of 10 parasites/ml at day 28 after treatment. PD drug‐drug interaction is modeled as empirical Bliss independence model modified to account for different maximal effect sizes, as described by Wicha et al. 8 For the purpose of this publication, artificial but realistic parameter and covariate values are used. Both drugs’ hypothetical maximum feasible doses are limited to 800 mg.
We computed the PD profiles over 28 days after drug administration for 750 populations, each including 1500 subjects; deduced for each individual if treatment was successful or not at day 28 and computed the effective isobole corresponding to the efficacy target of 95% success rate for each of the 750 populations with the fastIsoboles algorithm using six iterations and calculated the confidence level response surface using aggregateIsoboles. For illustration, we simulated one population on the full dose grid to compare the cure isobole of individual patients to the success rate isobole of one population in Figure 4.
FIGURE 4.

Malaria 1. Individual and population responses of the malaria model. (a) Response surface for one individual and its corresponding isobole (black line). In this case, success corresponds to cure. The black isobole divides the dosing space into unsuccessful and successful doses. At low levels of compound one, the isobole is concave: an increase of compound one dose only slightly decreases the required dose of compound two. (b) All individual cure isoboles for one population: interindividual variability leads to different individual cure isoboles each separating the dosing space into unsuccessful and successful regions differently. In color, are two different patient phenotypes in terms of drug sensitivity to either of the drugs. The blue subject responds well to drug one but poorly to drug two, the red subject vice versa. (c) Success rate response surface for one population and effective isobole (black line) at the target efficacy of 95% success rate. The effective isobole shows all dose combinations that achieve a 95% success rate in that population. The effective isobole is convex: at low doses of compound one, an increase of compound one dose reduces the required compound two dose to maintain the success rate. This beneficial property of the combination therapy is a population level effect
The difference between individual level and population level isoboles
Despite concave cure isoboles for individual subjects, the success rate isobole of a population can be convex. When starting from the effective mono‐dose of drug two indicated as the red cross in Figure 4a, adding a small amount of drug one does not significantly reduce the amount of drug two required to cure the subject. However, cure isoboles can differ quite drastically between individual subjects as a consequence of IIV. For example, patients can be strong or poor responders for either of the drugs. Examples are given in Figure 4b, where each isobole corresponds to the cure‐isobole of a subject sampled from IIV. A subject with low response to compound two is depicted in blue and a poor responder to compound one is shown in red. On the population level, both subjects push the effective isobole shown in Figure 4c outward only for their respective ineffective drug but not for the other drug. Even though adding small amounts of drug one to the effective mono‐dose of drug two does not help the red subject, on the population level there is a benefit, reducing the required dose of drug two to achieve the target success rate.
Characterizing the drug’s dose‐response under uncertainty
The confidence level response surface summarizes the influence that parameter uncertainty has on the effective isoboles for the targeted 95% success rate because they indicate the likelihood of reaching the treatment target. Sampling population parameters from their uncertainty distribution leads to different realizations effective isoboles, which are shown in Figure 5a. Using the aggregateIsoboles algorithm, these isoboles were translated into the confidence level response surface shown in Figure 5b. Two confidence level isoboles are shown in Figure 5b as well: the black curve indicates the confidence level isobole of dose combinations that have a 95% probability of reaching the target success rate of 95%, whereas the grey line visualizes the dose combinations having only a 50% chance to do so.
FIGURE 5.

Malaria 2. Effective isoboles and confidence level response surfaces of the malaria model. (a) Different effective isoboles for different realizations of population parameters from the parameter uncertainty distribution. The isoboles of 750 populations, each including 1500 subjects are shown, the efficacy target is a success rate of 95%. (b) The confidence level response surface of achieving at least 95% success rate in the population. The grey isobole corresponds to a 50% confidence level, the black isobole to 95% confidence. Cyan dashed lines indicate the (hypothetical) maximum feasible dose. Numbers indicate the locations at which the exemplary population simulations in panel (c) were performed. (c) Traditional outcome of population simulations with the distribution of success rates across the populations simulated: distributions obtained from population simulations at the doses indicated in panel b. Simulations were performed independently from the calculations of the response surface to validate the results. The circles indicate the median of the distributions, while crosses indicate the lower end of the 95% left‐open confidence interval ranging between the 5% and 100% quantiles. The confidence level response surface indicates at which quantile the target success rate is located, but does not make any other statement about the rest of the distribution of success rates
The interpretation of the confidence level response surface is tightly connected to the prespecified efficacy target. At any given dose combination, the probability of achieving the efficacy target is known, but the rest of the success rate distribution is unknown. To emphasize this, population simulations were performed with an independent population ensemble at selected points along the 50% (circles, labels 1–3) and 95% (crosses, labels 4–6) confidence level isoboles which are shown in grey and black in Figure 5b. The respective success rate distributions are shown in Figure 5c as violin plots with the 5% quantile highlighted as crosses and the median as circles. The median of the success rate distributions at dose combinations one to three lies at 95% success rate. This directly translates into a 50% probability of reaching a success rate of 95% or above, as predicted. However, it is not known that they would achieve a success rate of about 90% with a probability of 95% (crosses for combinations 1–3). Analogously, for simulation at doses four to six, it is known that they achieve the efficacy target of 95% with a probability of 95%, but probabilities for other success rate values are unknown.
The 95% confidence level isobole achieves the efficacy target with dramatically lower doses than the respective maximum feasible dose for each compound. The maximum feasible doses for compounds one and two are indicated by the cyan‐colored lines in Figure 5b and population simulation predicts 100% efficacy at the combination of these doses (dose combination 7). The dose combinations enclosed by the maximum feasible doses and the black 95% confidence level isobole represent the treatment opportunity window and can be analyzed further to optimize treatment with regard to cost, safety, and efficacy.
Antibiotics model
We now apply the methodology to combination therapies of antibiotic treatments. Two antibiotics frequently used in combination to overcome resistance in Gram‐positive methicillin‐resistant staphylococcus aureus (MRSA) bacterial infections are vancomycin 2 , 28 , 29 (VAN) and meropenem 30 , 31 (MER). The semimechanistic PD model of VAN‐MER treatment was developed and calibrated on in vitro data of clinical isolates of MRSA. 2 , 8 It features the relevant phenomena, such as the Eagle effect, 32 and the synergistic interaction between the two drugs. In their publication, the authors link this model to previously published PK models 31 , 33 in order to perform exemplary clinical trial simulation. The plasma concentrations of VAN and MER serve as direct inputs for the PD model. Simulations were performed for 500 populations, including 1000 subjects each over the time interval of 24 h at a dosing regimen of 2 × 1000 mg VAN b.i.d. and 3 × 1000 mg t.i.d. The clinical end point of interest is a 1000‐fold reduction of bacterial burden within 24 h, denoted as the bactericidal end point. All mathematical equations and details of the model are available in Text S3. The efficacy target is a success rate of 95% of patients meeting the bactericidal end point.
The two main features of the effective isoboles shown in Figure 6a are the strong synergistic effect that MER has on VAN and the large spread of the effective isoboles due to parameter uncertainty. The strong synergism becomes apparent at very low MER doses, which suffice to reduce the amount of VAN required to achieve 95% success and appears to hold for most parameter realizations. Second, the effective isoboles are distributed across the whole scanned dosing space (Figure 6a), which can also be observed in the confidence level response surface with a much broader distribution of confidence levels than in the malaria model (Figure 6b, large yellow and light blue areas). Considering the parameter uncertainty, success rates of 95% are just about achieved with high confidence at the clinically relevant dose of 1000 mg MER t.i.d. and 1000 mg VAN b.i.d. 8
FIGURE 6.

Antibiotics. Effective isoboles and confidence level response surfaces of the antibiotics model. (a) Effective isoboles for antibiotics combination therapy treatment. The target efficacy is a 95% success rate of reaching the bactericidal endpoint. The given parameter uncertainty imposes a large variation between the population realizations. (b) The confidence level response surface of achieving the efficacy target of at least 95% success rate in the population. The grey isobole corresponds to a 50% confidence level, the black isobole to 95% confidence. The two confidence levels’ isoboles are rather distant, indicating the large influence of parameter uncertainty. (c) The standard deviations of the nine most influential parameters were reduced 20‐fold after a hypothetical experiment informing those parameters. The confidence level response surface changed dramatically, allowing for lower doses to be selected with high confidence: With improved parameter estimates, the confidence level of reaching 95% success rates at a dose combination of 1000 mg MER +500 mg VAN is about 99% whereas with poor parameter estimates (panel b), the confidence level at this dose combination is only about 75%. MER, meropenem; VAN, vancomycin
In this example, the dose assessment is impeded by poorly informed parameters giving rise to the wide distribution of doses that could still meet the treatment target. The isobole simulation results can be analyzed to identify the critical parameters that need to be determined more precisely to gain less uncertain dose predictions, thus aiding experimental design. Correlating the location of the effective isoboles with their corresponding population parameters identifies which parameters influence the predictions most strongly, see Text S3 for more details. This sensitivity analysis reveals which parameters the experimental design should focus to reduce the variability of the prediction most efficiently. In Figure 6c, the standard error of the nine most influential parameters were reduced to 5% of their original value, which could be achieved by additional experimental data for parameter estimation. The spread of the confidence levels is greatly reduced and the new information would allow to confidently reduce the recommended dose amounts without the risk of underdosing.
Speed improvement
The fast algorithms allowed to calculate both confidence level response surfaces at high resolution. In comparison to the brute‐force method of simulating the population ensemble at each grid point, the total number of simulations was reduced by 21‐fold for the malaria model after six iterations and 6.7‐fold for the antibiotics model after five iterations. The relative saving compared to brute‐force depends on the shape of the effective isobole and increases with the number of iterations. More details on the speed gain and a benchmark of the algorithm’s convergence can be found in Text S1.
DISCUSSION
Connecting population PK/PD models and response surface analysis leads to new insights into the behavior of combination therapies. Isoboles and response surfaces of individuals, populations, and the population ensemble each carry different insights to understand properties of a given combination therapy. First, the individual‐level PK/PD response surface accounts both for PD interactions as well as the PK properties, which are relevant in the clinical context. As a population effect, it was shown that combinations with concave isoboles for individuals can still improve success rates because IIV allows for realizations of subjects which respond differently well. This is in line with similar findings of Palmer and Sorger in the oncologic setting. 34 Last, informed decisions need to account for the effects of parameter uncertainty on the predictions which is covered by confidence level response surfaces and isoboles.
Reporting high‐dimensional simulation results intuitively is critical in communicating with collaborators. Confidence level response surfaces and isoboles are effective visualizations displaying prediction uncertainty, which go beyond population simulation at few selected doses. They can be used to intuitively compare combinations with different partner drugs or to assess the impact of certain parameters in a simulation study, informing experimental design, as shown in the section about the antibiotics model.
By focusing on the efficacy level of interest, highly resolved confidence level response surface simulations become feasible. The combinatorial complexity requires trade‐offs between the complexity of the simulation at a given dose level and the number of dose combinations scanned. In current literature, one of the two trade‐offs is currently made. In the first case, population simulation is performed at relatively few doses. 3 , 8 , 25 , 35 The doses are typically chosen based on current therapy standards and are highly informative about the simulated doses, as confidence levels can be derived for all target success rates. In other cases, simulations scan a larger dose combination range but are only performed for few different parameter sets. 4 , 25 These simulations are useful to understand the mechanistic features of the interaction but might overlook the additional effects introduced by parameter variability from IIV and parameter uncertainty. The proposed methods add a third possibility to the tool set of combination therapy simulation, filling the gap the other two approaches left open. A shortcoming is that the algorithm only allows for fixed dosing schedules, requiring multiple runs when dosing schedule variations should be explored. Models of combination therapy are complex to explore and each simulation approach has their benefits and weaknesses. Only combining the methods of all three approaches allows for a comprehensive understanding of the model.
On the algorithmic side, the main assumption is the monotonicity of the dose‐response relationship. Just as bisection might terminate early and return no root at all for nonmonotonous problems, fastIsoboles is prone to “overlook” the effective isobole in nonmonotonous settings. Furthermore, aggregateIsoboles assumes a single isobole per population as input. Both fastIsoboles and aggregateIsoboles could be adapted to account for nonmonotonous surfaces, but we believe the presented algorithms already cover most use‐cases. Nevertheless, monotonicity of success rate response surfaces should be checked by brute‐force simulations for a few populations before running fastIsoboles for the whole population ensemble. The performance gains of the fastIsoboles algorithm varied between six and 16‐fold reduction of simulations (see Text S1), effectively cutting down simulation times from days to hours. A termination criterion improves this efficiency even more by stopping the algorithm when the isobole curve has converged, shortcutting the last and most expensive iterations. The algorithm is robust with regard to nonlinearities of the isobole, such as the kink at low MER doses in the VAN‐MER model. In some extreme cases, the algorithm might have convergence problems, as we detail in Text S1. However, these cases are likely to be of minor practical relevance. Other path‐finding algorithms which effectively follow the isobole, such as an adaption of an integration‐based profile likelihood algorithm, 36 were tested but dismissed because of inferior performance in this low‐dimensional setting. The assessment of hyperparameters, such as the population size or number of populations, can be performed by varying those numbers and testing the effective isoboles or confidence level isoboles for stationarity.
Future research could be pointed to more than two partner drugs 6 and toxicity modeling. Combination therapies with more than two drugs can only be analyzed with this method by high‐dimensional cross sections, when one dose is fixed. The methodology can readily be applied to toxicity modeling by simply replacing the dose‐response by a dose‐toxicity relationship. This way, the dose‐response surface can be optimized constrained by the dose‐toxicity response surface as described by Bottino et al. 4 allowing for a more sophisticated dose constraint than the one used in the malaria example. We hope that the versatility of the presented algorithms and concepts enable and stimulate future research in other disease areas as well.
CONCLUSION
The presented method joins the methods of population simulation and response surface analysis. On the one hand, the full complexity of the population PK/PD model is considered, including the dynamics of PKs and PDs, IIV, and parameter uncertainty. On the other hand, a general overview of the combination therapy’s behavior at different dose combinations is given by the response surface. This is made feasible by prespecifying a desired success rate, the efficacy target. The confidence level to reach the target success rate is an informative summary statistic both in terms of efficacy as well as uncertainty. The resulting confidence level response surface and its isoboles are easy to interpret clinically: The confidence level isobole defines the minimum doses that reach the target success rate at a given confidence level.
The method was illustrated with two examples for the indication of malaria and antibiotics with a target success rate based on cure. However, it can be applied to any disease indication: for example, to oncology with a target success rate based on survival or 50% tumor size reduction; or to epilepsy with a target success rate based on 50% reduction in seizure frequency. The only prerequisite is to have a model able to predict the clinical outcome from the administered dose combination.
The algorithms fastIsoboles and aggregateIsoboles resolve the trade‐off between computational complexity and dose resolution by focusing on the efficacy levels of interest and minimizing simulations for uninformative doses. The algorithms are publicly available as R‐package in SI and on https://github.com/IntiQuan/populationIsoboles.
CONFLICT OF INTEREST
The authors declared no competing interests for this work.
AUTHOR CONTRIBUTIONS
D.L., A.K., and N.G. wrote the manuscript. A.K., D.K., H.S., J.T., and D.L. designed the research. D.L. performed the research. D.L. and V.M. implemented the methods as R‐package.
Supporting information
Supplementary Material1
Supplementary Material2
Supplementary Material3
Supplementary Material4
ACKNOWLEDGMENTS
The authors would like to thank Sebastian Wicha for pointing us to the Vancomycin‐Meropenem model and for helping us with setting up the model for simulations. Furthermore, we thank Mohammed Cherkaoui for suggestions on the supplementary computer code. All computations were performed using the R statistical software 20 and notably the R‐packages data.table 37 and IQRtools. 38 Plots were created using ggplot2 39 and gridExtra. 40 This work was supported, in whole or in part, by the Bill & Melinda Gates Foundation Grant Number: INV‐007155. Open access funding enabled and organized by Projekt DEAL.
Lill D, Kümmel A, Mitov V, et al. Efficient simulation of clinical target response surfaces. CPT Pharmacometrics Syst Pharmacol. 2022;11:512‐523. doi: 10.1002/psp4.12779
Funding information
D.L. is funded by the German Federal Ministry of Education and Research grant LiSyM (BMBF 031L0048). The article processing charge was funded by the Baden‐Württemberg Ministry of Science, Research and Art and the University of Freiburg in the funding program Open Access Publishing
REFERENCES
- 1. World Health Organization . Guidelines for the Treatment of Malaria. 3rd ed. World Health Organization; 2015. ISBN 978 92 4 154912 7. [Google Scholar]
- 2. Wicha SG, Kees MG, Kuss J, Kloft C. Pharmacodynamic and response surface analysis of linezolid or vancomycin combined with meropenem against Staphylococcus aureus. Pharm Res. 2015;32(7):2410‐2418. [DOI] [PubMed] [Google Scholar]
- 3. Yadav R, Landersdorfer CB, Nation RL, Boyce JD, Bulitta JB. Novel approach to optimize synergistic carbapenem‐aminoglycoside combinations against carbapenem‐resistant Acinetobacter baumannii. Antimicrob Agents Chemother. 2015;59(4):2286‐2298. doi: 10.1128/AAC.04379-14 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Bottino DC, Patel M, Kadakia E, et al. Dose optimization for anticancer drug combinations: maximizing therapeutic index via clinical exposure‐toxicity/preclinical exposure‐efficacy modeling. Clin Cancer Res. 2019;25(22):6633‐6643. [DOI] [PubMed] [Google Scholar]
- 5. Pierrillas PB, Fouliard S, Chenel M, Hooker AC, Friberg LE, Karlsson MO. Model‐based adaptive optimal design (MBAOD) improves combination dose finding designs: an example in oncology. AAPS J. 2018;20(2):39. [DOI] [PubMed] [Google Scholar]
- 6. Krishna S. Triple artemisinin‐containing combination anti‐malarial treatments should be implemented now to delay the emergence of resistance: the case against. Malar J. 2019;18(1):339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Rukhlenko OS, Khorsand F, Krstic A, et al. Dissecting RAF inhibitor resistance by structure‐based modeling reveals ways to overcome oncogenic RAS signaling. Cell Syst. 2018;7(2):161‐179.e14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Wicha SG, Huisinga W, Kloft C. Translational pharmacometric evaluation of typical antibiotic broad‐spectrum combination therapies against Staphylococcus aureus exploiting in vitro information. CPT Pharmacomet Syst Pharmacol. 2017;6(8):512‐522. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Brill MJE, Kristoffersson AN, Zhao C, Nielsen EI, Friberg LE. Semi‐mechanistic pharmacokinetic–pharmacodynamic modelling of antibiotic drug combinations. Clin Microbiol Infect. 2018;24(7):697‐706. [DOI] [PubMed] [Google Scholar]
- 10. Wang S, Zhu X, Han M, Hao F, Lu W, Zhou T. Mechanistic pharmacokinetic/pharmacodynamic model of sunitinib and dopamine in MCF‐7/Adr xenografts: Linking cellular heterogeneity to tumour burden. AAPS J. 2020;22(2):45. [DOI] [PubMed] [Google Scholar]
- 11. Das S, Li J, Riccobene T, et al. Dose selection and validation for ceftazidime‐avibactam in adults with complicated intra‐abdominal infections, complicated urinary tract infections, and nosocomial pneumonia. Antimicrob Agents Chemother. 2019;63(4):e02187‐18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Dini S, Zaloumis SG, Price DJ, et al. Seeking an optimal dosing regimen for OZ439/DSM265 combination therapy for treating uncomplicated falciparum malaria. J Antimicrob Chemother. 2021;76(9):2325‐2334. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Greco WR, Bravo G, Parsons JC. The search for synergy: a critical review from a response surface perspective. Pharmacol Rev. 1995;47(2):331‐385. [PubMed] [Google Scholar]
- 14. Tallarida RJ. An overview of drug combination analysis with isobolograms. J Pharmacol Exp Ther. 2006;319(1):1‐7. [DOI] [PubMed] [Google Scholar]
- 15. Holford N, Ma SC, Ploeger BA. Clinical trial simulation: a review. Clin Pharmacol Ther. 2010;88(2):166‐182. [DOI] [PubMed] [Google Scholar]
- 16. Dini S, Zaloumis S, Cao P, et al. Investigating the efficacy of triple artemisinin‐based combination therapies for treating Plasmodium falciparum malaria patients using mathematical modeling. Antimicrob Agents Chemother. 2018;62(11):e01068‐18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Imbs D, El Cheikh R, Boyer A, et al. Revisiting bevacizumab + cytotoxics scheduling using mathematical modeling: proof of concept study in experimental non‐small cell lung carcinoma. CPT Pharmacomet Syst Pharmacol. 2018;7(1):42‐50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Burden RL, Faires JD. Numerical Analysis. Prindle, Weber & Schmidt; 1985. ISBN 978‐0‐87150‐857‐7. [Google Scholar]
- 19. Kümmel A, Bonate PL, Dingemanse J, Krause A. Confidence and prediction intervals for pharmacometric models. CPT Pharmacomet Syst Pharmacol. 2018;7(6):360‐373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. R Core Team . R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. 2020; Accessed December 7, 2021. https://www.R‐project.org/ [Google Scholar]
- 21. Fréchet MM. Sur quelques points du calcul fonctionnel. Rendiconti Circolo Mat Palermo 1884–1940. 1906;22(1):1‐72. [Google Scholar]
- 22. Genolini C, Ecochard R, Benghezal M, Driss T, Andrieu S, Subtil F. kmlShape: an efficient method to cluster longitudinal data (time‐series) according to their shapes. PLoS One. 2016;11(6):e0150738. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Pebesma EJ, Bivand RS. Classes and methods for spatial data in R. R News. 2005;5(2):9‐13. [Google Scholar]
- 24. Bivand RS, Pebesma E, Gomez‐Rubio V. Applied Spatial Data Analysis with R. 2nd ed. Springer; 2013. ISBN 978‐1‐4614‐7617‐7. [Google Scholar]
- 25. Macintyre F, Adoke Y, Tiono AB, et al. A randomised, double‐blind clinical phase II trial of the efficacy, safety, tolerability and pharmacokinetics of a single dose combination treatment with artefenomel and piperaquine in adults and children with uncomplicated Plasmodium falciparum malaria. BMC Med. 2017;15:181. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Wickham KS, Baresel PC, Marcsisin SR, et al. Single‐dose primaquine in a preclinical model of glucose‐6‐phosphate dehydrogenase deficiency: implications for use in malaria transmission‐blocking programs. Antimicrob Agents Chemother. 2016;60(10):5906‐5913. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Burrows JN, Duparc S, Gutteridge WE, et al. New developments in anti‐malarial target candidate and product profiles. Malar J. 2017;16(1):26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Abe S, Chiba K, Cirincione B, Grasela TH, Ito K, Suwa T. Population pharmacokinetic analysis of linezolid in patients with infectious disease: application to lower body weight and elderly patients. J Clin Pharmacol. 2009;49(9):1071‐1078. [DOI] [PubMed] [Google Scholar]
- 29. Oliveira MS, Machado AS, Mendes ET, et al. Pharmacokinetic and pharmacodynamic characteristics of vancomycin and meropenem in critically ill patients receiving sustained low‐efficiency dialysis. Clin Ther. 2020;42(4):625‐633. [DOI] [PubMed] [Google Scholar]
- 30. Rees VE, Yadav R, Rogers KE, et al. Meropenem combined with ciprofloxacin combats hypermutable Pseudomonas aeruginosa from respiratory infections of cystic fibrosis patients. Antimicrob Agents Chemother. 2018;62(11):e01150‐18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Li C, Kuti JL, Nightingale CH, Nicolau DP. Population pharmacokinetic analysis and dosing regimen optimization of meropenem in adult patients. J Clin Pharmacol. 2006;46(10):1171‐1178. [DOI] [PubMed] [Google Scholar]
- 32. Eagle H, Musselman AD. The rate of bactericidal action of penicillin in vitro as a function of its concentration, and its paradoxically reduced activity at high concentrations against certain organisms. J Exp Med. 1948;88(1):99‐131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Llopis‐Salvia P, Jimenez‐Torres NV. Population pharmacokinetic parameters of vancomycin in critically ill patients. J Clin Pharm Ther. 2006;31(5):447‐454. [DOI] [PubMed] [Google Scholar]
- 34. Palmer AC, Sorger PK. Combination cancer therapy can confer benefit via patient‐to‐patient variability without drug additivity or synergy. Cell. 2017;171(7):1678‐1691.e13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Zaloumis S, Humberstone A, Charman SA, et al. Assessing the utility of an anti‐malarial pharmacokinetic‐pharmacodynamic model for aiding drug clinical development. Malar J. 2012;11(1):303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Kaschek D, Mader W, Fehling‐Kaschek M, Rosenblatt M, Timmer J. Dynamic modeling, parameter estimation, and uncertainty analysis in R. J Stat Softw. 2019;88(1):1‐32. [Google Scholar]
- 37. Dowle M, Srinivasan A. data.table: Extension of ‘data.frame’. Published 2019. Accessed December 17, 2020. https://CRAN.R‐project.org/package=data.table
- 38. Kuemmel A, Guiastrennec B, Kaschek D, Lill D, Schmidt H. IQRtools: Modeling and simulation across systems pharmacology and pharmacometrics. Published 2020. Accessed October 25, 2021. https://github.com/IntiQuan/IQRtools
- 39. Wickham H. Ggplot2: Elegant Graphics for Data Analysis. Springer‐Verlag; 2016. https://ggplot2.tidyverse.org [Google Scholar]
- 40. Auguie B. gridExtra: Miscellaneous functions for “Grid” graphics. Accessed December 17, 2020. https://CRAN.R‐project.org/package=gridExtra
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplementary Material1
Supplementary Material2
Supplementary Material3
Supplementary Material4
