Skip to main content
Wiley Open Access Collection logoLink to Wiley Open Access Collection
. 2026 Sep 28;68(5):e70186. doi: 10.1002/bimj.70186

Optimal Designs for Identifying Effective Doses in Drug Combination Studies

Leonie Schürmeyer 1,✉, Ludger Sandig 1, Jorrit Kühne 1, Leonie T Hezler 2, Bernd‐Wolfgang Igl 2, Kirsten Schorning 1
PMCID: PMC13620475  PMID: 42806686

ABSTRACT

We consider the optimal design problem for identifying effective dose combinations within drug combination studies where the effect of the combination of two drugs is investigated. Drug combination studies are becoming increasingly important as they investigate potential interaction effects rather than the individual impacts of the drugs. In this situation, identifying effective dose combinations that yield a prespecified effect is of special interest. If nonlinear surface models are used to describe the dose combination–response relationship, these effective dose combinations, also called isoboles, result in specific contour lines of the fitted response model. Consequently, accurately estimating these effective dose combinations is crucial. We propose a novel design criterion that targets the precise estimation of these effective dose combinations. In particular, an optimal design minimizes the width of the confidence band of the contour lines of interest. Optimal design theory is developed for this problem, including equivalence theorems and efficiency bounds. The performance of the optimal design is illustrated in different examples modeling dose combination data by various nonlinear surface models. It is demonstrated that the proposed optimal design for identifying effective dose combinations yields a more precise estimation of the effective dose combinations than ray or factorial designs, which are commonly used in practice. This particularly holds true for a case study motivated by data from an oncological dose combination study.

1. Introduction

In various disciplines of pharmaceutical development, analyzing potential drug–drug interactions is fundamental, and drug combination studies are becoming increasingly relevant (see, e.g., Chou 2008 and Mokhtari et al. 2017 among many others). In general, the detection of positive drug–drug interactions might result in an increased efficacy, reduced adverse events, and cost reduction. For this purpose, one focus of dose combination studies is on identifying dose combinations that achieve a prespecified effect.

However, little research is available on modeling dose combination–response data and designing experiments for dose combinations in practice (Holland‐Letz and Kopp‐Schneider 2018). Often, the individual dose–response relationships of the monotherapies are known, but their combination is of particular interest, especially when the mode of action is unknown. In this situation, there are different approaches to specify the type of interaction, that is, whether there is synergism, additivity, or antagonism of the investigated drugs, which correspond to a positive interaction, no interaction, or a negative interaction, respectively (see, e.g., Loewe 1927; Bliss 1939, and Lee et al. 2007). Here, common strategies include, for example, curve‐shift analysis, isobolograms, combination indices, and universal surface response analysis (see, e.g., Zhao et al. 2010 and Foucquier and Guedj 2015). While modeling the drug–drug interaction based on the combination index or isobolograms results in a one‐dimensional linkage not capturing the response effect itself at each possible dose combination, dose–response surface modeling enables an estimation of the drug‐drug interaction across the entire design space based on the response effect. Therefore, we consider the situation in which the drug‐drug interaction is modeled by dose–response surface models. In particular, we consider two different specific approaches for response surface modeling. One is the Greco model, which is a commonly used modification of the sigmoid Emax model, often employed in one‐dimensional settings (see, e.g., for the sigmoid Emax Macdougall 2006 and Greco et al. 1995 or Liou et al. 2015 for the Greco model). The second model, proposed by, Zhou et al. (2024) uses the established one‐dimensional dose–response models in an additive manner, and includes an interaction effect resulting in specific nonlinear surface models to model the dose combination response data. In general, the two‐dimensional modeling by response surface models introduces new challenges for the design of the corresponding experiments. Similar to traditional one‐dimensional dose–response experiments, researchers are interested not only in modeling the effects across the entire design space but also in evaluating specific effective doses, which are defined as the dose combinations that achieve a predetermined target effect size. In the one‐dimensional setting, the dose that results in a specified effect level is unique, particularly if the response is strictly increasing with dose. In the two‐dimensional setting, multiple dose combinations yield a specific effect level, forming contour lines on the surface model, even if the response is strictly increasing in both doses. Therefore, a design in drug combination studies that facilitates precise estimation of these effective dose combinations leading to a prespecified effect level of interest is needed.

This paper aims to construct efficient designs for achieving a target effect size using nonlinear surface models. Although the theoretical and practical considerations of optimal designs for different kinds of classical one‐dimensional dose–response models are well established (see, e.g., Bretz et al. 2010; Dette and Schorning 2016, and Bornkamp et al. 2009), there is less research on the design of drug combination experiments. Ray designs, whose dose levels correspond to fixed proportions of the mixture of substances, are frequently used in drug combination studies (see, e.g., Straetemans et al. 2005 and Rønneberg et al. 2021). Therefore, Almohaimeed and Donev (2014) established locally D‐optimal designs for specific ray designs. Holland‐Letz and Kopp‐Schneider (2018) consider optimal experimental designs for estimating the drug combination index based on Loewe additivity. Besides, Papathanasiou et al. (2019) consider nonlinear surface models to describe the dose combination response relationship across the whole design space but mainly address the design problem by using the classical D‐optimality criterion instead of explicitly targeting the precise estimation of effective dose combinations. To address this gap, we propose a new and flexible design criterion that aims to accurately estimate effective dose combinations in drug combination studies. In particular, the design criterion can be used in combination with a broad class of (non)linear response surface models such as the Greco model or the additive sigmoid Emax model.

The paper is structured as follows. First, we introduce a definition of effective dose combinations under the assumption of a (non)linear response surface model in Section 2. Here, we also present two specific approaches of surface modeling as commonly used in drug combination studies. In Section 3, we will introduce the optimal design theory in the context of drug‐combination studies aiming to estimate the effective dose combinations accurately. More precisely, the new developed optimal design criterion minimizes the Lq‐norm of the variance of the prediction for the effect at the effective dose combinations. Note that a similar approach is proposed by Miller et al. (2007) for the one‐dimensional set‐up, but cannot be directly extended to the present situation of dose combination studies. For the present context, we will provide equivalence theorems and a lower bound for the efficiencies that can even be used if the optimal design is unknown.

In practice, the derived optimal designs should result in more precise predictions of the effective dose combinations. Therefore, Sections 4 and 5 are devoted to illustrating the advantages of the derived optimal designs in specific scenarios of dose combination studies. Based on a real case study, we will compare the performance of the derived optimal designs against established designs used in practice such as factorial and ray designs and classical established approaches from optimal design theory like the locally D‐optimal design. The considered design approaches will be compared theoretically, based on efficiencies, and practically through a simulation study. In addition to the case study, another scenario is investigated, both reflecting practical scenarios of dose combination studies with different underlying types of surface models.

Finally, we examine the robustness of the developed design approach. In drug combination studies, monotherapies are often known in advance, while the interaction effect may not be clearly defined before conducting the drug combination experiment. Therefore, we consider robust designs for various values of the interaction effect. Additionally, we investigate the capability of the resulting designs to provide precise estimates of the effective doses and assess their performance under these varying conditions.

2. Modeling Dose Combination Data

We consider the effect of the combination of two different substances, denoted by C and D, by modeling it with the nonlinear response surface model

Yij=η((ci,di),θ)+εijfori=1,…,n;j=1,…,ri, (1)

where εij are independent random variables such that εij∼N(0,σ2), σ2>0. This means that observations are taken at n different dose combinations (c1,d1),…,(cn,dn), which vary in the design space (i.e., the dose combination space) Z=XC×XD=0,cmax×0,dmax⊂R2 and ri observations are taken at each (ci,di), i=1,…,n. Let N=∑i=1nri denote the total sample size. The regression model η and the m‐dimensional parameter θ are used to describe the relationship between the response and the dose combination. We assume that the function ((c,d),θ)↦η((c,d),θ) is continuously differentiable both in (c,d) and in θ.

There are various approaches for modeling the combination of two substances differing by the choice of the regression function η. One natural choice for the regression function η includes the regression functions used to describe the dose‐specific effect of the individual substances. More precisely, let ηC(·,θC), θC∈ΘC⊂RmC, and ηD(·,θD), θD∈ΘD⊂RmD be the parts of the individual regression functions describing the dose‐specific effect of the substances C and D, respectively. Then we define the corresponding regression function for the dose combination in an additive manner including an interaction effect with

η((c,d),θ)=θ0+ηC(c,θC)+ηD(d,θD)+γηC(c,θC)ηD(d,θD), (2)

where the parameter θ=(θ0,θC,θD,γ) consists of the individual parameters θC and θD of the regression functions ηC and ηD, a joint placebo parameter θ0, and the parameter γ∈R that describes potential dose‐independent interaction effects between the two substances. Note, that due to identifiability reasons the parameters θC and θD do not contain a substance‐specific parameter for the placebo effect. The interaction effect is positive if γ>0, whereas γ<0 indicates a negative interaction. If γ=0, there is no interaction between the two substances. A drug–drug interaction may enhance the efficacy of a treatment even at lower dose ranges, which could additionally lead to a reduction in the occurrence of adverse events, for example, in oncology studies. Summarizing, for the regression function η in (2) it holds for the dimension of the parameter θ that m=2+mC+mD. In clinical and toxicological applications popular choices for the function ηC and ηD are the linear, exponential, Emax, or sigmoid Emax model, as described by Bornkamp et al. (2009) and presented in Table 1. Note that the functions depicted in Table 1 are continuously differentiable, hence also η is differentiable.

TABLE 1.

Possible choices of the one‐dimensional regression functions for ηC and ηD in the dose combination model (2). Note that the placebo parameter of the depicted regression functions from Bornkamp et al. (2009) is removed, as it is already part of the dose combination model (2).

Model Formula Parameters
Linear
f(d,θf)=δd
θf=δ
Exponential
f(d,θf)=E1(exp(dδ)−1)
θf=(E1,δ)
Emax
f(d,θf)=EmaxdED50+d
θf=(Emax,ED50)
sigmoid Emax
f(d,θf)=EmaxdhED50h+dh
θf=(Emax,ED50,h)

Another natural choice for the regression function η is included in the response surface model called Greco model. According to Greco et al. (1995) the regression function η of the Greco model is defined by

η((c,d),θ)=Emax·cED50C+dED50D+α·cED50C·dED50DγcED50C+dED50D+α·cED50C·dED50Dγ+1, (3)

where the parameter θ=(Emax,ED50C,ED50D,α,γ) consists of the individual model parameters. In detail, Emax is the maximal achievable effect, which has to be the same for both substances as well as the combined maximal effect. This is a common assumption for the Greco model but limits its practical application to the assumption of similar Emax parameters for both substances. ED50C and ED50D describe the effective doses, where substances C and D reach 50% of the maximal effect, respectively, when they are given alone. Besides, α refers to the interaction effect. A synergistic effect is observed for α>0, while α<0 indicates an infra‐additive effect. An additive interaction occurs for α=0. The steepness of the surface model is indicated by γ. The model can also be extended with an intercept by adding the placebo effect E0 to (3).

The structure of the Greco model is based on the one‐dimensional sigmoid Emax model (see Table 1) and can be seen as a modification of this. However, note the different levels at which the interaction is incorporated in the two models: In (2), the interaction combines the responses for the different substances, while in (3), the interaction happens already at the level of the concentrations. Accordingly, model (2) has two separate Emax parameters, while the Greco model (3) has only a single one. However, both models have two separate ED50 parameters. Furthermore, the Greco model also has a common slope parameter γ, while model (2) allows for differing slope parameters.

Using the model defined in (1) with a specified regression function η, we assume for asymptotic arguments that limN→∞riN=ωi∈(0,1) and collect this information in the matrix

ξ=(c1,d1)⋯(cn,dn)ω1⋯ωn.

Following Kiefer (1974), we refer to ξ as an approximate design on the design space Z. This means that the dose combinations (ci,di) define the different experimental conditions where observations are to be taken, and the weights ωi represent the relative proportion of observations at the corresponding dose combination (ci,di). If an approximate design is given and N observations can be taken, a rounding procedure proposed by Pukelsheim and Rieder (1992) is applied to obtain integers ri from the not necessarily integer valued quantities Nωi. Assume that observations are taken according to an approximate design ξ. Under certain assumptions of regularity, the distribution of θ^ is asymptotically normal (Jennrich 1969). Moreover, the distribution of the predicted effect at a specific dose combination (c0,d0) is also asymptotically normal, with

Nη(c0,d0),θ^−η(c0,d0),θ→DN0,φ(c0,d0),ξ,θ.

Here, →D denotes convergence in distribution and the function φ is defined by

φ(c0,d0),ξ,θ=∂∂θη(c0,d0),θT×M−(ξ,θ)∂∂θη(c0,d0),θ, (4)
whereM(ξ,θ)=∫Z∂∂θη((c,d),θ)∂∂θη((c,d),θ)Tdξ((c,d)) (5)

is the information matrix corresponding to the design ξ, and ∂∂θη((c,d),θ) is the gradient of η with respect to the parameter θ∈Rm. The matrix M−(ξ,θ) is the generalized inverse of the information matrix, whereby the design ξ has to satisfy ∂∂θη((c0,d0),θ)∈range(M(ξ,θ)).

Therefore, the asymptotic variance of the prediction η((c0,d0),θ^) at a prespecified dose combination is given by φ((c0,d0),ξ,θ). The asymptotic behavior in (4) can be used to construct an asymptotic confidence interval for the prediction of the effect at the dose combination (c0,d0). More precisely, the confidence interval for the level (1−α) is given by

η(c0,d0),θ^±z1−α/2σ^Nφ1/2(c0,d0),θ^, (6)

where σ^ and θ^ denote the maximum likelihood estimates of the parameters σ and θ, z1−α/2 denotes the (1−α/2)‐quantile of the standard normal distribution, and the function φ is given in (4).

2.1. Effective Doses in Dose Combination Studies

In classical dose–response experiments where the effect of one substance is investigated, special interest lies on effective doses (ED) that result in a certain percentage of the maximal effect. In particular, following Bretz et al. (2010), the EDp‐dose at which p% (0<p<100) of the maximal effect is achieved is defined by

EDp=minx∈(a,b]|h(x,θ)h(b,θ)=p100, (7)

where h(x,θ)=f(x,θ)−f(0,θ) and f(x,θ) is the considered regression function, which depends on both the dose x and the unknown parameter θ. Note that using the definition in (7) results in a unique EDp. If the regression function f(x,θ) is additionally strictly increasing, the effect level p is attained at exactly one dose.

However, in the two‐dimensional setting of dose combination studies, there is no unique EDp‐dose combination, even if the regression function η((c,d),θ) is strictly increasing in both doses c and d. Instead, several different dose combinations (c,d)∈Z yield the same effect, resulting in contour lines on the surface model. Extending the one‐dimensional definition of the EDp in (7), the set of multivariate effective doses for achieving p% (0<p<100) of the maximum effect in the considered design range Z=0,cmax×0,dmax can be defined by

MEDp(θ)={(c,d)∈Z|η((c,d),θ)−min(c0,d0)∈Zη((c0,d0),θ)Rmax=p100}, (8)

where the Rmax denotes the maximal effect of the response in the design space and is given by

Rmax=max(c,d)∈Zη((c,d),θ)−min(c,d)∈Zη((c,d),θ).

Note that the MEDp(θ) defined in (8) depends on the parameter θ. For the sake of brevity, we denote the multivariate effective doses for p % of the maximal effect with MEDp. Note that throughout the paper the MED always refers to the multivariate effective dose not to be confused with the minimum effective dose, which is often used in other literature.

Example 1

Consider the situation where dose combinations of the substances C and D that achieve p1=80% and p2=90% of the maximal effect are of interest in a dose combination study. Further, assume that the dose combination response relationship can be described by an additive interaction model (2), where the individual regression functions are given by Emax models with parameter θC=(80,3) and θD=(120,10), respectively. The interaction effect is given by γ=0.02. The corresponding combination response surface model is shown in Figure 1a. The dose combinations that result in 80% and 90% of the maximal effect, thus the sets MED80 and MED90, are marked by the red and blue (contour) line, respectively (Figure 1b).

FIGURE 1.

FIGURE 1

Response surface and multivariate effective doses for the model from Example 1.

3. Optimal Design Theory for Identifying Sets of Effective Doses in Drug Combination Studies

Dose combination studies aim to identify the dose combinations (c,d)∈MEDp for prespecified values for p%. Using (6) the pointwise confidence band of the prediction of effects at the dose combinations contained in the MEDp is given by

η((c,d),θ^)±z1−α/2σ^Nφ1/2((c,d),ξ,θ^)|(c,d)∈MEDp, (9)

where the asymptotic variance function φ((c,d),ξ,θ^) is defined in (4). The smaller the width of this confidence band is, the more precise the prediction of the effect at dose combinations (c,d) contained in MEDp becomes. A precise prediction of the effect at those dose combinations, in turn, leads to a precise identification of the corresponding MEDp. Note that, by definition, it is not possible to construct a criterion which aims at a precise estimation of the MEDs directly, as these depend on the estimated curve itself. Due to this, the precision of the MEDs needs to be assessed via the precision of the estimated effects at the corresponding dose combinations. Consequently, from a design perspective, a good design ξ should minimize the width of the confidence band in (9) at each dose combination (c,d)∈MEDp. This corresponds to a minimization of the asymptotic variance in (4) concerning the design ξ. Unfortunately, a simultaneous minimization is only possible in rare and probably unrealistic settings. We therefore propose a design criterion to minimize a Lq‐norm of the function φ, q∈[1,∞). More precisely, let p1,…,pk∈(0,100) be k≥1 prespecified percentages and C(θ)=⋃i=1kMEDpi≠∅ the joint set of the corresponding MED‐sets. Then, we can use the Lq‐norm

ϕMEDq(ξ,θ)=1lC(θ)∫C(θ)φq(c,d),ξ,θdμ(c,d)1q (10)

of the function φ defined in (4), where μ denotes an appropriate measure on the design space Z and lC(θ)=μ(C(θ))>0 the corresponding value of the measure μ evaluated at the set C(θ). Typical choices for the measure μ are the uniform distribution on the set C(θ) or discrete measures on the design space Z (as later chosen in the simulation study in Section 5.2). Note that the function in (10) is similar to the I‐criterion that is discussed in (Fedorov and Leonov 2013, 58).

Definition 1

Let p1,…,pk∈(0,100), k≥1, q∈[1,∞). Then a design ξ* is called locally MEDq‐optimal for the k effective dose combinations MEDp1,…,MEDpk and the parameter θ, if it satisfies ∂∂θη((c,d),θ)∈range(M(ξ*,θ)) for all (c,d)∈⋃i=1kMEDpi and if it minimizes the function ϕMEDq(ξ,θ) in (10) over the space of all approximate designs ξ on Z with ∂∂θη((c,d),θ)∈range(M(ξ,θ) for all (c,d)∈⋃i=1kMEDpi.

A central tool of optimal design theory is the equivalence theorem, which is frequently used to check the optimality of candidate designs determined numerically. Popular algorithmic approaches are versions of Fedorov's exchange algorithm (e.g., Yang et al. 2013), but also stochastic particle‐base heuristics that do not have convergence guarantees (e.g., Masoudi et al. 2019 or Chen et al. 2022). Moreover, equivalence theorems can be used to reduce the infinite‐dimensional optimization problems arising in optimal design theory to finite‐dimensional ones. Due to the convexity of the Lq‐norm, the criterion derived in (10) is convex with respect to the design ξ. Thus, we can derive the corresponding equivalence theorem (Theorem 1) that can be used to check the MEDq‐optimality of a given design ξ∗. Note that Theorem 1 consists of two parts. The first part is derived for the case where the information matrix M(ξ∗,θ) of the design ξ∗ is non‐singular. However, there might be cases where the information matrix M(ξ∗,θ) of the MEDq‐optimal design ξ∗ is singular. For instance, this situation can arise if only k=1 set of effective concentrations, denoted as MEDp, is of interest. Although such a singular design may be formally optimal in this case, it generally does not permit estimation of all parameters of the model under consideration. Therefore, only non‐singular designs are considered in the examples presented in this paper. In Section 4, the statement of the theorem is used to check the optimality of the numerically determined designs. The proof of Theorem 1 can be found in the Supporting Information.

Theorem 1

  1. Let ξ∗ be an approximate design on Z such that the corresponding information matrix M(ξ∗,θ) is non‐singular. The design ξ* is locally MEDq‐optimal if and only if the inequality
    ∫C(θ)φ((c,d),ξ*,θ)q−1α2(c0,d0),(c,d),ξ*,θdμ(c,d)−ϕMEDqq(ξ*,θ)≤0withα(c0,d0),(c,d),ξ,θ=∂∂θη((c,d),θ)TM−1(ξ,θ)∂∂θη((c0,d0),θ), (11)
    holds for all (c0,d0)∈Z. Moreover, equality is achieved in (11) for all (c,d) in the support of the design ξ∗.
  2. Let ξ∗ be an approximate design on Z such that the corresponding information matrix M(ξ∗,θ) is singular. The design ξ* is locally MEDq‐optimal if and only if there exists a generalized inverse G∈Rm×m of M(ξ*,θ) such that the inequality
    ∫C(θ)φ((c,d),ξ*,θ)q−1α2(c0,d0),(c,d),ξ*,θdμ(c,d)−ϕMEDqq(ξ*,θ)≤0withα(c0,d0),(c,d),ξ,θ=∂∂θη((c,d),θ)TGTM(ξ,θ)G∂∂θη((c0,d0),θ), (12)
    holds for all (c0,d0)∈Z. Moreover, equality is achieved in (12) for all (c,d) in the support of the design ξ∗.

Remark 2

If the L1‐norm is used in (10), the criterion, ϕMED1, simplifies to an A‐optimality criterion (see e.g., Pukelsheim 2006, 137). More precisely, ϕMED1 can be rewritten by

∫C(θ)∂∂θη((c,d),θ)TM−(ξ,θ)∂∂θη((c,d),θ)dμ(c,d)=∫C(θ)trM−(ξ,θ)∂∂θη((c,d),θ)∂∂θη((c,d),θ)Tdμ(c,d)=trM−(ξ,θ)∫C(θ)∂∂θη((c,d),θ)∂∂θη((c,d),θ)Tdμ(c,d)︸=:B=trM−(ξ,θ)B,

where the design ξ has to satisfy range(B)⊂range(M(ξ,θ)).

Remark 3

In order to investigate the quality of a (not necessarily optimal) design ξ for the purpose of identifying effective dose combinations, we consider the ϕMEDq‐efficiency

effϕMEDq(ξ):=ϕMEDq(ξ∗,θ)ϕMEDq(ξ,θ)∈(0,1]. (13)

The quantity effϕMEDq has an intuitive interpretation. Consider an experiment with N observations that will be performed according to the approximate design ξ∗. Then 1NϕMEDq(ξ∗,θ) can be interpreted as the approximate value of the mean predictive variance based on the experiment. Now, suppose ξ is a different design, for which we could take M observations instead. Both approaches will result in the same mean predictive variance if, and only if

ϕMEDq(ξ*,θ)ϕMEDq(ξ,θ)=NM.

In other words, when ξ has an efficiency of e, we would need to take a factor of 1/e more observations to obtain the same precision as under the locally MEDq‐optimal design ξ∗.

Corollary 4

For an arbitrary design ξ we have

effϕMEDq(ξ)≥1−max(c0,d0)∈ZΨξ,(c0,d0)ϕMEDq(ξ)=:elb(ξ), (14)

where Ψ(ξ,(c0,d0)) corresponds to the left‐hand side of inequality (11) if the information matrix is non‐singular, or respectively of inequality (12) in Theorem 1 for the singular case. Consequently, elb(ξ) is a lower bound for the efficiency of a design ξ in terms of Ψ. Notably, the lower bound does not depend on the optimal design ξ*.

The statement in (4) follows, for example, from rearranging eq. (2.63) in Fedorov and Leonov (2013, 67), which is applicable here because the MEDq‐criterion in (10) is convex and Theorem 1 holds.

So far, the optimality criterion for identifying an effective dose combination depends on the unknown, but true parameter θ. Thus, the corresponding locally optimal designs require a priori information about the parameter vector. In dose combination studies, preliminary knowledge regarding the individual dose–response relationships and the corresponding parameters might be available from earlier dose‐finding studies. Moreover, locally optimal designs can be applied as benchmarks for commonly used designs and can serve as starting points for constructing more robust designs with respect to model assumptions. A robust version of the ϕMEDq‐criterion can be developed following a Pseudo‐Bayesian approach (see, e.g., Pronzato and Walter 1985; Chaloner 1989 and Chaloner and Larntz 1989). More precisely, let π be a prior distribution of the unknown parameter θ∈Θ, then a design ξ* is called Bayesian MEDq‐optimal, if it minimizes the function

ψ(ξ)=∫ΘϕMEDq(ξ,θ)dπ(θ) (15)

for all possible designs ξ∈Ξ, where Ξ denotes the set of all possible approximate designs on the design space Z. For the Bayesian version of the MEDq‐criterion, analogous versions of the equivalence theorem in Theorem 1 and efficiency bounds such as in Corollary 4 can be derived.

4. Case Study

The following example consists of data obtained in the early 2020s from an oncology research department in the pharmaceutical industry. The data set is derived from 4 pooled mouse experiments of a xenograft tumor model, maintaining important parameters such as cell line, strain, and route of administration consistent across all experiments. These experiments consist of two test drugs C and D, with 3 and 4 dose levels and corresponding negative control observations within the design region Z=0,20×0,7. In addition to these data from the monotherapies, some drug combinations are used. The corresponding design, denoted as original design, is displayed in Appendix Table A1.

In general, in oncology research, test substances are examined to investigate their potential to inhibit the tumor growth and consequently, the Tumor Growth Inhibition (TGI) [%] is often used as the primary endpoint. When TVt,i,j denotes the tumor volume of animal j=1,…,ni in treatment group i=1,…,d at day t=0,…,T, then TGIt,i,j is defined as

TGIt,i,j=1−TVt,i,j−TV0,i,jmedj(TVt,0,j)−medj(TV0,0,j)·100%.

Here, t=0 refers to measurements at baseline and i=0 indicates the negative control and placebo group. Here, medj refers to the median observation of the tumor volume of all animals and must be clearly distinguished from the concept of the multivariate effective dose denoted as MED throughout the paper. A TGI value of 100% denotes a stasis with no observable tumor growth, whereas a TGI value greater than 100% signifies a reduction (regression) in the tumor volume.

In the present data set, TGI is evaluated on day 21 and normalized against the control group in each of the experiments. Subsequently, data sets were pooled to increase the sample sizes which is beneficial to maximize available prior knowledge. This approach ensured optimal utilization of the data and provided a solid foundation for planning the optimal design.

The corresponding data set was utilized to fit a dose combination model with an additive approach as defined in (2), resulting in a lower AIC than the Greco model defined in (3). To investigate which dose–response models describe the monotherapies best, the multiple comparison and modeling approach from Bretz et al. (2005) was exclusively applied to the data points representing each monotherapy in a first step. Based on the resulting test statistic, the optimal model selected for both substances was the sigmoid Emax model. Then in a second step, all data points were used to fit a model via maximum likelihood estimation for the corresponding dose combination model, where the corresponding maximum likelihood estimate was determined with θ0=19.05, Emax,C=111.10, ED50,C=5.83, hC=2.86, Emax,D=410.82, ED50,D=20.00, hD=0.78, γ=−0.0075. A visualization of the model and the corresponding data points is given in Figure 2. Please note that the interaction effect γ is slightly negative (γ=−0.0075), such that the negative interaction would be visible in the plotted response structure only for much higher dose combinations outside the design space Z. This may be attributed to the predominance of data points from the monotherapies in the case study, with only a limited number of measurements for dose combinations (c,d)∈Z, where the individual doses c,d are not the placebo doses.

FIGURE 2.

FIGURE 2

Drug combination surface model for the TGI in % for case study data with sigmoid Emax model for both substances. Additionally, the corresponding data points are displayed in orange.

5. Numerical Results

In the following sections, we compare the performance of various design approaches from both theoretical and practical perspectives. The theoretical comparison focuses on efficiencies of the different design approaches, while the practical aspect is explored through simulation studies.

We compare conventional designs, such as factorial and ray designs, against the newly derived MEDq‐optimal designs in terms of their precision in estimating effective dose combinations. For the comparison, we restrict ourselves to the L2‐norm in the criterion resulting in locally MED2‐optimal designs to which we refer as MED‐optimal designs for the sake of brevity. The considered factorial or ray designs motivated from practical aspects are visualized in the Appendix Figure A1. Moreover, we compare these designs to the corresponding locally D‐optimal designs, which are based on the most popular optimality criterion in optimal design theory. The initial comparison is based on the real case study introduced in Section 4, followed by evaluating another scenario in which we consider a different dose combination response relationship given by the Greco model.

To determine MED‐optimal designs in practice, we use the Julia package Kirstine.jl (Sandig 2024), where we implement (10) and (11) via a custom design criterion. As argued above, we limit our investigation to scenarios where (11) is applicable and the corresponding design is non‐singular, such that the resulting optimal designs always allow for the estimation of the full unknown model parameter. For the measure μ, we choose a uniform discrete distribution on a finite number of points in C(θ), which we obtain by first evaluating the response function on a grid, and then interpolating the contour lines with the marching squares algorithm (Lorensen and Cline 1987). To verify that a numerically obtained designs is (almost) optimal, we compute the efficiency lower bound (14) obtained in Corollary 4 via the maximum of Ψ over a 101×101‐point grid on Z. For all considered MED‐optimal designs, the corresponding efficiency bound is at least 0.99 (see the tabulated designs in the Appendix). The subsequent simulations and analyses were performed in R (R Core Team 2024). Our code and the computed designs can be found in Zenodo at Schürmeyer et al. (2026).

5.1. Efficiency‐Based Comparison for the Case Study Data

It is well established that the selection of dose combinations has a direct impact on the precision of estimation. However, it is crucial to investigate the extent of this influence. The quality of different designs in terms of their ability to estimate the effective dose combinations can be theoretically assessed based on their associated ϕMED‐efficiency in (13) (see Remark 3 for details). In this context, a higher ϕMED‐efficiency indicates a superior design with respect to the corresponding MED‐criterion.

In the following, the performance of the different design approaches is compared theoretically based on their corresponding ϕMED‐efficiencies for the parameter estimates of the case study data if two sigmoid Emax models are used (see Section 4 for details). In this context, a precise estimation of the effective dose combinations leading to 10% and 50% of the maximal effect in terms of TGI is of interest, to investigate the initital TGI and a bisection of the TGI in terms of the maximal effect within the design space. Furthermore, a second set of effective concentrations is of interest to define the magnitude of the maximal effect of the TGI, that is, where 20% and 80% of the maximal effect are achieved.

For the comparison, we consider the locally MED‐optimal design for the effective doses MED10 and MED50 using the parameter estimate of the case study and conventional designs as the factorial 4×4 design or the ray designs. Furthermore, we compare the designs to the corresponding locally D‐optimal design. Note that we do not consider the 3×3 factorial design in the situation of the case study, as the parameter of the considered model cannot be estimated uniquely. Moreover, the considered locally MED‐optimal designs and the D‐optimal design are illustrated in Figure 3, along with the corresponding contour lines of interest. The locally MED‐optimal design results in dose combinations with higher weights close to the contour lines of interest, whereas the D‐optimal design, by definition, aims to capture the overall response relationship.

FIGURE 3.

FIGURE 3

Visualization of the considered locally MED‐optimal designs and D‐optimal design for the case study, which includes their support points represented by dots, with their sizes corresponding to their weights.

The efficiencies of all considered designs, evaluated according to the multivariate effective dose criterion on different sets of contour lines, are presented in Table 2. By definition, the highest efficiencies across the different criteria are achieved by their corresponding optimal designs. For a precise estimation of effective doses at the 10% and 50% levels, the D‐optimal design demonstrates the next highest efficiency, followed by the locally MED‐optimal design for the 20% and 80% contour levels, and then the original design. However, all three designs exhibit efficiencies that are at most 60%, indicating an insufficient performance compared to the optimal one. Furthermore, an efficiency of at most 60% for all other designs demonstrates that theoretically more than 65% more observations are necessary for all considered designs to achieve the same precision as the locally MED(10,50)‐optimal design. The factorial design and both ray designs show very low efficiencies, demonstrating inadequate capability to estimate those contour lines and thus determine the corresponding effective concentrations accurately.

TABLE 2.

ϕMED2‐efficiencies of the considered designs for different effect levels based on the case study.

Design Levels
(10,50)
(20,80)
Ray 4/2 0.07 0.09
Ray 4/4 0.06 0.08
Factorial 4×4 0.04 0.06
Original 0.34 0.47
D‐optimal 0.6 0.8
MED (10,50) 1.00 0.19
MED (20,80) 0.52 1.00

For the MED‐criterion on 20% and 80% contour lines, similar results are obtained. Notably, the D‐optimal design exhibits an efficiency of 80%, indicating good performance in this setting. Additionally, the original design shows a higher efficiency than in the first setting, indicating a better ability to identify these contour lines. However, its efficiency remains below 50%, indicating an insufficient performance. For the original design, twice as many observations are required to achieve theoretically the same precision as the corresponding locally MED‐optimal design. The locally MED‐optimal design that aims at estimating the first set of contour lines (i.e., 10% and 50%) most precisely exhibits an efficiency below 20%, demonstrating poor performance for the second set of contour lines. This indicates that a misspecified design can perform poorly for contour lines or other settings for which it was not initially designed. Note that therefore the robustness of locally MED‐optimal designs is considered in Section 5.3. However, the commonly used factorial and ray designs perform even worse in the analysis of the case study.

5.2. Simulation Study

We perform a simulation study to compare the different design approaches for different types of interaction and different dose‐combination response relationships. In particular, we investigate how precisely the contour lines of the effective dose combinations can be estimated for the different design approaches with existing variability of the data points.

The considered parameters and designs of two scenarios are shown in Table 3. Additionally, the scenario‐specific response surface relationships are visualized in Figure 4. The individual scenarios exhibit distinct differences in their response surfaces. Scenario 1 is motivated by the case study (see Section 4) and shows no visible interaction of the two considered substances within the design space due to the slightly negative interaction effect of γ=−0.0075. Here, the contour levels of 10% and 50% can be achieved with doses from each monotherapy. Conversely, Scenario 2 demonstrates a clear positive interaction. In this scenario, the initial onset of the combined effect of both substances, resulting in the 10% contour line, is of interest. While Scenario 1 is modeled by the additive approach in (2), in Scenario 2 the Greco model in (3) is investigated.

TABLE 3.

Parameter specification of different simulation scenarios.

Scenario 1 Scenario 2
Model basis Case study Example Choice
Assumed model Additive model Greco model
(sigmoid Emax,
sigmoid Emax)
Design space
[0,20]×[0,7]
[0,1]×[0,1]
Parameter
θ0=19.05
θ0=0, Emax=1,γ=2
θC=(111.10,5.83,2.86)
EC50C=0.5
θD=(410.82,20.00,0.78)
EC50D=0.4
Interaction
γ=−0.0075
α=0.2
Contour level(s)
(10,50)
10
Error sd
σCS=24
σ=0.45
Factorial 3×3 —
✓
Factorial 4×4
✓
✓
Ray 3/2 —
✓
Ray 4/2
✓
✓
Ray 4/4
✓
—
D‐optimal
✓
✓
MED‐optimal
✓
✓
Misspecified MED‐optimal
✓
—

FIGURE 4.

FIGURE 4

Response‐surface models for the two considered scenarios with considered contour lines.

We consider different total sample sizes N∈{27,36,45,90,152} for both scenarios. For some designs, for example, the factorial 3×3 design, this leads to an equal number of observations at each dose combination for every choice of N. For all the remaining designs, an efficient rounding procedure of Pukelsheim and Rieder (1992) is used to obtain integer numbers at each dose combination. For both scenarios under consideration, s=1000 simulation iterations are performed, where the different design approaches are compared in terms of their precision.

The general structure of the simulation setup remains the same for both scenarios and consists of the following steps:

Initially, the model and parameter settings are specified for each scenario, respectively (see Table 3). In detail, this corresponds to the assumed combination model η((c,d),θt) and the parameter setting θt. For each simulation truth N new data points with normally distributed errors ε∼N(0,σ2) of the given variance σ2 are sampled at the dose combination levels of the considered design. Then, the same dose combination model is fitted to the new data points in simulation step s, resulting in the model fit η((c,d),θ^s). For this model the k effective dose combinations sets MEDpi are calculated for the scenario's levels pi, i=1,…,k. In the next step, the root mean squared error (RMSE) is calculated for all contour lines of interest via

RMSE=1k∑i=1k1li∑j=1lipi−η((cj,dj)i,θt)2with(cj,dj)i∈MEDpi(θ^s)fori=1,…,kandj=1,…,li,

where li denotes the length of the set MEDpi(θ^s) that is calculated based on a grid, i=1,…,k. By means of this, the precision of the estimated effects at the MED sets is measured for each simulation step in comparison to the initial “true” model.

It is important to note that due to the complex model setup, computational issues may arise when fitting the model or computing the MED sets for the new simulated data points during the simulation step. These cases were excluded from further analysis. If such cases were identified in the analysis, they will be stated.

Analyzing Scenario 1 reveals how well the different designs perform in the practically motivated setting of the case study (see Section 4 again). Since the case study serves as the source for this scenario, the initial parameter setting corresponds to the model fit of the case study. The corresponding results for the simulation study of Scenario 1 can be seen exemplarily for 27 measurements in Figure 5, where the precision of estimating the 10% and 50% contour lines is shown via the corresponding RMSE values.

FIGURE 5.

FIGURE 5

Extract of simulation RMSE values in Scenario 1 (case study) regarding the 10% and 50% contour levels for N=27 measurements. The locally MED(10,50)‐optimal design outperforms all other designs, especially the traditionally used factorial design and both ray designs. The locally MED(10,50)‐optimal design shows the smallest RMSE values and therefore the highest precision for prediction at the set of effective dose combinations. Additionally, the smallest variability can be seen by the locally MED(10,50)‐optimal design.

Both locally MED‐optimal designs demonstrate strong performance, particularly when compared to the traditional factorial or the ray designs. The locally MED‐optimal design, specifically tailored for estimating the corresponding 10% and 50% contour lines, exhibits the smallest median RMSE value and variability, outperforming all other design approaches. The smaller the RMSE values are, the more precisely the contour lines can be estimated. This is also directly linked to a precise estimation of the corresponding MED sets. Hence, the considered MED‐optimal design leads to the highest precision of the effective concentrations. Furthermore, the locally D‐optimal design shows the next best performance. The locally MED‐optimal design not intended for estimating the contour lines of interest at 10% and 50%, but rather for the 20% and 80% contour lines also performs well and outperforms the factorial design and the ray designs. Overall, the factorial design and the ray designs are clearly inferior to the other design approaches in this context, as indicated by their higher RMSE values and variability. However, it is important to note that both ray designs achieve higher precision than the factorial 4×4 design, despite utilizing fewer dose combination levels.

A similar pattern is observed for the other sample sizes. The locally MED‐optimal design for estimating the 10% and 50% contour line outperforms the other designs for all numbers of observations. As the number of measurements increases, both the RMSE values and the variability of all designs decrease, indicating higher precision for all designs (see Appendix Figure A3). Nevertheless, the factorial or ray designs remain inferior to the other design approaches. The misspecified locally MED‐optimal design for the contour lines of 20% and 80% also outperforms the original design for higher sample sizes in terms of the median RMSE values and ranks third best in this case. Additionally, it is important to note that the factorial 4×4 design and both ray designs result in very large outliers, particularly for small sample sizes.

Furthermore, it should be noted that issues may arise when fitting the models during the simulation due to the model's complexity. Across all N and all replications, one model could not be estimated for all simulations if the original design, or a ray design was used. Additionally, four problematic simulation steps were observed in the factorial design. Given that 1000 simulation steps are performed for each different sample size and only a few problematic steps were encountered in total, these can be considered negligible. Both locally MED‐optimal designs and the locally D‐optimal design did not exhibit any problems when estimating the models during the simulation steps.

In Scenario 2 a Greco model with a clear positive interaction effect is considered (see Figure 4). Here, we consider the situation where the precise estimation of one contour line, that is, 10%, is of interest. Similar to Scenario 1, the different design approaches (see Table 3 and Appendix Table A2) are compared. Additionally, the locally MED‐optimal and D‐optimal designs are displayed in Appendix Figure A2.

The precision of the considered design approaches regarding the contour line of interest in Scenario 2 is shown in Figure 6 for the case of 27 measurements. Clearly, the locally MED‐optimal design outperforms all other designs in terms of the lowest RMSE values, indicating the highest precision. The next highest precision is achieved by the D‐optimal and the Ray 4/2 design. Both designs show a similar performance; however, the RMSE values of the Ray 4/2 design vary less than those of the D‐optimal design. Furthermore, the Ray 3/2 design ranks fourth in Scenario 2, but is considerably less effective than the locally MED‐optimal design. Both factorial designs exhibit much higher RMSE values and greater variability than all other designs, indicating that they are not suitable for estimating MED curves if the 10% contour line is used in combination with the Greco model.

FIGURE 6.

FIGURE 6

Extract of simulation RMSE values in Scenario 2 (Greco model) regarding the 10% contour level for N=27 measurements. The locally MED‐optimal design outperforms all other designs. It shows the smallest RMSE‐values and therefore the highest precision of the set of effective dose combinations.

While precision generally improves with an increasing number of measurements used in the simulation, the factorial and ray designs still perform poorly relative to the theoretically motivated approaches based on design theory, that is, the D‐optimal and the MED‐optimal design (see Appendix Figure A4). All practically motivated designs show RMSE values twice as high as those of the locally MED‐optimal design.

In this scenario, issues regarding the model fit were encountered for any of the design choices in the simulation study. The factorial 4×4, the locally MED‐optimal, and the D‐optimal design exhibited 1, 2, 3 problematic simulations, respectively, across all sample sizes N. The factorial 3×3 design showed nine problematic simulations. Both ray designs yielded the highest number of problematic simulation steps, which are 16 for the Ray 4/2 design and 64 for the Ray 3/2 design. Although these numbers are negligible relative to the total of 1000 simulation steps, they nonetheless indicate that the ray designs may be less suitable compared to the other design strategies.

In summary, both scenarios demonstrate that using the MED‐optimal design allows for more precise estimation of effective concentrations compared to the other designs, even though all designs employ the same sample size. Consequently, the alternative designs would require a larger number of observations (animals) to achieve the same level of precision in estimating effective concentrations as obtained with the MED‐optimal design. Therefore, the MED‐optimal design should be preferred over traditionally used designs like Factorial or Ray designs.

5.3. Robustness Analysis

In dose combination experiments, the dose–response relationships of the individual substances are often well understood from previous experiments, but the interaction effect is unknown. Thus, it is reasonable to account for different possible values of the interaction effect when planning the drug combination experiments. To ensure robustness, Bayesian designs can be used to account for uncertainty about the interaction effect. In this section, the performance of the locally MED‐optimal design itself and its corresponding Bayesian version defined in (15) is investigated in terms of their ability to estimate effective dose combinations most precisely.

First, we investigate a setting where due to previous experiments of each substance exclusively, the dose–response relationship of the monotherapies is already known. Furthermore, the interaction effect is not precisely known but is based on a small preliminary experiment of the combined substances, assumed to be non‐negative. We construct a locally MED‐optimal design for the simulation truth γ=0.02 and a locally MED‐optimal design for the misspecified value γ=0.05 to investigate the influence of a missspecified interaction parameter on the estimation precision. Moreover, the Bayesian MED‐optimal design for different non‐negative values of γ is calculated using the definition in (15).

In detail, we investigate an additive model with two Emax models and the assumed parameter setting θ0=0,θC=(80,3),θD=(120,10) and a positive interaction effect γ=0.02. Here, the considered design approaches are evaluated in terms of their ability to estimate the 10% and 30% contour lines most precisely. The corresponding surface model and its corresponding contour lines are shown in the Appendix Figure A5.

To imitate the case of not knowing the real interaction effect before conducting a dose combination experiment, but assuming the interaction effect to be greater or equal to zero, we consider three different values, that is, {0,0.01,0.02}, all equally weighted for the interaction effect γ, which for example can be assessed via preliminary experiments or literature research. Note that although a continuous prior would be desirable, it is currently not feasible in our code due to the computationally complexity associated with the required design calculations. The corresponding Bayesian MED‐optimal design is displayed in Appendix Figure A7 and Table A3. Additionally, the resulting contour lines for the different values of γ are shown in Appendix Figure A6. Although the response‐surface is substantially different for the different choices of the interaction effect, the contour lines in this case look quite similar. Due to this fact, the Bayesian MED‐optimal design has very similar support points to both locally MED‐optimal designs in this case.

In a simulation study, we compare the three different designs (Appendix Table A3) in terms of their ability to precisely estimate the 10% and 30% contour lines. Figure 7 shows the RMSE values of the 10% and 30% curves for different sample sizes. All designs seem to perform quite similarly, as the median RMSE values as well as their corresponding variabilities illustrated by the corresponding boxes are similar across the designs. The misspecified locally MED‐optimal design, which assumed an interaction effect of γ=0.005 instead of γ=0.02 performs slightly worse for small sample sizes, but shows a similar performance to the other approaches in the case of higher sample sizes. This might be due to the fact that the MEDs also look similar in this setting for different values of γ, although the corresponding surfaces differ.

FIGURE 7.

FIGURE 7

Extract of RMSE values for the robustness analysis setting 1 with simulation truth γ=0.02 (two Emax models) grouped by design and total sample size for the robustness analysis of MED designs. All designs show a similar ability to estimate the contour lines for p1=10 and p2=30 in this setting.

Besides, there were no numerical difficulties to estimate the correct specified or Bayesian MED‐optimal design, respectively. The missspecified locally MED‐optimal design instead showed three problematic iteration steps across all samples sizes.

In a second setting, we explore the capabilities of the Bayesian MED design when the interaction effect remains uncertain and a broader range of values for γ is considered. We consider five different potential values for the interaction effect γ, namely {−0.02,0.01,0,0.01,0.02}. In this setting, we assume that the true (but unknown before) dose combination relationship exhibits a negative interaction effect with γt=−0.01. The corresponding contour lines of interest are displayed in Appendix Figure A8 and exhibit widely different shapes. A locally MED‐optimal design is calculated for the simulated truth of γt=−0.01 and a misspecified γ=0.02 as well as the Bayesian MED design for the considered prior. The designs are displayed in Appendix Figure A9 and Table A4.

Figure 8 illustrates the precision of the 80% and 90% contour lines for the second setting in this robustness analysis. In this case, the locally MED‐optimal design, which was tailored to the true parameter setting, performs best as expected and can be treated as the gold standard. The misspecified locally MED‐optimal design exhibits considerably higher RMSE values, indicating a lower ability to estimate the contour lines accurately. Conversely, the Bayesian MED‐optimal design, which accounts for a range of different values of the interaction effect γ, demonstrates excellent performance in this context, nearly on par with the locally optimal design.

FIGURE 8.

FIGURE 8

Extract of RMSE values for the robustness setting 2 with simulation truth γ=−0.01 (two Emax models) grouped by design and total sample size for the robustness analysis of MED designs. The locally MED‐optimal design and the Bayesian MED design show a similar ability to estimate the contour lines for p1=80 and p2=90 in this setting, while the misspecified design shows clearly higher RMSE values.

Besides, there were no difficulties to estimate the Bayesian MED or both locally MED‐optimal designs.

6. Discussion and Conclusion

Identifying effective dose combinations that achieve a prespecified percentage of the maximal effect has recently become more relevant in drug‐combination studies. However, so far, the optimal design of drug‐combination experiments is based on the established classical D‐optimality criterion (see Papathanasiou et al. 2019) or criteria related to therapeutic indices, such as the drug combination index (see Holland‐Letz and Kopp‐Schneider 2018). The disadvantage of these designs is that they may result in an imprecise estimation of effective dose combinations, as given by contour lines, if nonlinear surface models are used to describe the dose combination response relationship. Therefore, we propose a novel design approach for drug‐combination experiments that directly addresses the precise estimation of effective dose combinations. Here, MEDp denotes the set of dose combinations resulting in p% of the maximum effect, that is, the contour line of a nonlinear surface model at p%. We define a design as optimal for identifying effective dose combinations if it minimizes the Lq‐norm of the variances of the confidence band describing the effect at the dose combinations contained in MEDp.

For this novel criterion, we provide optimal design theory via equivalence theorems and some further analytic results.

The MEDp‐optimal design criterion is a flexible approach, which can be used for a broad class of linear and nonlinear response surface models. Therefore, we investigate in an extensive simulation study the ability of the MEDp‐optimal design to estimate contour lines of interest precisely for commonly used response surface models in dose combination studies. In two different simulation scenarios, we explore the performance of the MEDp‐optimal design for different response surface models and assumed interactions between the two considered drugs. Moreover, we compare the performance of the MED‐optimal design with commonly used designs, including factorial and ray designs. The analysis also incorporates D‐optimal designs. Also, one of the simulation scenarios is based on a real case study. Here, a data set of four pooled mouse experiments was used to investigate the dose–response relationship of two oncological substances.

In both scenarios, the optimal designs for identifying effective dose combinations demonstrate strong performance, outperforming the other designs considerably. Our results clearly demonstrate that the MED‐optimal design should be preferred over traditionally used designs, as it provides higher precision in estimating the contour lines while using the same number of measurements. Other designs would require additional observations (e.g., animals) to achieve the same level of precision as the MED‐optimal design. In research and animal experiments, such as oncology research, this approach can provide notable benefits. Dose‐combination studies often involve a considerable number of animals. With an optimized study design, however, it may be possible to achieve precise estimates with smaller sample sizes. This could offer advantages from an ethical perspective by supporting the principles of the 3R framework (Replace, Reduce, Refine) and may also help facilitate the implementation of such experiments.

Also, the locally D‐optimal design leads to effectively estimating the contour lines. However, it struggles if the scope is the identification of effective dose combinations for one marginal effect level p. The D‐optimal design aims at achieving a precise estimation of the parameter of interest. Therefore, it appears that when more contour lines are relevant and these contours are more distinct, the D‐optimal design is also a suitable choice, as it effectively captures the overall surface structure. Furthermore, the practically motivated designs like the factorial or ray designs are clearly inferior to the theoretical motivated designs. One could also refine factorial or ray designs by incorporating prior knowledge and employing optimal experimental design theory (see, e.g., Almohaimeed and Donev 2014). Presumably, their performance would then improve substantially when the dose combinations of the corresponding rays are optimally planned. Given that prior knowledge of single‐substance dose–response relationships often exists before conducting dose combination studies, while the interaction effects are unknown, we propose a robust version of the developed criterion using a (pseudo) Bayesian approach. More precisely, instead of assuming a specific value for the interaction effect, several possible values for the interaction effect are incorporated via a prior distribution. Performance comparisons in simulation studies reveal that the Bayesian approach enhances robustness, particularly if the prior knowledge about the interaction effect is less informative. In this case, the contour lines of the surface model vary considerably, and a potentially misspecified locally optimal design for identifying effective dose combinations is inferior to the corresponding Bayesian optimal design. However, if the prior distribution is informative, reflecting a specific direction of the type of interaction, the differences between the locally optimal and the Bayesian optimal design are minor. Here, the contour lines of interest show slight variation with different values of the interaction effect γ, and both the locally optimal designs (under slight misspecification) and the corresponding Bayesian design perform similarly. In situations where the effect is uncertain before conducting the experiment, and with varying contour lines depending on the interaction effect γ, the Bayesian optimal designs should be preferred over a potentially misspecified version of the locally optimal design for identifying effective dose combinations.

We emphasize that, even in the one‐dimensional case, the confidence interval for the effective doses can be quite large in practical settings. Due to various uncontrollable factors in the laboratory, the effective doses can vary, even between two experiments with similar setups (Jiang and Kopp‐Schneider 2014). This underscores the inherent variability of the ED itself. This issue can also arise in two‐dimensional settings and is a persistent challenge. However, the developed criterion focuses on minimizing the asymptotic variance of the effective dose combinations, which also results in the minimal variability of the estimation of the effective doses.

The proposed design approach is very flexible, allowing to adapt to any nonlinear surface model, including non‐monotonic regression functions for the individual drugs under consideration. We focused on identifying multivariate effective dose combinations that lead to p% of the maximal effect. However, the approach can be easily be extended to any contour line of interest. To facilitate the application of the developed optimality criterion by practitioners, code examples are provided in Zenodo at Schürmeyer et al. (2026).

The criterion is based on an Lq‐norm where q∈[1,∞) has to be fixed in advance. We analyzed the performance of the optimal designs for various selected values of q, finding that, for example, q=2 outperformed q=1. However, we did not investigate the performance of higher values of q. We leave the quantification of the benefits associated with using higher values of q, as well as the extension of q=∞ aligning with the supremum norm L∞, and an exploration of their advantages, for future research.

Funding

This work has been supported by the Research Training Group “Biostatistical Methods for High‐Dimensional Data in Toxicology” (RTG 2624, Project P5) funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation—Project Number 427806116).

Conflicts of Interest

The authors declare no conflicts of interest.

Open Research Badges

This article has earned an Open Data badge for making publicly available the digitally‐shareable data necessary to reproduce the reported results. The data is available in the Supporting Information section.

This article has earned an open data badge “Reproducible Research” for making publicly available the code necessary to reproduce the reported results. The results reported in this article could fully be reproduced.

Supporting information

Supporting File 1: bimj70186‐sup‐0001‐SuppMat.pdf

BIMJ-68-e70186-s001.pdf (210.1KB, pdf)

Supporting File 2: bimj70186‐sup‐0002‐Data.zip.

BIMJ-68-e70186-s003.zip (581.4KB, zip)

Supporting File 3: bimj70186‐sup‐0003‐CaseStudyData.xlsx.

BIMJ-68-e70186-s002.xlsx (15.6KB, xlsx)

Acknowledgments

Open access funding enabled and organized by Projekt DEAL.

TABLE A1.

Considered designs with information of used dose combination levels and corresponding weights based on case study data (see Section 4). K denotes the number of distinct dose combinations, and for the numerically obtained designs, elb is the lower bound on their efficiency from (14) in Corollary 4.

Design
K
1−elb
Doses and corresponding weights
Ray 4/2 8
(0.0,0.0)
(0.0,2.33)
(0.0,4.67)
(0.0,7.0)
(6.67,0.0)
(13.33,0.0)
1/8
1/8
1/8
1/8
1/8
1/8
(20.0,0.0)
(20.0,7.0)
1/8
1/8
Ray 4/4 10
(0.0,0.0)
(0.0,2.33)
(0.0,4.67)
(0.0,7.0)
(6.67,0.0)
(6.67,2.33)
1/10
1/10
1/10
1/10
1/10
1/10
(13.33,0.0)
(13.33,4.67)
(20.0,0.0)
(20.0,7.0)
1/10
1/10
1/10
1/10
Factorial 4×4 16
(0.0,0.0)
(0.0,2.33)
(0.0,4.67)
(0.0,7.0)
(6.67,0.0)
(6.67,2.33)
1/16
1/16
1/16
1/16
1/16
1/16
(6.67,4.67)
(6.67,7.0)
(13.33,0.0)
(13.33,2.33)
(13.33,4.67)
(13.33,7.0)
1/16
1/16
1/16
1/16
1/16
1/16
(20.0,0.0)
(20.0,2.33)
(20.0,4.67)
(20.0,7.0)
1/16
1/16
1/16
1/16
Original 12
(0.0,0.0)
(5.0,0.0)
(10.0,0.0)
(20.0,0.0)
(0.0,0.3)
(0.0,1.0)
0.22 0.11 0.11 0.16 0.05 0.05
(0.0,3.0)
(10.0,3.0)
(20.0,3.0)
(0.0,7.0)
(5.0,7.0)
(20.0,7.0)
0.05 0.05 0.05 0.09 0.03 0.03
D‐optimal 9
(0.0,0.0)
(0.0,0.4)
(0.0,7.0)
(0.0,3.13)
(3.66,0.0)
(3.8,0.44)
0.105 0.099 0.125 0.125 0.097 0.073
(7.67,0.01)
(20.0,0.0)
(20.0,7.0)
0.126 0.125 0.125
MED (10,50) 11
6.0×10−5
(0.0,0.0)
(0.0,0.3)
(0.0,7.0)
(0.0,2.61)
(3.14,0.0)
(3.59,1.99)
0.049 0.178 0.012 0.175 0.107 0.125
(3.67,0.48)
(6.18,0.38)
(6.86,0.0)
(20.0,0.0)
(20.0,7.0)
0.107 0.109 0.115 0.013 0.01
MED (20,80) 12
3.3×10−7
(0.0,0.0)
(0.0,7.0)
(0.0,0.46)
(1.16,4.23)
(3.27,3.5)
(3.55,0.55)
0.011 0.051 0.144 0.168 0.005 0.099
(3.66,0.0)
(7.57,2.54)
(9.15,0.35)
(9.4,0.0)
(20.0,0.01)
(20.0,7.0)
0.097 0.151 0.045 0.057 0.137 0.035

TABLE A2.

Considered designs with information of used dose combination levels and corresponding weights for Scenario 2. K denotes the number of distinct dose combinations, and for the numerically obtained designs, elb is the lower bound on their efficiency from (14) in Corollary 4.

Design
K
1−elb
Doses and corresponding weights
Ray 3/2 6
(0.0,0.0)
(0.0,0.5)
(0.0,1.0)
(0.5,0.0)
(1.0,0.0)
(1.0,1.0)
1/6
1/6
1/6
1/6
1/6
1/6
Ray 4/2 8
(0.0,0.0)
(0.0,0.33)
(0.0,0.67)
(0.0,1.0)
(0.33,0.0)
(0.67,0.0)
1/8
1/8
1/8
1/8
1/8
1/8
(1.0,0.0)
(1.0,1.0)
1/8
1/8
Factorial 3×3 9
(0.0,0.0)
(0.0,0.5)
(0.0,1.0)
(0.5,0.0)
(0.5,0.5)
(0.5,1.0)
1/9
1/9
1/9
1/9
1/9
1/9
(1.0,0.0)
(1.0,0.5)
(1.0,1.0)
1/9
1/9
1/9
Factorial 4×4 16
(0.0,0.0)
(0.0,0.33)
(0.0,0.67)
(0.0,1.0)
(0.33,0.0)
(0.33,0.33)
1/16
1/16
1/16
1/16
1/16
1/16
(0.33,0.67)
(0.33,1.0)
(0.67,0.0)
(0.67,0.33)
(0.67,0.67)
(0.67,1.0)
1/16
1/16
1/16
1/16
1/16
1/16
(1.0,0.0)
(1.0,0.33)
(1.0,0.67)
(1.0,1.0)
1/16
1/16
1/16
1/16
MED (10) 7 0
(0.0,0.18)
(0.0,0.58)
(0.11,0.09)
(0.23,0.0)
(0.34,0.28)
(0.73,0.0)
0.283 0.07 0.177 0.323 0.032 0.071
(1.0,1.0)
0.044
D‐optimal 6
(0.0,0.25)
(0.0,0.6)
(0.32,0.0)
(0.33,0.26)
(0.75,0.0)
(1.0,1.0)
0.147 0.152 0.148 0.2 0.153 0.2

TABLE A3.

Considered designs in robustness analyses setting 1 with information of used dose combination levels and corresponding weights. K denotes the number of distinct dose combinations, and elb is the lower bound on their efficiency from (14) in Corollary 4.

Design
K
1−elb
Doses and corresponding weights
MED (10,30) γt=0.02 9
0.00021
(0.0,12.0)
(0.0,0.0)
(0.0,4.87)
(1.54,3.18)
(1.59,12.0)
(1.99,0.0)
0.187 0.13 0.061 0.27 0.027 0.039
(10.0,3.02)
(10.0,12.0)
(10.0,0.0)
0.032 0.016 0.238
MED (10,30) γ=0.005 7
0.0034
(0.0,0.0)
(0.0,12.0)
(0.0,3.97)
(1.53,3.04)
(2.05,0.0)
(10.0,12.0)
0.139 0.064 0.23 0.259 0.22 0.012
(10.0,0.0)
0.076
Bayesian MED (10,30) 9
3.3×10−8
(0.0,0.0)
(0.0,12.0)
(0.0,3.82)
(1.39,12.0)
(1.6,3.26)
(1.97,0.0)
0.121 0.117 0.18 0.022 0.207 0.168
(10.0,0.0)
(10.0,2.8)
(10.0,12.0)
0.146 0.024 0.015

TABLE A4.

Considered designs in robustness analyses setting 2 with information of used dose combination levels and corresponding weights. K denotes the number of distinct dose combinations, and elb is the lower bound on their efficiency from (14) in Corollary 4.

Design
K
1−elb
Doses and corresponding weights
MED (80,90) γ=0.02 7
5.5×10−7
(0.0,0.0)
(0.0,12.0)
(3.27,12.0)
(3.29,5.92)
(10.0,0.0)
(10.0,5.88)
0.004 0.019 0.313 0.084 0.02 0.337
(10.0,12.0)
0.223
MED (80,90) γt=−0.01 9
4.0×10−6
(0.0,0.0)
(0.0,12.0)
(0.0,3.88)
(1.74,12.0)
(1.94,0.0)
(2.34,4.67)
0.018 0.107 0.014 0.167 0.017 0.233
(10.0,0.0)
(10.0,3.49)
(10.0,12.0)
0.068 0.218 0.158
Bayesian MED (80,90) 9
0.0014
(0.0,0.0)
(0.0,5.35)
(0.0,12.0)
(2.16,4.22)
(2.32,12.0)
(2.68,0.0)
0.016 0.05 0.076 0.109 0.211 0.036
(10.0,0.0)
(10.0,4.61)
(10.0,12.0)
0.095 0.227 0.18

FIGURE A1.

FIGURE A1

Showcase visualization of the considered factorial designs and ray designs. The considered number of support points can differ depending on the considered setting.

FIGURE A2.

FIGURE A2

Visualization of the considered designs and contour line in Scenario 2, which includes their support points represented by dots, with their sizes corresponding to their weights.

FIGURE A3.

FIGURE A3

Extract of RMSE values grouped by design and total number of observations used in the simulation steps of Scenario 1. The locally MED(10,50)‐optimal design shows the smallest RMSE values for all considered sample sizes compared to all other designs, especially the traditionally used factorial design and both ray designs.

FIGURE A4.

FIGURE A4

Extract of RMSE values grouped by design and total number of observations used in the simulation steps of Scenario 2. The locally MED‐optimal design outperforms all other designs for all numbers of measurements. In detail it shows the smallest RMSE values and therefore the highest precision of the set of effective doses.

FIGURE A5.

FIGURE A5

Additive response‐surface model (including two Emax models) for robustness setting 1 with the considered 10% and 30% contour lines.

FIGURE A6.

FIGURE A6

Visualization of MED10 and MED30 sets for robustness analysis setting 1 in case of different values of the interaction effect γ.

FIGURE A7.

FIGURE A7

Visualization of the considered designs in the robustness analysis setting 1, which includes their support points represented by dots, with their sizes corresponding to their weights.

FIGURE A8.

FIGURE A8

Visualization of MED80 and MED90 sets for the second setting in the robust analysis in case of different values of the interaction effect γ.

FIGURE A9.

FIGURE A9

Visualization of the considered Bayesian designs in robustness analysis setting 2, which includes their support points represented by dots, with their sizes corresponding to their weights.

Data Availability Statement

The code that supports the findings of this study is openly available in Zenodo at Schürmeyer et al. (2026). The data used for this analysis are provided in the Supporting Information.

References

  1. Almohaimeed, B. , and Donev A. N.. 2014. “Experimental Designs for Drug Combination Studies.” Computational Statistics & Data Analysis 71: 1077–1087. [Google Scholar]
  2. Bliss, C. I. 1939. “The Toxicity of Poisons Applied Jointly.” Annals of Applied Biology 26, no. 3: 585–615. [Google Scholar]
  3. Bornkamp, B. , Pinheiro J., and Bretz F.. 2009. “MCPMod: An R Package for the Design and Analysis of Dose‐Finding Studies.” Journal of Statistical Software 29: 1–23. [Google Scholar]
  4. Bretz, F. , Dette H., and Pinheiro J. C.. 2010. “Practical Considerations for Optimal Designs in Clinical Dose Finding Studies.” Statistics in Medicine 29, no. 7‐8: 731–742. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bretz, F. , Pinheiro J. C., and Branson M.. 2005. “Combining Multiple Comparisons and Modeling Techniques in Dose‐Response Studies.” Biometrics 61, no. 3: 738–748. [DOI] [PubMed] [Google Scholar]
  6. Chaloner, K. 1989. “Bayesian Design for Estimating the Turning Point of a Quadratic Regression.” Communications in Statistics‐Theory and Methods 18, no. 4: 1385–1400. [Google Scholar]
  7. Chaloner, K. , and Larntz K.. 1989. “Optimal Bayesian Design Applied to Logistic Regression Experiments.” Journal of Statistical Planning and Inference 21, no. 2: 191–208. [Google Scholar]
  8. Chen, P.‐Y. , Chen R.‐B., and Wong W. K.. 2022. “Particle Swarm Optimization for Searching Efficient Experimental Designs: A Review.” WIREs Computational Statistics 14, no. 5: e1578. [Google Scholar]
  9. Chou, T.‐C. 2008. “Preclinical Versus Clinical Drug Combination Studies.” Leukemia & Lymphoma 49, no. 11: 2059–2080. [DOI] [PubMed] [Google Scholar]
  10. Dette, H. , and Schorning K.. 2016. “Optimal Designs for Comparing Curves.” Annals of Statistics 44, no. 3: 1103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Fedorov, V. V. , and Leonov S. L.. 2013. Optimal Design for Nonlinear Response Models. CRC Press. [Google Scholar]
  12. Foucquier, J. , and Guedj M.. 2015. “Analysis of Drug Combinations: Current Methodological Landscape.” Pharmacology Research & Perspectives 3, no. 3: 1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Greco, W. R. , Bravo, and Parsons J. C.. 1995. “The Search for Synergy: A Critical Review From a Response Surface Perspective.” Pharmacological Reviews 47: 331–385. [PubMed] [Google Scholar]
  14. Holland‐Letz, T. , and Kopp‐Schneider A.. 2018. “Optimal Experimental Designs for Estimating the Drug Combination Index in Toxicology.” Computational Statistics & Data Analysis 117: 182–193. [Google Scholar]
  15. Jennrich, R. I. 1969. “Asymptotic Properties of Non‐Linear Least Squares Estimators.” Annals of Mathematical Statistics 40, no. 2: 633–643. [Google Scholar]
  16. Jiang, X. , and Kopp‐Schneider A.. 2014. “Summarizing EC50 Estimates From Multiple Dose‐Response Experiments: A Comparison of a Meta‐Analysis Strategy to a Mixed‐Effects Model Approach.” Biometrical Journal 56, no. 3: 493–512. [DOI] [PubMed] [Google Scholar]
  17. Kiefer, J. 1974. “General Equivalence Theory for Optimum Designs (Approximate Theory).” Annals of Statistics 2, no. 5: 849–879. [Google Scholar]
  18. Lee, J. J. , Kong M., Ayers G. D., and Lotan R.. 2007. “Interaction Index and Different Methods for Determining Drug Interaction in Combination Therapy.” Journal of Biopharmaceutical Statistics 17, no. 3: 461–480. [DOI] [PubMed] [Google Scholar]
  19. Liou, J.‐Y. , Tsou M.‐Y., and Ting C.‐K.. 2015. “Response Surface Models in the Field of Anesthesia: A Crash Course.” Acta Anaesthesiologica Taiwanica 53, no. 4: 139–145. [DOI] [PubMed] [Google Scholar]
  20. Loewe, S. 1927. “Die Mischarznei: Versuch einer Allgemeinen Pharmakologie der Arzneikombinationen.” Klinische Wochenschrift 6, no. 23: 1077–1085. [Google Scholar]
  21. Lorensen, W. E. , and Cline H. E.. 1987. “Marching Cubes: A High Resolution 3D Surface Construction Algorithm.” In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '87, 163–169. ACM. [Google Scholar]
  22. Macdougall, J. 2006. “Analysis of Dose–Response Studies—Emax Model.” In Dose Finding in Drug Development, 127–145. Springer. [Google Scholar]
  23. Masoudi, E. , Holling H., Duarte B. P., and Wong W. K.. 2019. “A Metaheuristic Adaptive Cubature Based Algorithm to Find Bayesian Optimal Designs for Nonlinear Models.” Journal of Computational and Graphical Statistics 28, no. 4: 861–876. [Google Scholar]
  24. Miller, F. , Guilbaud O., and Dette H.. 2007. “Optimal Designs for Estimating the Interesting Part of a Dose‐Effect Curve.” Journal of Biopharmaceutical Statistics 17, no. 6: 1097–1115. [DOI] [PubMed] [Google Scholar]
  25. Mokhtari, R. B. , Homayouni T. S., Baluch N., et al. 2017. “Combination Therapy in Combating Cancer.” Oncotarget 8, no. 23: 38022–38043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Papathanasiou, T. , Strathe A., Overgaard R. V., Lund T. M., and Hooker A. C.. 2019. “Optimizing Dose‐Finding Studies for Drug Combinations Based on Exposure‐Response Models.” AAPS Journal 21: 1–11. [DOI] [PubMed] [Google Scholar]
  27. Pronzato, L. , and Walter E.. 1985. “Robust Experiment Design via Stochastic Approximation.” Mathematical Biosciences 75, no. 1: 103–120. [Google Scholar]
  28. Pukelsheim, F. 2006. Optimal Design of Experiments. SIAM. [Google Scholar]
  29. Pukelsheim, F. , and Rieder S.. 1992. “Efficient Rounding of Approximate Designs.” Biometrika 79, no. 4: 763–770. [Google Scholar]
  30. R Core Team . 2024. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. [Google Scholar]
  31. Rønneberg, L. , Cremaschi A., Hanes R., Enserink J. M., and Zucknick M.. 2021. “bayesynergy: Flexible Bayesian Modelling of Synergistic Interaction Effects in in Vitro Drug Combination Experiments.” Briefings in Bioinformatics 22, no. 6: 1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Sandig, L. 2024. “Kirstine.jl: A Julia Package for Bayesian Optimal Design of Experiments.” Journal of Open Source Software 9, no. 97: 6424. [Google Scholar]
  33. Schürmeyer, L. , Sandig L., and Kühne J.. 2026. “Code for ‘Optimal Designs for Identifying Effective Doses in Drug Combination Studies’ (Version 4).” 10.5281/zenodo.19322118. [DOI] [PMC free article] [PubMed]
  34. Straetemans, R. , O'Brien T., Wouters L., et al. 2005. “Design and Analysis of Drug Combination Experiments.” Biometrical Journal 47, no. 3: 299–308. [DOI] [PubMed] [Google Scholar]
  35. Yang, M. , Biedermann S., and Tang E.. 2013, December. “On Optimal Designs for Nonlinear Models: A General and Efficient Algorithm.” Journal of the American Statistical Association 108, no. 504: 1411–1420. [Google Scholar]
  36. Zhao, L. , Au J. L., and Wientjes M. G.. 2010. “Comparison of Methods for Evaluating Drug‐Drug Interaction.” Frontiers in Bioscience (Elite Edition) 2: 241. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Zhou, Y. , Sloan A., Menon S., and Wang L.. 2024. “Combination MCP‐Mod for Two‐Drug Combination Dose‐Ranging Studies.” Journal of Biopharmaceutical Statistics 35, no. 2: 257–270. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supporting File 1: bimj70186‐sup‐0001‐SuppMat.pdf

BIMJ-68-e70186-s001.pdf (210.1KB, pdf)

Supporting File 2: bimj70186‐sup‐0002‐Data.zip.

BIMJ-68-e70186-s003.zip (581.4KB, zip)

Supporting File 3: bimj70186‐sup‐0003‐CaseStudyData.xlsx.

BIMJ-68-e70186-s002.xlsx (15.6KB, xlsx)

Data Availability Statement

The code that supports the findings of this study is openly available in Zenodo at Schürmeyer et al. (2026). The data used for this analysis are provided in the Supporting Information.


Articles from Biometrical Journal. Biometrische Zeitschrift are provided here courtesy of Wiley

RESOURCES