Skip to main content
Biomedicines logoLink to Biomedicines
. 2023 Feb 8;11(2):497. doi: 10.3390/biomedicines11020497

Nonlinear Adaptive Optimal Controller Design for Anti-Angiogenic Tumor Treatment

Nitendra Nath 1, Irfan Kil 2, Ugur Hasirci 3,*, Richard E Groff 4, Timothy C Burg 5
Editors: Camilla Palumbo, Loredana Albonici
PMCID: PMC9953489  PMID: 36831033

Abstract

Angiogenesis is an important process in tumor growth as it represents the regime when the tumor recruits blood vessels from the surrounding tissue to support further tumor growth. Anti-angiogenic treatments aim to shrink the tumor by interrupting the vascularization of the tumor; however, the anti-angiogenic agents are costly and the tumor response to these agents is nonlinear. Simple dosing schemes, e.g., a constant dose, may yield higher cost or lower efficacy than an approach that considers the tumor system dynamics. Hence, in this study, the administration of anti-angiogenic treatment is considered as a nonlinear control problem. The main aim of the controller design is to optimize the anti-angiogenic tumor therapy, specifically, to minimize the tumor volume and drug dose. Toward this aim, two nonlinear optimal controllers are presented. The first controller ensures exponential tracking of a desired, optimal tumor volume profile under the assumption that all parameters in the system model are known. The second controller, on the other hand, assumes all the parameters are unknown and provides asymptotic tracking. Both controllers take pharmacokinetics and pharmacodynamics into account, as well as the carrying capacity of the vascular network. Lyapunov based arguments are used to design the controllers, using stability arguments, and numerical simulation results are presented to demonstrate the effectiveness of the proposed method.

Keywords: angiogenesis, anti-angiogenic treatment, control systems, optimal control

1. Introduction

Breast cancer has the highest incidence rate compared to other types of cancer [1]. An overview of the tumor angiogenesis is provided by the US National Cancer Institute [2] and summarized in Figure 1. Initially, tumor cells get nutrients from the surrounding tissues via diffusion. The diffusion supported growth regime ends when physical limits (1–2 mm of tumor diameter) prevent nutrients and oxygen from reaching the core of the tumor. Then, an angiogenesis triggering event occurs; the tumor cells release factors, such as vascular endothelial growth factor (VEGF) or basic fibroblast growth factor (bFGF) [3], that instigate the recruitment of blood vessels to support further tumor growth. The tumor and support vasculature can then co-develop as the blood vessels supply nutrients and remove waste products from the proliferating tumor cells, and the growing tumor signals additional vascular growth, primarily vascular endothelial cells. The next major event is metastasis when the tumor spreads to the other tissues and organs.

Figure 1.

Figure 1

Angiogenesis occurs as the tumor approaches a certain size that can no longer be supported by diffusion alone; the tumor must recruit blood vessels from the surrounding tissue to support further growth.

Anti-angiogenic treatment was proposed by Folkman [4] and aimed to control the growth of the vascular network, described above, to indirectly control the tumor. The relationship between the growth of the vascular network and the growth of the tumor is dynamic, complex, and nonlinear. Therefore, applying a fixed or a time-varying dose of anti-angiogenic agents, without observing the response of the tumor, i.e., open-loop control, may fail to shrink the tumor. Closed-loop control may be more effective to control the growth of the vascular network, so as to shrink the tumor, by using feedback signals from the co-developing tumor and vascular network. Since the commercially available anti-angiogenic agents, like angiostatin and endostatin, are expensive, an optimal control approach can be employed to keep the tumor size at a certain (desired) value by using an optimum dose of an anti-angiogenic agent. Ledzewicz and her coworkers have proposed many open-loop [5,6] and closed-loop optimal control schemes [7,8]. Swierniak et al. also presented an optimal controller addressing the same problem in [9]. Nath et al. proposed a novel approach that combines closed-loop tracking control with an optimization to minimize the anti-angiogenic agents that needed to move the system to a setpoint (tumor size) [10]. In 2013, Hasirci et al. proposed enhancements to the core tracking controller: a robust controller in [11] and an adaptive controller in [12]. Researchers have used nonlinear adaptive and robust control techniques in a wide range of applications, success in controlling similar dynamical systems [13,14,15,16,17] inspires the current work.

As a general control design methodology, the salient features of the system to be controlled are first approximated with a mathematical model. In biological systems, especially, it is a good and usual practice to make simplifying assumptions to make the mathematical model tractable, while balancing accuracy and resolution. As experience and evidence build, additional complexities can be added to the model. The controllers reviewed above are based on a simplified dynamic model where tumor volume and vascular carrying capacity are the only state variables. This model assumes drug concentration is equal to drug dose, and also assumes that the effect of the anti-angiogenic agents is instantaneous. A more realistic and, as a result, more complex view of the angiogenesis process dictates the incorporation of pharmacokinetics (PK) and pharmacodynamics (PD) into the system model. As clearly stated in [18], pharmacokinetics equations describe the concentration of a drug and pharmacodynamics equations model the effectiveness of drug dose. Incorporating PK/PD equations to the angiogenic tumor growth model begins to add the clinic reality of drug delivery to the model.

In this paper, we present a novel approach for real-time dosing of the anti-angiogenic treatment by considering the richer tumor growth model, which incorporates PK/PD. The main aim of the control design is to optimize the anti-angiogenic tumor therapy for minimizing the tumor volume by using an optimal amount of the anti-angiogenic agents. Two different controllers are presented to achieve the control objective. To minimize the tumor volume, we first formulate a performance index to be minimized and then a nonlinear optimal exact model knowledge controller is designed to drive the tumor volume to an optimal desired time-varying trajectory. Then, a more realistic control design approach is also presented for the same control objective; a nonlinear optimal adaptive controller assuming all the system parameters is unknown. For the adaptive controller, a least-squares estimation technique is used to identify the system parameters in the performance index and the desired optimal trajectory is generated by using an optimization algorithm, which seeks the minimum of the performance index. As demonstrated by simulation results, this optimization algorithm successfully finds the optimum values of the carrying capacity of vasculature and the tumor volume. The paper is organized as follows: Section 2 contains discussion about the modeling issues and a definition of the control problem. Section 3 contains the details of the design of an exact model knowledge nonlinear optimal controller, and then an adaptive controller. Performance results of the proposed adaptive scheme are obtained via numerical simulation in Section 4. The last section discusses the results and highlights some conclusions.

2. System Model and Control Problem Definition

Early mathematical models for tumor growth comprised one state variable: tumor volume (p(t)) [19]. The carrying capacity of the vasculature network (q(t)) concept was proposed to account for co-growth of the tumor and vasculature, i.e., angiogenesis, and then a killing factor was introduced to model anti-angiogenic therapy, which targets endothelial cells instead of the tumor cells [20]. Many mathematical models have been proposed for this two-state system, some of which attempt to fully describe the complexity of biological process [21,22,23,24,25,26,27]. Since these models are not tractable for mathematical analysis [28], Hahnfeldt et al. proposed and biologically validated a simpler two-state model to describe the interaction between the carrying capacity of vasculature and tumor size [29]. A useful modification of this model was presented by Ergun et al. [30], and more recently by d’Onofrio and Gandolfi [31]. Incorporation of PD/PK equations to this modified model has been presented by Ledzewicz et al. [32] and is given by:

p˙=αp1pqq˙=bqdp2/3qGscqc˙=mc+hu ; ct0=0 (1)

where p(t) is the tumor volume in mm3, q(t) is the carrying capacity of the endothelial cells, also measured in mm3, c(t) is the plasma concentration of the exogenous angiogenic inhibitors, applied as treatment and measured in [conc.], and α is the tumor growth parameter. The term bq accounts for the proliferation kinetics of the endothelial cells and the term dp2/3q models endogenous inhibition of the tumor. Because the inhibitors release through the surface of the tumor mass, the 2/3 exponent represents the conversion of the tumor volume into a tumor surface area, and the product p2/3q is due to the interactions of endogenous inhibitors with endothelial cells. The parameters b and d are constants. The constant G denotes the anti-angiogenic killing parameter, and u(t) is the manipulated control input which corresponds to the anti-angiogenic dose. The drug dose u(t) and concentration of c(t) of the inhibitors are linked by a first-order, linear, ordinary differential equation where m and h are constant parameters [32]. The effect of the applied drug is proportional to the concentration of the inhibitor, given as effect = sc where s [0,1]. Note that “[conc.]” is generic concentration and that the units of concentration do not affect the states q(t) and p(t) when the parameters G, m, and h are written for a specific unit of concentration.

Assumption 1.

Only the biologically realistic domain where all the state variables are always greater than zero for all time instants, i.e., p(t) > 0, q(t) > 0, and c(t) > 0, will be considered. It is assumed that the tumor volume p(t), the carrying capacity of the vascular network q(t), and the concentration of the angiogenic inhibitors c(t) are measurable.

The control objective is to minimize the tumor volume, p(t), by using an optimum dose of angiogenic inhibitors, u(t). This objective is met if the following performance index is minimized:

J=p+Sud3/2 (2)

where S = Gs. The performance index J(t) captures the treatment goal by using the summation of tumor size and drug dose. To obtain the same units, mm3, for each term in (2), the drug dose is multiplied by a factor of S/d and then raised to 3/2. The steady-state expression of the performance index is:

J0=p0+Su0d3/2 (3)

where J0, p0, and u0 are the steady-state values of J, p, and u, respectively. The minimum of this performance index gives the minimum tumor volume that can be obtained by using the minimum drug dose; these values are found from the steady-state properties of the system given in (1) by calculating its equilibria corresponding to a constant drug dose, u0. By setting left-hand sides of the state equations in (1) to zero, an equilibrium at p0 = q0 = 0 is obtained, which is not an admissible point [26], and:

p0=q0=bSc0d3/2, c0=hmu0. (4)

This equilibrium point analysis reveals some important properties of the system given in (1). First, it is clear that the tumor volume is equal to the carrying capacity at steady-state. It is also clear that an uninterrupted or a long-term therapy is needed to prevent the growth of the tumor. By selecting the value of the parameter related to PD as s = 0.8, and by setting the PK parameters m = h = 1, which is a case often considered in the literature [33], and finally, by using the system parameter values taken from [31] and given in Table 1, respective equilibria of the tumor volume and the carrying capacity are found as p0 = q0 = 17,320 mm3, if the control input u(t) is equal to zero. Figure 2 shows the variation of J0 with respect to the steady-state values of u(t), denoted u0, and Figure 3 shows the variation of J0 with respect to the steady-state values p(t) and q(t), denoted by p0 and q0 for selected parameter values.

Table 1.

Parameter Values [31].

Parameter Value Unit
α 1.08 [day]−1
d 3.63 × 10−4 [day]−1 [mm]−2
b 0.243 [day]−1
G 1.3 [day]−1 [conc.]−1

Figure 2.

Figure 2

Variation of the steady-state performance index, J0, with respect to the steady-state drug dose, u0.

Figure 3.

Figure 3

Variation of the steady-state performance index, J0, with respect to the steady-state values of the tumor volume, p0, and the carrying capacity, q0.

The minimum of the curves in Figure 2 and Figure 3, i.e., the optimum values of the variables, are found to be:

J*=12,247 [mm]3p*=q*=6118 [mm]3u*=0.1169 [conc.]. (5)

Considering the results of the analysis given above, the control objective can be more precisely defined as driving q(t) to its optimum value, q*. Since the tumor volume is equal to the carrying capacity of the vascular network at steady-state, this necessarily means that the tumor volume, p(t), will also be driven to q* = p* by using the minimum drug dose, if the control objective is achieved.

3. Control Design

In this section, two nonlinear optimal backstepping controllers are presented. The first controller encapsulates an exact-model knowledge controller that ensures exponential tracking of a desired optimal tumor volume under the assumption that all parameters in the system model are known. The second controller, on the other hand, is an adaptive controller that supports the practical reality that the parameters are unknown and provides asymptotic tracking.

3.1. Exact Model Knowledge Controller

Assuming all parameters in the tumor model are known, a complete control scheme is shown in Figure 3. The tracking controller uses feedback to drive the tumor volume to a desired, optimal point, qd. That optimal point, qd, is known a priori from the static optimization summarized in (5). A tracking controller shown in Figure 4 is needed that moves the tumor system towards this optimum value.

Figure 4.

Figure 4

A block diagram representation of the developed tumor minimization technique.

To quantify the performance of the exact model tracking knowledge controller to be designed, an error signal can be defined as:

e1=qq*. (6)

Differentiating and substituting from (1) yields the error dynamics:

e˙1=bqdp2/3qGscq. (7)

This equation lacks a control input to be manipulated to stabilize the error variable; the actual control input appears in the last state equation given in (1). In such cases of coupled subsystems, the backstepping technique [34] provides a tool to design a control input signal that is propagated through the coupled subsystems. To apply this procedure, a virtual control input, cd(t), is added and subtracted to the right-hand side of (7) as:

e˙1=bqdp2/3qScqScdq+Scdq. (8)

In practice, cd(t) is the desired trajectory for the concentration of the inhibitor. A new error variable, e2(t), is defined to quantify the difference between the actual concentration of the inhibitor and the desired concentration of the inhibitor as:

e2=ccd (9)

Temporarily ignoring the last two terms in (9), a desired trajectory for the concentration of the inhibitors, that would force e1(t) towards zero, can be designed as:

cd=1Sqbqdp2/3q+k1e1 (10)

where k1 is a positive control gain. Substituting the proposed trajectory yields the closed-loop dynamics for e1(t) as:

e˙1=k1e1Sqe2. (11)

Investigating the e2(t) dynamics yields:

e˙2=c˙c˙d=mc+huddt1Sqbqdp2/3q+k1e1=Wθ+hu (12)

where

W=c23p2/31pqk1qe2k12e1 (13)

is a 1-by-4 regression vector containing measurable variables and known gains, and

θ=mαdSS1T (14)

is a 4-by-1 vector containing the parameters. The actual control input, the concentration of angiogenic inhibitor, can be designed as:

u=1hk2e2Wθ+Sqe1 (15)

where k2 is a positive control gain, which renders:

e˙2=k2e2+Sqe1 (16)

Remark 1.

The above approach means that q(t) will be controlled directly, and that p(t) is indirectly controlled in the sense that it follows q(t) towards an equilibrium. From (1) and Assumption 1, it is evident that p˙(t)0 when p(t)q(t), thus p(t) decreases. If p(t)<q(t), then p(t) will increase until p(t)=q(t). It will start to decrease again if p(t)q(t). Therefore, p(t) is bounded as long as q(t) is bounded.

Theorem 1.

For the tumor growth model given in (1), the dose of the angiogenic inhibitor applied according to (15) ensures that the concentration of the inhibitor exponentially follows its trajectory, cd(t), in order for the carrying capacity, q(t), of the vascular network to reach the constant value, q*, exponentially fast. In other words, e1 goes to zero exponentially fast. It also guarantees that all signals in the closed-loop system are bounded.

Proof 1.

Consider the following nonnegative Lyapunov function:

V1=12e12+12e22. (17)

Taking the time derivative and then substituting the closed-loop dynamics of e1 and e2, given by (11) and (16), respectively, yields:

V˙1=k1e12k2e22. (18)

By considering (17) and (18) together, one can write:

V1=V1(t0)expηt,η+ (19)

where V1(t0) is the initial condition of V1(t) and exp{·} is the base of the natural logarithm. This means that V1(t) and its components, e1(t) and e2(t), go to zero exponentially. According to (6), if e1(t) goes to zero, then the carrying capacity, q(t), is bounded, i.e., q(t)L. From Remark 1, p(t)L; therefore, cd(t)L. From (9), it can be concluded, c(t)L. Finally, from (15), u(t)L.

The following simulation is presented to illustrate the performance and feasibility of the proposed controller applied to the tumor volume problem defined in this section. Note that the approach used to design this exact model controller will be expanded to account for parameter uncertainty in the following section. The simulation parameter values were provided in Section 2. Figure 5 shows the time variation of the error between the actual and optimum carrying capacity, defined in (6)—it goes to zero exponentially, as claimed. Practically, this means that the actual value of the carrying capacity of the vascular network goes to its optimum value, 6118 mm3, if the dose of the angiogenic inhibitors is applied to the tumor, as in Figure 6. This figure also demonstrates that the required dose of the anti-angiogenic agents is bounded. Finally, Figure 7 illustrates that the tumor volume follows the carrying capacity to reach its optimum value at steady-state. Values of the control gains were selected as k1 = 0.1 and k2 = 10 for this simulation. Initial values were assigned as p(t0) = 12,000 mm3 and q(t0) = 14,000 mm3. This approach is now extended to account for parameter uncertainty in the vector in (14).

Figure 5.

Figure 5

Variation of the tracking error, e1(t).

Figure 6.

Figure 6

Variation of the dose of the angiogenic inhibitors, u(t).

Figure 7.

Figure 7

Variation of the tumor volume, p(t).

3.2. Adaptive Controller

Determination of the “exact” values of the system parameters b, d, and S, which appear in the carrying capacity dynamics, for a specific patient is a very difficult and time-consuming task. The biological experiments that would be required to measure the exact values of the parameters for each patient would be costly, may delay the start of treatment, and would likely ultimately fail because of the uncertainty in measuring such a complex biological system. A more realistic and clinically feasible approach is to achieve the control objective, to minimize the tumor volume, p(t), by using an optimum dose of angiogenic inhibitors, u(t), despite measurement uncertainties in tumor growth model parameters. To end this, an estimate of the performance index given in (2) is defined, denoted by J^(t), as:

J^=p+S^cd^3/2 (20)

where S^(t),d^(t) are the estimates of the parameters S and d, respectively. Such a definition reveals an important issue with the control problem definition; the control problem will no longer be a set point problem, i.e., the desired trajectory for the carrying capacity will not be a fixed point, q*. Instead, the desired carrying capacity will be a time-varying trajectory as knowledge about the model parameters evolves.

Figure 8 shows an outline of the solution and indicates the three key components. First, the calculation of the performance index given in (20) requires the individually estimated values of the system parameters; a convergent estimation scheme is proposed to find the estimates of these parameters. Specifically, a least-squares estimation technique is adopted to generate the estimates of the unknown constant parameters. Second, an adaptive controller is proposed so that the carrying capacity of the vascular network follows a time-varying desired optimum trajectory qd(t), that is q(t)qd(t) as t. Third, the desired trajectory, qd(t), is generated dynamically and online, using a numerical optimization method to minimize the performance index given by (20), such that qd(t)q* where q* is the optimum value of q(t) at steady-state.

Figure 8.

Figure 8

A block diagram representation of the developed adaptive tumor minimization technique.

3.2.1. Least-Squares Parameter Estimator

The least-squares estimation technique is used in many types of parameter estimation schemes. The main idea behind the technique is to extract the maximum information about the unknown parameters by using the measurable quantities in the system. Since the tumor volume, carrying capacity, and the concentration of the inhibitors are assumed to be measurable, information about the unknown parameters can be extracted as explained in the following.

To facilitate the estimator development, the q-dynamics given in (1) are parameterized as:

Q=Weθe (21)

where Q denotes q˙(t),

We(t)qp2/3qcq1×3 (22)

is a measurable regression vector, and

θe=bdST3 (23)

is a vector of unknown parameters. Such a parameterization allows the design of an adaptive estimation rule for the unknown parameters, given in (23), through the known quantities found in (22). To further facilitate the estimator design, a prediction error ε(t) is defined as:

εQfQ^f (24)

in which Qf(t) is a filtered signal defined in the form of:

Q˙fβQf+βQ ; Qf(t0)=0 (25)

where β is a positive constant. It should be noted that (25) cannot be implemented directly since Q(t) is not measurable; however, an implementable form of this signal is provided in Appendix A. Q^f(t) is the estimate of Qf(t) and is defined as:

Q^fWfθ^e (26)

where Wf(t)1×3 is a filtered regression vector expressed as:

W˙fβWf+βWe ; Wft0=01×3 (27)

and 01×3 denotes a 1-by-3 vector of zeros. In (26), θ^e=b^d^S^T3 is the estimate vector of unknown parameters. Substituting (21) into (25) yields:

Q˙f+βQf=βWeθe. (28)

The last expression can be rewritten as:

Q˙f+βQf=W˙fθe+βWfθe (29)

where (27) was used. After taking the time derivative of (26), and then adding and subtracting the term W˙fθ^e to the right-hand side of the resulted expression, the following expression will be obtained:

Q^˙f+βQ^f=ddtWfθ^e+βWfθ^e (30)

where (26) and (27) were used. After subtracting (30) from (29), and utilizing (24) and (27), the resulting expression can be written as:

ε˙+βε=ddtWfθ˜e+βWfθ˜e (31)

where θ˜e3 is the estimation error signal, defined as:

θ˜eθeθ^e. (32)

From (31), it can be shown that a mathematically useful, but unrealizable form of the prediction error ε(t) given in (24) can be written as [35]:

ε=Wfθ˜e. (33)

Based on the subsequent analysis, the following continuous least-squares update law θ^˙e3 is employed for estimating the unknown parameters:

θ^˙eΓWfTε (34)

where Γ(t)3×3 is the least-squares estimation gain matrix which is designed as:

Γ˙1WfTWf. (35)
Remark 2.

If Q(t) is bounded, from (25), it can be seen thatQf(t),Q˙f(t)L.Similarly, ifWe(t)L,is bounded, from (27), it can be seen thatWf(t),W˙f(t)L [35].

Remark 3.

It should be noted that ifΓ1t0is selected to be positive definite and symmetric, thenΓt0is also positive definite and symmetric. Therefore, it follows that bothΓ1tandΓtare positive definite and symmetric. The following expression can be obtained from (35):

Γ˙=ΓWfTWfΓ. (36)

It can be easily seen from (36) thatΓ˙tis negative semidefinite; therefore,Γtis always constant or decreasing. Hence, it follows thatΓtis bounded [34,36].

Theorem 2.

The update law defined in (34) ensures thatθ˜e0ast, provided that the following Persistency of Excitation condition [36] holds:

κ1I3t0to+δWfTτWfτdτκ2I3 (37)

where κ1,κ2,δ are positive constants and I3 is a standard 3-by-3 identity matrix.

Proof 2.

See Appendix B. □

3.2.2. Adaptive Controller Design

The parameter estimates, θ^e(t), are ultimately used to generate the desired trajectories; that is, the tracking objective for the control system. The current challenge is to now create a tracking controller for a system with uncertain parameters—this suggests an adaptive controller solution. To proceed with the development of an adaptive control law to achieve the control objective, we again consider c(t) as the virtual control input and define the error variables to rewrite the error dynamics as:

ea1=qqd (38)
ea2=ccd. (39)

As stated before, cd(t) is the desired optimal trajectory for the concentration of the inhibitors. Note that q-dynamics can be rewritten as:

A1q˙=A1bqA1dp2/3qcq=W1θ1cq (40)

where A11/S, W1=qp2/3q1×2 is a 1-by-2 regression vector containing measurable variables and θ1=A1bA1dT2 is a 2-by-1 vector containing the uncertain parameters. After substituting (39) into (40), the following expression is obtained:

A1q˙=W1θ1ea2qcdq. (41)

After taking the time-derivative of (38) and multiplying both sides of the resulting expression by A1, the following expression will be obtained:

A1e˙a1=W2θ2ea2qcdq (42)

where (41) was utilized. In (42), W2=W1q˙d1×3 is a 1-by-3 regression vector containing measurable variables and θ2=θ1TA1T3 is a 3-by-1 vector containing the uncertain parameters. Then, the desired trajectory for the concentration of the inhibitors can be designed as:

cd=1qW2θ^2+ka1ea1 (43)

in which ka1 is a positive control gain. In (43), θ^2(t)3 is an estimate of the constant vector, θ2. A parameter estimation error vector can be defined to quantify estimation performance as:

θ˜2=θ2θ^2. (44)

Then the final dynamics for ea1 will be:

A1e˙a1=ka1ea1ea2q+W2θ˜2. (45)

Following the same procedure, i.e., dividing both sides of the c-dynamics given in (1) by h and then substituting the results into the time derivative of (39), one can write:

A2e˙a2=W3θ3+u (46)

where A2h1, W3=cc˙d1×2 is a 1-by-2 regression vector containing measurable variables and θ3=mA2A2T2 is a 2-by-1 vector containing the uncertain parameters. Based on the subsequent stability analysis and the control input, the concentration of angiogenic inhibitors, can be designed as:

u=W3θ^3ka2ea2+ea1q (47)

where ka2 is a positive control gain and θ^3(t)2 is an estimate of the constant vector θ3, which renders:

A2e˙a2=ka2ea2+qea1+W3θ˜3 (48)

where

θ˜3=θ3θ^3. (49)
Theorem 3.

For the tumor growth model given in (1), the concentration of the angiogenic inhibitors proposed in (47) ensures that the carrying capacity of the vascular network follows a desired trajectory, qd(t), despite uncertainty about the values of parameters in the tumor dynamics with update laws:

θ^˙2γ1W2Tea1θ^˙3γ2W3Tea2 (50)

where γ1,γ2 are positive constants. In other words, ea1 and ea2 go to zero. It also guarantees that all signals in the closed-loop system are bounded.

Proof 3.

See Appendix C. □

3.2.3. Optimum Trajectory Generation

The desired carrying capacity input to the adaptive controller will be a time-varying trajectory due to lack of knowledge about the model parameters, i.e., the cost function is changed based on parameter updates from the least-squares estimator. The gradient descent algorithm, also known as steepest descent, is a first-order optimization algorithm to minimize a function. For a function defined by a set of parameters, the gradient descent algorithm starts with an initial set of parameter values and then, by taking steps proportional to the negative of the gradient of the function, reaches the set of parameter values that minimizes the function. In general, it is considered as one of the simplest optimization algorithms. It is used in this overall approach to determine an optimum trajectory for the carrying capacity.

The desired trajectory, qd(t), is needed as the input to the adaptive controller. This continuous optimum trajectory is designed to minimize the performance index given in (20), where the estimates of parameters S and d, obtained as described in Section 3.2.1, are utilized. For the minimization of the estimate of the performance index, a gradient descent algorithm is employed, which guesses the optimum value q¯d[n] at each time step of the algorithm [10]. The output of the algorithm, q¯d[n], is passed through a second-order, stable, and proper low-pass filter to generate the continuous and bounded signals qd(t) and q˙d(t). The following filters are utilized:

qd(t)=ς1ς2s2+ς3s+ς4q¯d[n] (51)
q˙d(t)=sς1ς2s2+ς3s+ς4q¯d[n] (52)

where ς1, ς2, ς3, ς4 are positive filter constants and n is a positive integer that represents the iteration step of the algorithm. At step n, the optimum trajectory holds the output, q¯d[n], constant until the response of the closed-loop system, q(t), has reached a steady-state near qd(t). A new target optimum, q¯d[n+1], is then issued. In other words, the algorithm waits for certain thresholds to be satisfied before it proceeds to the next iteration. For instance, if q(t)qd(t)e¯1, q¯d[n]qd(t)e¯2, and q(t)p(t)e¯3, then n = n + 1, where e¯1, e¯2, e¯3 are threshold constants. Furthermore, the desired trajectory can be concluded to have converged when the gradient of J^(t), with respect to q(t), is within a certain threshold. Once qd(t) has reached the termination threshold, the optimization algorithm stops updating q¯d[n]. As the performance index approaches its minimum value, the desired trajectory qd(t) and u(t) approach q^* and u*, respectively. q^*, u* are the estimates of the optimum values of q(t) and u(t), respectively, that result from the optimum seeking algorithm. As mentioned earlier, at steady-state p(t)=q(t); therefore, p(t)pd(t)p* as q(t)qd(t)q*, where pd(t)=qd(t) and p^*=q^*. Then, p^* is the estimated optimum tumor volume that can be realized by applying the estimated optimum drug dose, u^*.

4. Simulation Results

A numerical simulation study was conducted to evaluate the proposed tumor treatment optimization technique using the MATLAB/Simulink environment. It should be noted that the least-squares estimator developed in Section 3.2.1, adaptive controller designed in Section 3.2.2, and the optimization algorithm described in Section 3.2.3 were run simultaneously, as shown in Figure 8. The parameter values were taken from [26] and are summarized in Table 1. Initial values were selected as p(t0) = 10,000 mm3 and q(t0) = 12,000 mm3 so that qt0>pt0, i.e., the carrying capacity of the endothelial cells is greater than the tumor volume; thus, the tumor volume is susceptible to an increase in the absence of a proper therapy.

The least-square estimator given in (34) was initialized as θ^et0=0.1θe and the estimation gain matrix was initialized as Γ1t0=10I3. The positive constant β introduced in (25) was set to β=0.05. The adaptive update law was initialized as θ^at0=03, where 03 denotes a 3-by-1 vector of zeros. The positive control gains were set to ka1=10, ka2=5, and γ1=γ2=1×1012. The initial guess, q¯d[n], was selected to be 7500 mm3. Figure 9 shows the least-squares estimate of the unknown vector, θe; it can be seen from this figure that all the parameters are accurately identified.

Figure 9.

Figure 9

Least-squares estimation: (a) b^(t), (b) d^(t), and (c) S^(t).

Figure 10 shows the time evolution of the drug dose, u(t). It can be seen from Figure 10 that u(t) converges to its optimum value u*=0.1169 [conc.].

Figure 10.

Figure 10

The time evolution of the drug dose, u(t).

The time evolution of the tumor volume, p(t), and the carrying capacity of the endothelial cell volume, q(t), are shown in Figure 11 and Figure 12, respectively. It can be seen from these figures that p(t) and q(t) converge to their respective optimum values p*=6118 [mm]3 and q*=6118 [mm]3 given in (5), respectively. It should be noted that if the initial conditions, p(t0) and q(t0), were chosen to be smaller values, then the convergence would have been faster.

Figure 11.

Figure 11

The time evolution of the tumor volume, p(t).

Figure 12.

Figure 12

The time evolution of the tumor volume, q(t).

The time evolution of the estimate of the performance index, J^(t), is shown in Figure 13. It can be seen from Figure 13 that J^(t) converges to J*=12,247 [mm]3.

Figure 13.

Figure 13

Time evolution of the estimate of the performance index, J^(t).

Figure 14 shows the tracking error, ea1(t). It can be seen from the figure that the tracking error, ea1(t), is driven to zero.

Figure 14.

Figure 14

Variation of the tracking error, ea1(t).

Recently, an optimization method has also been proposed to analyze the mathematical model of cancer chemotherapy, which includes anti-angiogenic effects of cytotoxic agents in [37]. Similar to the study in [38], it provides a very useful discussion on modeling and optimization aspects of the problem, but they are open-loop controllers, i.e., both studies try to minimize to tumor volume by using the anti-angiogenic agents without feedback. Some useful methods with state feedback are given in [39], but they lack any optimization algorithm; on the other hand, lack of optimization in [39] leads to a very important advantage of continuous protocols. A very useful controller is given in [40], but it assumes all the system parameters are known. The main benefits of the controller given in existing papers are that it offers a control of the tumor volume and optimization algorithm to the drug dose. However, the parameter estimation scheme creates a disadvantage for the implementation of the control input signal, which is the concentration of the antiangiogenic agents. As seen from Figure 10, time variation of the drug dose has very high chattering. Even if this variation is continuous, a real-world clinical application will be discrete in two ways: drugs are not administrated continuously and the tumor volume is not measured continuously. Therefore, the chattering may affect the performance of the proposed tumor shrinking procedure, according to the selected drug-delivery frequency, especially in the first 6 months of treatment. Effects of continuous and discrete applications of the drug dosing controller has also been discussed in detail in [11].

5. Conclusions

A novel approach for the administration of anti-angiogenic tumor treatment by considering the nonlinear tumor dynamics and drug delivery pharmacokinetics and pharmacodynamics was presented. A performance index was formulated and then minimized to obtain an optimum tumor volume that would be realized; using an optimum drug dose and a nonlinear tracking controller was proposed to drive the system states to this optimum point. It was shown that if all the system parameters are known, the tumor volume can be driven to its optimum value exponentially fast.

The problem is more complicated if the tumor model parameters are unknown; it was shown that the performance index can be estimated, using a least-squares strategy, and the optimum tumor volume trajectory can be generated numerically. The proposed least-squares estimation scheme proves that the estimation errors can be driven to zero, provided that the persistency of excitation condition is satisfied. An adaptive tracking controller then drives the system to this optimum. The proposed adaptive scheme ensures that the tumor volume and the carrying capacity of the vascular network go to their desired values globally and asymptotically. Numerical simulation results were presented to show the performance and feasibility of the proposed estimation and control approaches. The simulations demonstrate that the developed estimation and control strategies successfully minimize the tumor volume, along with the carrying capacity of endothelial cells, with an optimum drug dose, despite of the lack of knowledge about system parameters. It can be concluded from the simulation study that the proposed tumor minimization technique can efficiently reduce the tumor volume with an optimum drug dose.

Appendix A. Implementable Form of the Filtered Signal Qf(t)

In order to obtain an implementable form of (25), an auxiliary filter signal ζ(t) is designed as:

ζ˙βζβ2q ;ζt0=βqt0. (A1)

Furthermore, the filter signal Qf(t) is defined as:

Qfζ+βq. (A2)

After taking the time derivative of (A2), the following expression is obtained:

Q˙f=βζ+βq+βq˙ (A3)

where (A1) was utilized. After substituting (A2) into (A3), the following expression can be obtained:

Q˙fβQf+βQ (A4)

which is the same as (25). Thus, it is clear that (A2) and (A3) can be implemented to obtain Qf(t) without measuring q˙(t).

Appendix B. Proof Details for Theorem 2

Consider the following nonnegative Lyapunov function:

Ve=12θ˜eTΓ1θ˜e. (A5)

Taking its time derivative results in:

V˙e=θ˜eTΓ1θ^˙e+12θ˜eTΓ˙1θ˜e (A6)

where the time derivative of (32) was utilized. After substituting (34) and (35) into (A6), the following expression, the following is obtained:

V˙e=ε2+12ε2 (A7)

where (33) was utilized. This expression can be further simplified as:

V˙e=12ε2. (A8)

After integrating (A8), the following expression is obtained:

12t0ε2τdτ=Vet0Ve (A9)

From (A5) and (A8), it can be concluded that VetL; thus, θ˜etL. From (A9), it is clear that εtLL2. Since θ˜etL, from (32), it follows that θ^etL. Assuming pt, qt, utL (see Proof 3), from (22), it follows that WetL, and from (21), it follows that QtL. Since Qt, We(t)L, from Remark 2, it follows that Qf(t), Q˙f(t), Wf(t), W˙f(t)L. Since Wf(t), ε(t)L, and from Remark 3, Γ(t)L, therefore, from (34), it can be concluded that θ^˙etL; thus, the time derivative of (32) can be utilized to show that θ˜˙etL. Since W˙f(t), θ˜˙etL, the time derivative of (33) can be utilized to show that ε˙tL. Since εtLL2 and ε˙tL, from Barbalat’s Lemma [41], it can be concluded that ε0 as t; thus, Wf(t)θ˜e(t)0 as t. Upon the satisfaction of PE condition [36] given in (37), it can be further concluded that θ˜e0 as t.

Appendix C. Proof Details for Theorem 3

Consider the following nonnegative Lyapunov function:

V2=12A1ea12+12A2ea22+12γ11θ˜2Tθ˜2+12γ21θ˜3Tθ˜3. (A10)

Taking its time derivative and then substituting the dynamics of ea1 and ea2, given by (45) and (48), respectively, then the updates laws given in (50) yields:

V˙2=ea1ka1ea1ea2q+W2θ˜2+ea2ka2ea2+qea1+W3θ˜3γ11θ˜2Tγ1W2Tea1γ21θ˜3Tγ2W3Tea2V˙2=ka1ea12ka2ea22. (A11)

From (A11), the following inequalities can be written:

V˙2ka1ea12 (A12)
V˙2ka2ea22. (A13)

After integrating (A12) and (A13), the following inequalities will be obtained:

k1t0ea12τdτV2t0V2 (A14)
k2t0ea22τdτV2t0V2. (A15)

From (A10) and (A11), it can be concluded that V2tL; hence, ea1t, ea2t, θ˜2t, θ˜3tL. From (A14) and (A15), it is clear that ea1t,ea2tL2. Since qdt is designed to be bounded, from (38), qdtL; thus, from Remark 1, ptL. The fact that θ2 and θ3 are constant vectors and θ˜2t, θ˜3tL, from (44) and (49), it follows that θ^2t, θ^3tL. Since pt, qt, qdtL, it is clear that W2tL. Further, since θ^2tL, therefore, from (43), cdL; thus, from (39), ctL. From (50), it follows that θ^˙2tL. Since cdt is a function of bounded and continuous signals, after taking its time derivative, it follows that c˙dtL; therefore W3L. Now it follows from (50) that θ^˙3tL. From (47), it follows that utL. Since ea1t, ea2tLL2, and from (42) and (46) e˙a1t, e˙a2tL, from Barbalat’s Lemma [41], it can be concluded that ea1t, ea2t0 as t.

Author Contributions

Conceptualization, T.C.B. and R.E.G.; methodology, U.H.; software, I.K.; resources, N.N.; writing—original draft preparation, U.H.; writing—review and editing, T.C.B.; visualization, N.N. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Information on numerical simulations can be provided upon request.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This research received no external funding.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.National Cancer Institute Breast Cancer. [(accessed on 1 June 2021)]; Available online: http://www.cancer.gov/cancertopics/types/breast.
  • 2.National Cancer Institute Understanding Cancer Series: Angiogenesis. [(accessed on 1 July 2019)]; Available online: http://www.cancer.gov/cancertopics/understandingcancer/angiogenesis.
  • 3.Clagsburn M., Soker S. VEGF/VPF: The angiogenesis factor found? Curr. Biol. 1993;3:699–702. doi: 10.1016/0960-9822(93)90073-w. [DOI] [PubMed] [Google Scholar]
  • 4.Folkman J. Angiogenesis: A new concept for therapy of solid tumors. Ann. Surg. 1972;175:409–416. doi: 10.1097/00000658-197203000-00014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Ledzewicz U. Optimal control for a system modeling tumor anti-angiogenesis. Int. J. Autom. Control Syst. Eng. 2006;6:33–39. [Google Scholar]
  • 6.Ledzewicz U., Schaettler H. Application of Optimal Control to a System Describing Tumor Anti-Angiogenesis; Proceedings of the 17th International Symposium on Mathematical Theory of Networks and Systems (MTNS); Minneapolis, MN, USA. 12–15 July 2006; pp. 478–484. [Google Scholar]
  • 7.Ledzewicz U., Schaettler H. A Synthesis of Optimal Controls for a Model of Tumor Growth under Angiogenic Inhibitors; Proceedings of the 44th IEEE Conference on Decision and Control; Seville, Spain. 15 December 2005; pp. 12–15. [Google Scholar]
  • 8.Ledzewicz U. Optimal and suboptimal protocols for a class of mathematical models of tumor anti-angiogenesis. J. Theor. Biol. 2008;252:295–312. doi: 10.1016/j.jtbi.2008.02.014. [DOI] [PubMed] [Google Scholar]
  • 9.Swierniak A., d’Onofrio A., Gandolfi A. Control Problems Related Tumor Angiogenesis; Proceedings of the IEEE Industrial Electronics; Paris, France. 6–10 November 2006; pp. 677–681. [Google Scholar]
  • 10.Nath N., Burg T.C., Dawson D.M., Iyasere E. Optimizing Anti-Angiogenic Therapy for Tumor Minimization; Proceedings of the 2010 American Control Conference; Baltimore, MD, USA. 30 June–2 July 2010; pp. 1242–1247. [Google Scholar]
  • 11.Hasirci U., Burg T.C., Groff R.E. Closed-Loop Nonlinear Smooth Robust Control of Anti-Angiogenic Tumor Therapy; Proceedings of the 2013 American Control Conference; Washington, DC, USA. 17–19 June 2013; pp. 2301–2306. [Google Scholar]
  • 12.Hasirci U., Burg T.C., Groff R.E. Closed-Loop Nonlinear Adaptive Control of Anti-Angiogenic Tumor Therapy; Proceedings of the 2013 9th Asian Control Conference (ASCC); Istanbul, Turkey. 23–26 June 2013; pp. 1–6. [Google Scholar]
  • 13.Roman R.C., Precup R.E., Petriu E.M. Hybrid data-driven fuzzy active disturbance rejection control for tower crane systems. Eur. J. Control. 2021;58:373–387. doi: 10.1016/j.ejcon.2020.08.001. [DOI] [Google Scholar]
  • 14.Chi R., Li H., Shen D., Hou Z., Huang B. Enhanced P-type control: Indirect adaptive learning from set-point updates. IEEE Trans. Autom. Control. 2022 doi: 10.1109/TAC.2022.3154347. [DOI] [Google Scholar]
  • 15.Qi Z., Shi Q., Zhang H. Tuning of Digital PID Controllers Using Particle Swarm Optimization Algorithm for a CAN-Based DC Motor Subject to Stochastic Delays. IEEE Trans. Ind. Electron. 2020;7:5637–5646. doi: 10.1109/TIE.2019.2934030. [DOI] [Google Scholar]
  • 16.Luo Q., Nguyen A.T., Fleming J., Zhang H. Unknown Input Observer Based Approach for Distributed Tube-Based Model Predictive Control of Heterogeneous Vehicle Platoons. IEEE Trans. Veh. Technol. 2021;70:2930–2944. doi: 10.1109/TVT.2021.3064680. [DOI] [Google Scholar]
  • 17.Shi Q., Zhang H. Fault Diagnosis of an Autonomous Vehicle with an Improved SVM Algorithm Subject to Unbalanced Datasets. IEEE Trans. Ind. Electron. 2021;68:6248–6256. [Google Scholar]
  • 18.Ledzewicz U., Liu Y., Schattler H. The Effect of Pharmacokinetics on Optimal Protocols for a Mathematical Model of Tumor Anti-Angiogenic Therapy; Proceedings of the American Control Conference; St. Louis, MO, USA. 10–12 June 2009; pp. 1060–1065. [Google Scholar]
  • 19.Agur Z., Arakelyan L., Daugulis P., Ginosar Y. Hopf point analysis for angiogenesis models. Disrete Cont. Dyn. Sys. B. 2004;4:29–38. doi: 10.3934/dcdsb.2004.4.29. [DOI] [Google Scholar]
  • 20.Davis S., Yancopoulos G.D. The angiopoietins: Yin and Yang in angiogenesis. Curr. Top. Microbiol. Immunol. 1999;237:173–185. doi: 10.1007/978-3-642-59953-8_9. [DOI] [PubMed] [Google Scholar]
  • 21.Boehm T., Folkman J., Browder T., O’Reilly M. Anti-angiogenic therapy of experimental cancer does not induce acquired drug resistance. Nature. 1997;390:404–407. doi: 10.1038/37126. [DOI] [PubMed] [Google Scholar]
  • 22.Anderson A., Chaplain M. Continuous and discrete mathematical models of tumor induced angiogenesis. Bull. Math. Bio. 1998;60:857–859. doi: 10.1006/bulm.1998.0042. [DOI] [PubMed] [Google Scholar]
  • 23.Arakelyan L., Vainstain V., Agur Z. A computer algorithm describing the process of vessel formation and maturation and its use for predicting the effects of anti-angiogenic and anti- maturation therapy on vascular tumor growth. Angiogenesis. 2002;5:203–214. doi: 10.1023/a:1023841921971. [DOI] [PubMed] [Google Scholar]
  • 24.Ramanujan S., Koenig G.C., Padera T.P., Stoll B.R., Jain R.K. Local imbalance of prangiogenic and anti-angiogenic factors: A potential mechanism of focal necrosis and dormancy in tumors. Can. Res. 2000;60:1442–1448. [PubMed] [Google Scholar]
  • 25.De Angelis E., Preziosi L. Advection-diffusion models for solid tumour evolution in vivo and related free boundary problem. Math. Model. Methods Appl. Sci. 2000;10:379–407. [Google Scholar]
  • 26.Jackson J.L. Vascular tumor growth and treatment: Consequences of polyclonality, competition and dynamic vascular support. J. Math. Biol. 2002;44:201–226. doi: 10.1007/s002850100118. [DOI] [PubMed] [Google Scholar]
  • 27.Breward C.J.W., Byrne H.M., Lewis C.E. A multiphase model describing vascular tumour growth. Bull. Math. Biol. 2003;65:609–640. doi: 10.1016/S0092-8240(03)00027-2. [DOI] [PubMed] [Google Scholar]
  • 28.Ledzewicz U., Schattler H., d’Onofrio A. Optimal Control for Combination Therapy in Cancer; Proceedings of the IEEE International Conference Decision and Control; Cancun, Mexico. 9–11 December 2008; pp. 1442–1448. [Google Scholar]
  • 29.Hahnfeldt P., Panigrahy D., Folkman J., Hlatky L. Tumor development under angiogenic signaling: A dynamical theory of tumor growth, treatment response, and postvascular dormancy. Can. Res. 1999;59:4770–4775. [PubMed] [Google Scholar]
  • 30.Ergun A., Camphausen K., Wein L.M. Optimal scheduling of radiotherapy and angiogenic inhibitors. Bull. Math. Biol. 2003;65:407–424. doi: 10.1016/S0092-8240(03)00006-5. [DOI] [PubMed] [Google Scholar]
  • 31.D’Onofrio A., Gandolfi A. Tumor eradication by anti-angiogenic therapy: Analysis and extensions of the model by Hahnfeldt et al. (1999) Math. Biosci. 2004;191:159–184. doi: 10.1016/j.mbs.2004.06.003. [DOI] [PubMed] [Google Scholar]
  • 32.Ledzewicz U., Maurer H., Schattler H. Recent Advances in Optimization and its Applications in Engineering. Springer; Berlin, Germany: 2010. Minimizing tumor volume for a mathematical model of anti-angiogenesis with linear pharmacokinetics; pp. 267–276. [Google Scholar]
  • 33.Ledzewicz U., Schattler H. The influence of PK/PD on the structure of optimal controls in cancer chemotherapy models. Math. Biosci. Eng. 2004;2:561. [PubMed] [Google Scholar]
  • 34.Krstic M., Kanellakopoulos I., Kokotovic P. Nonlinear and Adaptive Control Design. John Wiley and Sons; New York, NY, USA: 1995. [Google Scholar]
  • 35.Dawson D.M., Hu J., Burg T.C. Nonlinear Control of Electric Machinery. Marcel Dekker Inc.; New York, NY, USA: 1998. [Google Scholar]
  • 36.De Queiroz M., Dawson D., Nagarkatti S., Zhang F. Lyapunov-Based Control of Mechanical Systems. Birkhauser; Boston, MA, USA: 1999. [Google Scholar]
  • 37.Ledzewicz U., Schattler H. The structure of optimal protocols for a mathematical model of chemotherapy with antiangiogenic effects. SIAM J. Control Optim. 2022;60:1092–1116. doi: 10.1137/21M1395326. [DOI] [Google Scholar]
  • 38.Moustafid A. Set-valued analysis of anti-angiogenic therapy and radiotherapy. Math. Model. Numer. Simul. Appl. 2022;29:187–196. [Google Scholar]
  • 39.Moustafid A. General anti-angiogenic therapy protocols with chemotherapy. Int. J. Math. Model. Comput. 2021;11:1–14. [Google Scholar]
  • 40.Ledzewicz U., Schättler H. Combination of antiangiogenic treatment with chemotherapy as a multi-input optimal control problem. Math. Methods Appl. Sci. 2022;45:3058–3082. [Google Scholar]
  • 41.Ioannou P.A., Sun J. Robust Adaptive Control. Prentice Hall; Upper Saddle River, NJ, USA: 1996. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Information on numerical simulations can be provided upon request.


Articles from Biomedicines are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES