Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2025 Jul 12;15:25229. doi: 10.1038/s41598-025-07227-8

Maximum likelihood inference for multivariate delay differential equation models

Ahmed Adly Mahmoud 1, Abdalla Rabie 1, Sarat Chandra Dass 2, Ohud A Alqasem 3, Getachew Tekle Mekiso 4,, Eslam Hussam 5,6, Ahmed M Gemeay 7
PMCID: PMC12255705  PMID: 40651986

Abstract

The maximum likelihood inference framework for delay differential equation models in the multivariate settings is developed. The number of delay parameters is assumed to be one or more. This study does not make any restrictive assumptions on the form of the underlying delay differential equations which was one of the limitations of some of the previous work. Thus, the maximum likelihood inference framework can be applied to general delay differential equation models with multiple delay parameters. To obtain the maximum likelihood estimator and estimate of the information matrix, two numerical algorithms are developed: (i) the adaptive grid and (ii) the gradient descent algorithms. Two examples of multivariate delay differential equation models related to the epidemic and pharmacokinetic models, respectively, are presented in this paper. For the unknown parameters, standard errors and confidence intervals are constructed, and formulas and techniques for producing the information matrix are developed. The code and computations are developed with the help of the mathematical software MATLAB.

Keywords: Delay differential equation (DDE), Delay differential equation models (DDEMs), Delayed pharmacokinetic models, Delayed susceptible-infective-recovered (SIR) model, Maximum likelihood estimation (MLE)

Subject terms: Applied mathematics, Software, Statistics

Introduction

Many researchers have incorporated various types of time delays into biological models to represent the regeneration times of resources, periods of maturation, feeding times, response times, and more; see, for examples,16. Also, delays are widespread in pharmacokinetic and pharmacodynamics studies in the form of absorption delay, delayed drug response, etc. see714. Numerous delay differential equation models (NDDEMs) are proposed by investigators according to their understanding of the underlying dynamical system. In such systems, the unknown parameters must be estimated based on actual observations from the experiment. Some research works on various parameter estimation techniques for dynamical system is available in the literature; see1519. However, only a few methods in the statistical literature have been proposed to estimate and infer parameters in delay differential equation models (DDEMs), see2026, albeit in a univariate setting. In the statistical literature, there aren’t a lot of methods for parameter estimation and inference for DDEMs in multivariate setting.

We present a review of parameter inference methods for DDEMs that have been reported in the literature for the multivariate case. Murphy27 developed parameter estimation algorithm to estimate unknown time delays and other parameters (e.g., initial condition) appearing within a nonlinear nonautonomous functional differential equation. The unknown parameters are estimated within the approximating systems by minimizing a least squares fit-to-data criterion. Murphy assumed that the model equation is a functional differential equation of the general form:

graphic file with name 41598_2025_7227_Article_Equ1.gif 1

where Inline graphic, Inline graphic denotes the function Inline graphic where Inline graphic varies over Inline graphic and Inline graphic represents a vector of parameters occurring in the model equation. Any of the parameters Inline graphic, Inline graphic or Inline graphic might be unknowns. If the delay is explicitly time independent, it is function Inline graphic that will be unknown, see27. Murphy introduced a full discretization approach where he uses linear splines to describe solution and delay functions. The problem then is treated as a very large minimization problem.

The two-step method relies on the estimation of derivatives of the underlying ODEs from the data. Many researchers suggested the two-step approach: In the first step, the first order derivative of the ODE is estimated from the observations in2834. It is then treated as a response variable in the second step where estimation of the parameters is carried out. In the second step, the ODE parameters are estimated using a standard nonlinear least squares method, where the estimation of Inline graphic is now obtained from the first step.

Bünner et al.19 studied the special case of DDEMs whose underlying delay differential equation (DDE) is of the form

graphic file with name 41598_2025_7227_Article_Equ2.gif 2

where Inline graphic is the dynamic process on Inline graphic and Inline graphic is a constant delay parameter. Bünner et al. introduced a method to estimate Inline graphic from time series of the observation process (1.2) in the special case of Inline graphic. They take advantage of the fact that Inline graphic at time point Inline graphic as Inline graphic. Next, they infer the time delay using the value that gives the smoothest graph of Inline graphic versus Inline graphic. Their method amounts to the two-step method with an approximation of the derivative by Inline graphic.

Ellner et al.25 unified the approaches which have been introduced in20,21 and extended them to more realistic cases, in which the data have measurement errors. They used nonparametric smoothing methods to estimate the derivative of a univariate DDEM from noisy data that is presumed to be additive. see35. From the fitting of a generalized additive model, they then infer the constant delay parameter, τ. Even though Ellner’s method combines earlier research, it can only be used with DDEMs that satisfy the presumptive additive form.

A version of two-step method has been utilized to estimate certain types of DDE models with time varying coefficient whereas Siamak et al.36,37 presented an estimation method according to Least Squares Support Vector Machines (LS-SVMs), which, in deterministic parameter-affine DDEMs, transforms the solution of the differential equations (DEs) into an optimization of a set of algebraic equations for each of approximating constant and time-varying parameters. However, neither confidence intervals nor standard errors of estimations are given.

Wood38 devised spline-based model fitting methodologies for scenarios where the DDEMs are partially defined with noisy data for modeling ecological population dynamics. Wood considered a partially specified predator–prey model with Inline graphic being an unknown function, is given by the following set of equations:

graphic file with name 41598_2025_7227_Article_Equ3.gif 3

where Inline graphic and Inline graphic denote the predator and prey population size respectively, Inline graphic and Inline graphic are the derivatives of Inline graphic and Inline graphic with respect to the time Inline graphic respectively, Inline graphic, Inline graphic, Inline graphic are parameters, Inline graphic is the delayed prey population size and Inline graphic is the time delay. The model parameters are estimated by minimizing the distance between the observed data and the numerical solution of the DDE given a nonparametric spline estimate of Inline graphic and other parameters Inline graphic, Inline graphic and Inline graphic. This is a very difficult optimization problem since the DDE numeric solutions not only depend on the parameter values, but also on the history of the dynamic process, which is essentially an infinite-dimensional optimization problem. Because the cross validation and the estimations of the unknown parameters are needed to choose the smoothing coefficients linked to the penalty term, the spline-based approach has significant computing costs.

Cangelosi and Hooten39 utilized a fourth-order Runge–Kutta (RK4) approximation to the system of differential equations in conjunction with Markov chain Monte Carlo (MCMC) methods to implement the formal statistical model where RK4 is a useful approximation, well known for its accuracy, efficiency, robustness, and applicability to dynamical processes of any finite dimension. They proposed MCMC to estimate the parameters in the Lotka-Volterra (LV) model but assuming the data comes from a truncated normal distribution with the mean function being the solution of the DDE.

Also, Calderhead et al.40 proposed a Bayesian approach based on Gaussian processes (GP) to estimate DDE parameters, see41, which also requires repeatedly solving DDEs numerically when sampling for values of DDE parameters. They used GP to predict the state variables of the model as well as their derivatives, thus avoiding the need to solve the system explicitly.

Based on the maximum likelihood (ML) inference framework, we examine the estimation and inference of parameters for multivariate DDEMs that incorporate multiple delays. ML estimators are efficient estimator which is used to estimate the unknown parameters (fixed as well as random) of parameterized probability density functions.

Properties of MLEs are well understood and exhibit good behavior. Fisher placed maximization of the likelihood function on a sound footing under the name of the method of maximum likelihood which achieved widespread popularity because of its properties in the theory of estimation, Its mathematical basis has been extensively studied, see42,43. Berk44,45 takes a Bayesian approach and mentions in passing the information theoretic interpretation of maximum likelihood estimation (MLE). For large sample sizes, Huber46 presents common conditions under which the MLE is guaranteed to give the accurate values for the parameters that are unknown and he provides very general conditions, building on those of Wald47 under which the ML estimator converges to a well-defined limit, even when the probability model is not correctly specified. Huber’s limit is identical to that of Berk but, Huber does not explicitly discuss the information theoretic interpretation of this limit. This interpretation has been emphasized by Akaike48, who has observed that the ML estimator is a natural estimator for the parameters when the true distribution is unknown. The ML estimator is a natural estimator for the parameters which minimize the Kullback–Leibler49 Information Criterion (KLIC).

Generally, the parameters are often unknown in a DDE, and it is important to estimate these parameters based on observed data. A delay differential equation model is a statistical model that incorporates the observational process over the underlying DDE. As was previously mentioned, there were not many methods offered for parameter estimation and inference from DDEMs in the statistical literature.

In this paper, we use MLE technique to infer unknown parameters in DDEMs. To obtain the MLE, we develop the adaptive grid and gradient descent methods in a multivariate setting. The remainder of the paper is organized as follows. Sect. “The mathematical model” defines the mathematical model for DDEMs in a multivariate setting and presents two examples. The MLE technique for DDEMs and the associated numerical procedures are described in Sect. “Proposed methodology” Based on the outcomes of the simulation, Sect. “Numerical solution and results” resents the results and discussion based on the suggested methodology.

The mathematical model

A model of the DDE with multiple delays equals, Inline graphic as noisy realizations from an underlying DDE:

graphic file with name 41598_2025_7227_Article_Equ4.gif 4

where Inline graphic and Inline graphic is a vector of error variables where it is presumed that every component comes from a normal distribution with mean equals to zero and Inline graphic where Inline graphic is unknown standard deviation, i.e., Inline graphic. In (4), Inline graphic is the solution, Inline graphic, of the DDE

graphic file with name 41598_2025_7227_Article_Equ5.gif 5

calculated at the Inline graphic time points, Inline graphic; in (5), Inline graphic and Inline graphic where Inline graphic is the Inline graphic-th delay term with Inline graphic, where Inline graphic is the delay parameter, Inline graphic and Inline graphic are other parameters of concern that control the trajectories of the underlying DDE in (5). Equations (4) and (5) construct a multivariate DDEM in the most comprehensive form. In a DDEM, the parameters Inline graphic and Inline graphic are unknown and should be estimated according to observations Inline graphic Inline graphic

The observation Inline graphic at the Inline graphic-th sampled time point, Inline graphic, with Inline graphic is obtained. The function Inline graphic on Inline graphic has a complete trajectory which is determined by (5) based on an initial condition function Inline graphic where Inline graphic, Inline graphic and Inline graphic is chosen to be

graphic file with name 41598_2025_7227_Article_Equ6.gif 6

which is also unknown besides Inline graphic and Inline graphic.

For prescribed values of Inline graphic, Inline graphic and Inline graphic, where Inline graphic, we notice that the solution Inline graphic is a function of Inline graphic, Inline graphic and Inline graphic; thus, the solution is represented as an explicit function of the unknown quantities Inline graphic, Inline graphic and Inline graphic, that is Inline graphic. According to the observational model (4), the Inline graphic are gathered at the Inline graphic sampled time points Inline graphic.Our objective is to estimate the parameters Inline graphic, Inline graphic and Inline graphic (the variance of noise) based on the observations Inline graphic Note that here Inline graphic is an unknown vector of parameters Inline graphic, but it is actually a nuisance parameter that affects the estimation of the parameters of interest, namely Inline graphic and Inline graphic. The dynamical system properties are determined by Inline graphic and Inline graphic and not Inline graphic.

Examples

As a special case, we consider two examples: The delayed Susceptible-Infective-Recovered (SIR) differential equation model with unknown parameters related to biological systems and the two-compartment model with time delay related to the pharmacokinetic models.

Delayed SIR model

The epidemic delayed SIR model with two delays which is derived from the original Kermack and McKendrick’s classical SIR model reported in50. The original SIR model divided the total population into three groups of individuals, namely, the group of susceptible individuals denoted by S, I is the group of infective individuals and R is the group of recovered individuals, where the principle of mass action governs the movement from the S to I to R groups51, governs the diffusion of an epidemic.

Epidemic models using ordinary differential equations in the simplest forms were given in52,53 as the following:

The classic epidemic model is the SIR model given by the initial value problem

graphic file with name 41598_2025_7227_Article_Equ7.gif 7

where Inline graphic is the contact rate (i.e., the average number of adequate contacts of a person per unit time), Inline graphic is average infectious period, Inline graphic, Inline graphic, and Inline graphic are the numbers in these classes, so that Inline graphic, Inline graphic is the total population size.

Recently, the epidemic models have been studied and extended by many authors and they can be found in5460, for example. One of the most basic epidemic models which is proposed to explain the rise and fall in the number of infected patients observed in an epidemic is the SIR model. If the immunity that is obtained upon recovery is permanent, then the model is a SIR model. If recovery does not give immunity, then the model is called a susceptible-infective-susceptible (SIS) model. Generally, SIR models are applicable for viral agent diseases such as mumps, measles, and smallpox, while SIS models are more applicable for protozoan agent diseases such as sleeping sickness and malaria, and for some bacterial agent diseases such as plague, meningitis, and venereal diseases.

A SIR model with time delay has been studied in many literature reviews6164. A SIR model with discrete delay was analyzed as in59. The delay was used to model the fact that an individual may not be infectious for a period of time after infection. In6264, A SIR model with distributed delay was studied. The SIR model with incubation time delay and logistic growth rate with carrying capacity was analyzed and the dynamic properties of the suggested system are presented in65. A new system was extended and proposed by66 instead of the system in65 because of considering the behavioral changes of susceptible individuals.

Now, let Inline graphic, Inline graphic and Inline graphic denote the numbers of susceptible, infective, and recovered individuals at time Inline graphic, respectively. A SIR epidemic model with time delays is as follows:

graphic file with name 41598_2025_7227_Article_Equ8.gif 8

where the initial conditions Inline graphic Inline graphic, and Inline graphic for Inline graphic and Inline graphic, represents the derivative of Inline graphic with respect to Inline graphic. The differential equation model in (8) is an extension of the Kermack and McKendrick’s model48 incorporating delay parameters Inline graphic and Inline graphic. The delay parameter Inline graphic relates to the time delay for a newly infected susceptible to exhibit symptoms of his/her infectiousness. Thus, Inline graphic represents the incubation period of an infection in the susceptible. Similarly, Inline graphic is the infectious period before the patient is fully recovered, i.e., stop being infectious. Thus, the delayed SIR model represents a more realistic infection experience for a population under study.

The other parameters in the model, namely; Inline graphic; where Inline graphic are as follows: Inline graphic is the daily contact rate, i.e., the average number of contacts per infective per unit of time, Inline graphic is the rate of return to susceptibility after a period of infection of duration Inline graphic and Inline graphic is the daily recovery rate of the infectives per unit of time. In this example, Inline graphic, Inline graphic and Inline graphic.

Pharmacokinetic models: the two-compartment model with time delay

Pharmacokinetic study of drugs subject to enterohepatic circulation has gained importance in recent years. A two-compartment model was developed by Harrison and Gibaldi67 representing the body and the GI, or digestive, tract then by Chen and Gross68 to describe the pharmacokinetics of drugs undergoing reabsorption. In many cases, a compartmental model must include delays to give a more isomorphic description of the biological system see6971. Cobelli and Rescigno72 and Steimer et al.73 proposed a modification to the previous model by adding a time-lag Inline graphic on the transfer pathway from compartment I to compartment II, where compartment I represents the body including the liver while compartment II represents the GI tract, as shown in Fig. 1. A two-compartment model with time delay is suggested to characterize the pharmacokinetics of drugs that undergo enterohepatic circulation.

Fig. 1.

Fig. 1

Time delay pharmacokinetic model for a drug subject to enterohepatic circulation67.

The model illustrated in Fig. 1 represents a two-compartment system varying from the fundamental model described in67, by adding a time delay in the transfer pathway from compartment I to compartment II.

It is assumed that a time interval exists following biliary excretion, prior to the occurrence of reabsorption. The transfer processes are assumed to be of first-order kinetics; elimination occurs both from compartment I (Inline graphic) and compartment II (Inline graphic); the rate constant for biliary excretion and reabsorption are, respectively, Inline graphic and Inline graphic. The hypothesis that the reabsorption of a drug molecule is lagged after its biliary excretion is represented by the addition of a time delay Inline graphic in the transition from the first compartment to the second one.

Now, let Inline graphic be the amount of drug at time Inline graphic in compartment I. The corresponding mathematical formulation is:

graphic file with name 41598_2025_7227_Article_Equ9.gif 9

The mathematical formulation is described by (9) with the corresponding initial conditions.

For intravenous administration:

graphic file with name 41598_2025_7227_Article_Equ10.gif 10

and for oral administration:

graphic file with name 41598_2025_7227_Article_Equ11.gif 11

Equations (9), (10) and (11) represent two models: model I coincides with an intravenous single dose and is represented by (9) and (10); model II coincides with an oral single dose and is represented by (9) and (11).

In this research, model I and model II are studied and the goal is to estimate the parameters related to these models.

Proposed methodology

The maximum likelihood inference approach for DDEMs

Let Inline graphic denote the probability density function (pdf) parameterized in terms of the unknown parameters Inline graphic, Inline graphic and Inline graphic for Inline graphic independent (vector) observations Inline graphic. Based on the independence and normality assumptions on Inline graphic’s in (4), the likelihood function is given by

graphic file with name 41598_2025_7227_Article_Equa.gif

For now, we consider that Inline graphic is known and fixed; the situation where Inline graphic is unknown is addressed later. So, for now, it is assumed that the aforementioned likelihood is a function of Inline graphic. Using the log-likelihood function is the standard procedure for statistical inference, which is provided by

graphic file with name 41598_2025_7227_Article_Equ12.gif 12

The log-likelihood function Inline graphic expressions are frequently easier to work with than the likelihood function, Inline graphic, since the expressions of the log-likelihood function involve summations and not products. Hence, the differentiation of the log-likelihood function is easier and the results are more reliable. Here the MLE of Inline graphic is denoted as Inline graphic. The MLE Inline graphic is a point estimate where

graphic file with name 41598_2025_7227_Article_Equ13.gif 13

which is depending on Inline graphic. Now, let us study the case in which Inline graphic is unknown. Inline graphic denotes to the MLE of Inline graphic and the Inline graphic in (12) is maximized as a function of Inline graphic after finding Inline graphic as in (13). In closed form, Inline graphic can be obtained and is provided by

graphic file with name 41598_2025_7227_Article_Equ14.gif 14

Over the grid, the function global maximum can be found by the grid algorithms. First, evaluate the function value on the grid, then find the grid value corresponding to the maximum value. The space of the grid is quite refined, and the grid value is close to the domain value. Therefore, we are close to the global maximum value. The algorithm of the adaptive grid improves the original algorithm of the grid, thereby bringing us increasingly closer to the global maximum. Nevertheless, the primary disadvantage of the grid algorithm or any grid is its slow convergence.

To find the MLE numerically, the log-likelihood in Eq. (12) is the function to maximize. Therefore, it is best to choose the value with largest log-likelihood to get Inline graphic and Inline graphic as in (13). This maximization can be done by a two-step procedure: First, an adaptive grid procedure is used which is then followed by a quasi-Newton algorithm. The first step ensures we are close to the MLE, whereas the second procedure guarantees a swift convergence towards the MLE.

The grid procedure

Utilizing an adaptive grid procedure can help us to get Inline graphic and Inline graphic, where the value with largest log-likelihood is chosen. The gridding is executed for Inline graphic and Inline graphic. A numerical Newton–Raphson method is utilized to determine the maximum value of Inline graphic in the grid space Inline graphic, is defined as

graphic file with name 41598_2025_7227_Article_Equ15.gif 15

where the grid space Inline graphic, Inline graphic which covers Inline graphic values of Inline graphic is used. By maximizing the log-likelihood above for each fixed value of Inline graphic and Inline graphic in Inline graphic, we find the MLE of Inline graphic, Inline graphic. The MLE Inline graphic is obtained by solving

graphic file with name 41598_2025_7227_Article_Equ16.gif 16

Denote Inline graphic to be the Inline graphic column vector consisting of the entries Inline graphic where

graphic file with name 41598_2025_7227_Article_Equb.gif

By using Newton–Raphson method, the numerical problem is solved as follows:

graphic file with name 41598_2025_7227_Article_Equ17.gif 17

where

graphic file with name 41598_2025_7227_Article_Equ18.gif 18

And

graphic file with name 41598_2025_7227_Article_Equ19.gif 19

As noted from (18) and (19), Inline graphic and Inline graphic values are needed at each Inline graphic where Inline graphic and Inline graphic are the first and second partial derivative of Inline graphic regarding Inline graphic, respectively. This is performed repetitively as in the following:

Inline graphic is got by differentiating (5) regarding Inline graphic, where Inline graphic and Inline graphic are independent of each other, where Inline graphic, Inline graphic, Inline graphic, which gives:

graphic file with name 41598_2025_7227_Article_Equ20.gif 20

which suggests that Inline graphic gives a DDE that is obtained by (20). Note that Inline graphic if (Inline graphic and Inline graphic if (Inline graphic.

Since the initial condition of the Inline graphic-process is Inline graphic 1, for all Inline graphic. Based on the initial condition using Euler method, the above DDE can be solved numerically.

Also, Inline graphic is got by differentiating (5) regarding Inline graphic to get

graphic file with name 41598_2025_7227_Article_Equ21.gif 21

where Inline graphic is the derivative of Inline graphic regarding Inline graphic, and Inline graphic is the delayed version of Inline graphic, that is Inline graphic The initial condition for the DDE in (Inline graphic) is Inline graphic since the derivative of the initial values Inline graphic regarding Inline graphic is Inline graphic.

In the same way and by differentiating (5) regarding Inline graphic, we get

graphic file with name 41598_2025_7227_Article_Equ22.gif 22

where Inline graphic is the derivative of Inline graphic, and Inline graphic is the delayed version of Inline graphic, that is.

Inline graphicInline graphic, Inline graphic

Inline graphic. The initial condition for the DDE in (Inline graphic) is Inline graphic since the derivative of the initial values Inline graphic regarding Inline graphic is 0.

To find Inline graphic at each Inline graphic by using the Euler method, the numerical solution is calculated using step size of Inline graphic, the number of equal segments of the interval Inline graphic, Inline graphic, and by using Inline graphic, Inline graphic where Inline graphic, Inline graphic. Here, Inline graphic is a natural number chosen to be large. To get the initial conditions of the process of the derivatives, it is observed that

graphic file with name 41598_2025_7227_Article_Equ23.gif 23

Thus, Inline graphic and Inline graphic for all Inline graphic, Inline graphic.

In the same way, the second derivative process of Inline graphic is got by differentiating (20) regarding Inline graphic, to get

graphic file with name 41598_2025_7227_Article_Equ24.gif 24

which implies that Inline graphic satisfies another DDE depending on Inline graphic which has been given earlier.

Inline graphic can be obtained by differentiating (21) with respect to Inline graphic as given below

graphic file with name 41598_2025_7227_Article_Equ25.gif 25

In the same way,

graphic file with name 41598_2025_7227_Article_Equ26.gif 26

where Inline graphic as Inline graphic, Inline graphic and Inline graphic as Inline graphic.

Thus, the second derivative process of Inline graphic can be obtained by differentiating (22) with respect to Inline graphic as given above.

The log-likelihood Inline graphic is computed depending on (17) using Inline graphic. Then, by finding the maximum Inline graphic as a function of Inline graphic, the point based maximum is found. The MLE got from the gridding algorithm is defined as

graphic file with name 41598_2025_7227_Article_Equ27.gif 27

The adaptive grid procedure

Applying the generic grid procedure repeatedly at increasingly finer intervals for Inline graphic) is the adaptive grid (AG) algorithm. These are the steps in the AG algorithm:

  • i.

    Determine an initial grid space Inline graphic containing the grid points Inline graphic, Inline graphic and Inline graphic.

  • ii.

    Let Inline graphic to be maximized regarding Inline graphic and Inline graphic as given in Sect. “The grid procedure

  • iii.

    Get Inline graphic as in (27).

  • iv.

    Refine the Grid: Assume that Inline graphic as in step iii. The upper and lower Inline graphic-grid points of new grid space Inline graphic is given by Inline graphic. The congruous upper and lower Inline graphic-grid points are Inline graphic. The original grid space is expanded such that the MLE result in the interior of Inline graphic if neither the upper nor lower bounds can be found.

  • v.

    Repeat steps ii—step iv to obtain Inline graphic depending on the generic grid procedure. Continue repeating to form the sequence Inline graphic, Inline graphic . Stop at Inline graphic when Inline graphic, a pre-specified threshold.

  • vi.

    Depnding on the adaptive grid approach, the final MLE is Inline graphic

Remark: The first step selects a large domain Inline graphic as the initial grid space, which is expected to contain the MLE. The domain is chosen around the true values of Inline graphic in simulation experiments because these true values are known. Practically, an exhaustive search is carried out within the bounds of upper and lower of Inline graphic and Inline graphic. The lower bounds can be taken to be zero if the parameters are positive, which is typically the situation. Subsequently, take Inline graphic and Inline graphic are two large positive numbers, and build the grid in Inline graphic with Inline graphic equally spaced marginal grid points as its constituent parts. Given that the only goal is to discover the profile of log-likelihood, the value of Inline graphic needs not to be so large. To visualize the characteristics of the resultant surface, the log-likelihood is assessed and plotted at these grid points. It is preferable to either fix or increase Inline graphic and Inline graphic until the MLE is within the chosen domain, depending on this plot (see74).

When the adaptive grid procedure above yields the first step approximation to the MLE, we can use the MATLAB function “fminunc” as an alternative. The final MLE can also be obtained by minimizing the negative log-likelihood function using a quasi-Newton procedure, and this MATLAB function requires the gradient vector, which is provided by

graphic file with name 41598_2025_7227_Article_Equ28.gif 28

where Inline graphic is unknown parameter vector, Inline graphic and the last step MLE is expressed as

graphic file with name 41598_2025_7227_Article_Equ29.gif 29

where Inline graphic with Inline graphic defined in (15).

Statistical inference based on MLE

Let’s integrate Inline graphic into the estimation procedure. After getting Inline graphic, the MLE of Inline graphic is obtained analytically as follows:

graphic file with name 41598_2025_7227_Article_Equ30.gif 30

Let Inline graphic is the Inline graphic vector of all unknown parameters, including Inline graphic where Inline graphic. The information matrix Inline graphic can be expressed by:

graphic file with name 41598_2025_7227_Article_Equ31.gif 31

The information matrix in (31) can be written in the form

graphic file with name 41598_2025_7227_Article_Equ32.gif 32

Now, recall (12), the equation which is mentioned before

graphic file with name 41598_2025_7227_Article_Equc.gif

By using log-likelihood function and substitution in (32), it follows that

graphic file with name 41598_2025_7227_Article_Equ33.gif 33

as well

graphic file with name 41598_2025_7227_Article_Equ34.gif 34

and

graphic file with name 41598_2025_7227_Article_Equ35.gif 35

where the derived DDEs for the quantities Inline graphic, Inline graphic and Inline graphic for Inline graphic, Inline graphic can be found based on the derived DDEs and Euler method is provided in Appendix A.

The observed information matrix, Inline graphic, is the information matrix assessed at the ML estimate, Inline graphic of Inline graphic The inverse of Inline graphic which is computed at the MLE, is as follows:

graphic file with name 41598_2025_7227_Article_Equ36.gif 36

The significance level Inline graphic for any element of Inline graphic, say, Inline graphic, for Inline graphic the margin of error estimate is needed. The estimated standard error of the MLE, Inline graphic, of Inline graphic is defined as:

graphic file with name 41598_2025_7227_Article_Equ37.gif 37

where the variance matrix, Inline graphic, is given in (36). The substituting from (33) into (36) gives the explicit terms of the covariance matrix. The confidence interval for Inline graphic is

graphic file with name 41598_2025_7227_Article_Equ38.gif 38

where Inline graphic norminv Inline graphic, Inline graphic is the required level of significance and Inline graphic is the margin of error. Similarly, confidence intervals for the components of Inline graphic can be found. In certain cases, we can see that some negative values are contained in the estimated confidence interval in (38). Here, the parameter is transformed logarithmically. After this log-transformation, the confidence interval for Inline graphic is

graphic file with name 41598_2025_7227_Article_Equ39.gif 39

as was explained for the parameter Inline graphic in the previous section.

Numerical solution and results

In this section, the simulation results for two examples of DDEMs in the multivariate setting with single and multiple delays are discussed and presented, respectively, based on the proposed developed methodology in Sect. “Proposed methodology” as follows:

Numerical experiment for delayed SIR model

We numerically solving the delayed SIR model in (8) by using the dde23 (MATLAB function) with parameters of fixed values at the positive constants Inline graphic which give a Siamak’s model as in34, the true values of the delays Inline graphic, the initial values Inline graphic and the standard deviation Inline graphic. At discrete time intervals, the sample observations Inline graphic from the DDE as in (4) are obtained. The starting point of the time intervals is Inline graphic whereas the end point is Inline graphic and each time interval has width Inline graphic. The total number of time points considered is Inline graphic equally spaced values. The aim is to estimate Inline graphic and Inline graphic based on observations Inline graphic. Figure 2 illustrates the numerical solution of the delayed SIR model (8), using fixed values parameters in Inline graphic at Inline graphic with Inline graphic and Inline graphic for the initial conditions Inline graphic Inline graphic, and Inline graphic. Also, Fig. 2 shows the different behavior of Inline graphic based on different parameter specifications Inline graphic, Inline graphic, Inline graphic and Inline graphic. Figure 3 gives the underlying trajectories of the solution Inline graphic from the delayed SIR model in (8) and Inline graphic sample observations. The stars are simulated noisy data by adding noise to the delayed SIR differential equations solutions at Inline graphic time points that are equally distributed in Inline graphic at Inline graphic with Inline graphic, Inline graphic and Inline graphic.

Fig. 2.

Fig. 2

Periodic outbreak of disease and numerical solution of the delayed SIR model (8) in Inline graphic with Inline graphic and Inline graphic.

Fig. 3.

Fig. 3

Numerical solution of the delayed SIR model (8), using estimated parameter values.

For the adaptive grid procedure, the initial grid space is taken to be Inline graphicInline graphicInline graphic with Inline graphic Inline graphic and Inline graphic; for this example as well as for the rest, see the remark that is given in Sect. “The adaptive grid procedure” belongs to the selection of Inline graphic. We choose Inline graphic(stopping criteria threshold) to be 0.0001. The adaptive grid results are presented in Table 1 for Inline graphic and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic and Inline graphic, whereas the quasi-Newton results are given in Table 2. Recall that Inline graphic which is used for calculating the quantities Inline graphic and Inline graphic; see Sect. “The grid procedure” As Inline graphic gets larger, the MLE accuracy increases but at the cost of longer computation times. It has been observed that when Inline graphic is set to Inline graphic, the results obtained are already satisfactory regarding their closeness to the actual parameter values of Inline graphic Inline graphic, Inline graphic and Inline graphic. Then, Inline graphic is taken into account in order to find the information matrix, calculate the parameter confidence intervals, and find the maximum of the log-likelihood function.

Table 1.

The values of Inline graphic, Inline graphic, Inline graphic and Inline graphic in delayed SIR model by using an adaptive grid for Inline graphic and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic.

Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
10  − 0.0169 (4.9994,0.0999,0.9994) (0.9840,0.9640,0.9960,0.9880,9.9880) 0.00011047

Table 2.

The values of Inline graphic, Inline graphic and Inline graphic for delayed SIR model with Inline graphic.

Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
10 0.0169 Inline graphic (1,1,1,1,10) (0.9840,0.9640,0.9960,0.9880,9.9880)

where Inline graphic.

The information matrix as Inline graphic for delayed SIR model at Inline graphic is

graphic file with name 41598_2025_7227_Article_Equd.gif

and variance of Inline graphic by using MLE is given by

graphic file with name 41598_2025_7227_Article_Eque.gif

The Inline graphic confidence intervals for parameters Inline graphic in delayed SIR model as shown in Table 3.

Table 3.

The Inline graphic confidence intervals for parameters Inline graphic and Inline graphic in delayed SIR model.

Inline graphic=10
Inline graphic (0.9632,1.0048)
Inline graphic (0.9210,1.0070)
Inline graphic (0.9895,1.0025)
Inline graphic (0.9565,1.0195)
Inline graphic (4.4384,22.4766)
Inline graphic (4.9954,5.0138)
Inline graphic (0.0998,0.1038)
Inline graphic (0.9847,1.0050)
Inline graphic 10−3×(0.0477,0.1732)

Comparison

The purpose of this section is to compare the proposed model estimation (8) with that of a previously reported estimation procedure by Siamak et al.36.

First, recall the delayed SIR epidemic model with time delays (8) as in the following:

graphic file with name 41598_2025_7227_Article_Equf.gif
graphic file with name 41598_2025_7227_Article_Equg.gif
graphic file with name 41598_2025_7227_Article_Equh.gif

where Inline graphic, Inline graphic and Inline graphic represent the numbers of individuals of susceptible, infective, and recovered at time Inline graphic.

Now, recall the mathematical formulation which be introduced as Siamak’s model36:

graphic file with name 41598_2025_7227_Article_Equi.gif
graphic file with name 41598_2025_7227_Article_Equj.gif
graphic file with name 41598_2025_7227_Article_Equ40.gif 40

where the initial conditions Inline graphic Inline graphic, and Inline graphic for Inline graphic. It is noted that there are no parameters modeled in Siamak’s model. So, no estimation of parameters is possible by his method (i.e. Siamak’s model doesn’t estimate the parameters Inline graphic, Inline graphic and Inline graphic but estimates the values of Inline graphic and Inline graphic because Siamak’s model implicitly assumes Inline graphic, Inline graphic and Inline graphic). Due to this property of Siamak’s model, it cannot estimate Inline graphic and Inline graphic correctly for general values of Inline graphic, Inline graphic and Inline graphic.

By using generated data from the delayed SIR model (8) where Inline graphic, Inline graphic, Inline graphic, Inline graphic and Inline graphic, the delayed SIR model in (8) is numerically solved using dde23 with values of fixed parameters at the positive constants Inline graphic, the true values of the delays Inline graphic, the initial values Inline graphic and the standard deviation Inline graphic. Sample observations Inline graphic Inline graphic from the DDE as in (4) were obtained at discrete time intervals of width Inline graphic which start at point Inline graphic and end at point Inline graphic corresponding to Inline graphic sampled points Inline graphic the aim is to estimate Inline graphic and Inline graphic based on observations Inline graphic. Figure 4 illustrate the numerical solution of the delayed SIR model (8), using values of fixed parameters in Inline graphic at Inline graphic with Inline graphic and Inline graphic for the initial conditions Inline graphic Inline graphic, and Inline graphic and the different behaviour of Inline graphic according to various parameter configurations Inline graphic, Inline graphic, Inline graphic and Inline graphic. Figure 5 shows the underlying trajectories of the solution Inline graphic from the delayed SIR model in (8) and the Inline graphic sample observations. The stars are simulated noisy data by including noise in the delayed SIR differential equations solutions at Inline graphic time points that are equally distributed in Inline graphic at Inline graphic with Inline graphic, Inline graphic and Inline graphic.

Fig. 4.

Fig. 4

Periodic outbreak of disease and numerical solution of the delayed SIR model (8) in Inline graphic with Inline graphic and Inline graphic

Fig. 5.

Fig. 5

Numerical solution of the delayed SIR model (8), using estimated parameter values.

For the adaptive grid procedure, the initial grid space is considered to be Inline graphic with Inline graphic, Inline graphic Inline graphic and Inline graphic. We set the standard for Inline graphic to be 0.0001. The adaptive grid results are given in Table 4 for Inline graphic, Inline graphic and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic and Inline graphic. Recall that Inline graphic which is needed for calculating the quantities Inline graphic and Inline graphic. As Inline graphic gets larger, the MLE accuracy increases but at the cost of longer computation times. It is noted that for Inline graphic, sufficiently good results are carried out in terms of closeness to the true parameter values of Inline graphic, Inline graphic, Inline graphic and Inline graphic.

Table 4.

The values of Inline graphic, Inline graphic and Inline graphic in delayed SIR model by using an adaptive grid for Inline graphic and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic.

Inline graphic Inline graphic Inline graphic Inline graphic
10  − 0.0169 (4.9991,0.1002,0.9997) (0.4960,1.0000,1.4880,0.9800,9.9880)

Now, let give illustration of the poor estimation by Siamak. By using same generated data from the delayed SIR model (8) where Inline graphic, Inline graphic, Inline graphic, Inline graphic and Inline graphic, the Siamak’s model above is numerically solved using dde23 with the initial values Inline graphic and the standard deviation Inline graphic. Sample observations Inline graphic from the DDE as in (4) were obtained at discrete time intervals of width Inline graphic which start at point Inline graphic and end at point Inline graphic corresponding to Inline graphic sampled points Inline graphic the aim is to estimate Inline graphic and Inline graphic based on observations Inline graphic. The initial grid space for the adaptive grid procedure is taken to be Inline graphic with Inline graphic Inline graphic and Inline graphic. The standard for δ was set to be Inline graphic. As Inline graphic, the adaptive grid results are given in Table 5.

Table 5.

The values of Inline graphic, Inline graphic and Inline graphic in Siamak’s model (40) by using an adaptive grid.

Inline graphic Inline graphic Inline graphic Inline graphic
10  − 4.4608 (5.0626,0.0889,1.1050) (4.4800,6.4800)

Table 5 showing values of maximum value of log-likelihood (Inline graphic, Inline graphic and Inline graphic in Siamak’s model (40) by using an adaptive grid for generated data from the delayed SIR model (8) and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic.

From the previous discussion, it is noted that the estimated values of Inline graphic, Inline graphic, are very different from Inline graphic (the original values used to simulate the data). This means the general SIR model (8) with Inline graphic, Inline graphic and Inline graphic cannot be estimated using Siamak’s model (40) and method, in which case the estimation is incorrect. However, note that the model and estimation proposed in this paper are able to obtain an accurate estimate of Inline graphic as well as Inline graphic.

Numerical experiment for pharmacokinetic models

Model I for intravenous administration

Recall the mathematical formulation in (9) which be introduced as pharmacokinetic model:

graphic file with name 41598_2025_7227_Article_Equk.gif
graphic file with name 41598_2025_7227_Article_Equl.gif

with the corresponding initial conditions:

Inline graphic Inline graphic, and Inline graphic for Inline graphic for intravenous administration and Inline graphic Inline graphic, and Inline graphic for Inline graphic for oral administration.

The equations above represent two models: model I corresponds to an intravenous single dose and is represented by (9) and (10); model II corresponds to an oral single dose and is represented by (9) and (11).

By utilizing dde23 with fixed values of parameters Inline graphic in Inline graphic at Inline graphic with Inline graphic and Inline graphic or Inline graphic or Inline graphic, the trajectories of the solutions Inline graphic and Inline graphic are obtained. As in (9) and (10) for the initial conditions Inline graphic and Inline graphic, the effect of time delay on pharmacokinetic after intravenous injection of the drug and the various traits of the solution based on the parameter specifications is presented in Fig. 6. Therefore, the parameters are fixed at Inline graphic. Figure 7 shows the underlying trajectories of the solution Inline graphic and Inline graphic from the DDE model (9) for intravenous administration, (Model I), and the Inline graphic sampled observations.SECT

Fig. 6.

Fig. 6

Variations of Inline graphic and Inline graphic versus time and numerical solution of (9) for intravenous administration (Model I) using fixed parameter values as a) Inline graphic and b) Inline graphic.

Fig. 7.

Fig. 7

Numerical solution of (9) for intravenous administration (Model I) using estimate of the parameter.

The stars and squares are simulated noisy data by adding noise to the solutions of two-compartment model with time delay at Inline graphic time points that are equally distributed in Inline graphic at Inline graphic with Inline graphic and Inline graphic or Inline graphic or Inline graphic and initial conditions: a) Inline graphic and b) Inline graphic respectively.

The initial grid space for the adaptive grid procedure is considered as Inline graphicInline graphic with Inline graphic Inline graphic and Inline graphic. The results of adaptive grid are given in Table 6 for Inline graphic and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic and Inline graphic and Newton–Raphson procedures are given in Table 7. As in previous example, it is noted that for Inline graphic, acceptable results are accomplished in terms of closeness to the true parameter values of Inline graphic Inline graphic, Inline graphic and Inline graphic. Thus, Inline graphic is considered for finding the MLE function.

Table 6.

The values of Inline graphic, Inline graphic, Inline graphic and Inline graphic in (9) Model I for intravenous administration by using an adaptive grid for Inline graphic and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic.

Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
10  − 1.0685 (100.1167,-0.1216) (0.5040,0.9880,0.1960,0.9920,0.4960) 0.0134
Table 7.

The values of Inline graphic, Inline graphic and Inline graphic for model I with Inline graphic.

Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
10 1.0128 Inline graphic (0.5,1.0,0.2,1.0,0.5) (0.4991,0.9905,0.1984,0.9935,0.4950)

The information matrix as Inline graphic for Model I at Inline graphic is

graphic file with name 41598_2025_7227_Article_Equm.gif

and variance of Inline graphic by using MLE is given by

graphic file with name 41598_2025_7227_Article_Equn.gif

The Inline graphic confidence intervals for parameters Inline graphic in Model II as shown in Table 8.

Table 8.

The Inline graphic confidence intervals for parameters Inline graphic and Inline graphic in model I.

Inline graphic=10
Inline graphic (0.4789, 0.5211)
Inline graphic (0.9875, 1.0125)
Inline graphic (0.1827, 0.2173)
Inline graphic (0.9862, 1.0138)
Inline graphic (0.4877, 0.5123)
Inline graphic (99.7482, 100.4852)
Inline graphic (-0.4820, 0.2389)
Inline graphic (0.0081, 0.0189)

Model II for oral administration

In the same mannerand by using dde23 with values of fixed parameters Inline graphic in Inline graphic at Inline graphic with Inline graphic and Inline graphic or Inline graphic or Inline graphic, the trajectories of the solutions Inline graphic and Inline graphic are obtained. As in (9) and (11) for the initial conditions Inline graphic and Inline graphic, the effect of time delay on pharmacokinetic after oral intake of the drug and the various traits of the solution according to the parameter specifications is shown in Fig. 8. The underlying trajectories of the solution Inline graphic and Inline graphic from the DDE model (9) for oral administration, (Model II), and the Inline graphic sampled observations are displayed in Fig. 9.

Fig. 8.

Fig. 8

Variations of Inline graphic and Inline graphic versus time and numerical solution of (9) for intravenous administration (Model II) using fixed parameter values as a) Inline graphic and b) Inline graphic

Fig. 9.

Fig. 9

Numerical solution of (9) for oral administration (Model II) using estimated parameter values.

The stars and squares are simulated noisy data by adding noise to the solutions of two-compartment model with time delay at Inline graphic time points that are equally distributed in Inline graphic at Inline graphic with Inline graphic and Inline graphic or Inline graphic or Inline graphic and initial conditions: a) Inline graphic and b) Inline graphic respectively.

The results of adaptive grid are given in Table 9 for Inline graphic and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic and Inline graphic and Newton–Raphson procedures are given in Table 10. As in previous example, it is noted that for Inline graphic, acceptable results are actually carried out in terms of closeness to the true parameter values of Inline graphic Inline graphic, Inline graphic and Inline graphic. Thus, Inline graphic is considered for finding the MLE function.

Table 9.

The values of Inline graphic, Inline graphic, Inline graphic and Inline graphic in (9) Model II for oral administration by using an adaptive grid for Inline graphic and Inline graphic time points that are equally distributed in Inline graphic at Inline graphic.

Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
10  − 1.3643 (− 0.0874,100.2061) (0.2,0.2,0.2,0.5,4) 0.0134
Table 10.

The values of Inline graphic, Inline graphic and Inline graphic for Model II with Inline graphic.

Inline graphic Inline graphic Inline graphic Inline graphic Inline graphic
10 1.1293 Inline graphic (0.2,0.2,0.2,0.5,4) (0.1992,0.1993,0.2019,0.4965,4.0007)

The information matrix as Inline graphic for Model II at Inline graphic is

graphic file with name 41598_2025_7227_Article_Equo.gif

and variance of Inline graphic by using MLE is given by

graphic file with name 41598_2025_7227_Article_Equp.gif

The Inline graphic confidence intervals for parameters Inline graphic in Model II as shown in Table 11.

Table 11.

The Inline graphic confidence intervals for parameters Inline graphic and Inline graphic in model II.

Inline graphic=10
Inline graphic (0.1964, 0.2036)
Inline graphic (0.1980, 0.2020)
Inline graphic (0.1946, 0.2054)
Inline graphic (0.4962, 0.5038)
Inline graphic (3.9710, 4.0290)
Inline graphic (− 0.3231, 0.1484)
Inline graphic (99.9714, 100.4409)
Inline graphic (0.0080, 0.0187)

Conclusion

The method of maximum likelihood inference was presented for unknown delay parameters as well as other parameters of interest in multivariate setting. As examples, we considered the delayed SIR model with multiple delays and the two-compartment model with time delay (Model I for intravenous administration and Model II for oral administration) and after that, we derived the unknown parameters in these models. A two-step approach that uses a gradient descent technique after an adaptive grid is suggested. Based on the proposed methodology and by using simulation results, the numerical solution and statistical inference on unknown parameters of two examples for DDEMs in the multivariate settings with single and multiple delays are solved and illustrated in graphs and tables. The comparison between obtained results and Siamak et al.36 results has been added and applied to delayed SIR model, example of multivariate DDEMs. Moreover, the likelihood inferential framework was used to find the gradient vector, information matrix, and confidence intervals for each unknown parameter.

Acknowledgements

Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2025R734), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Appendix

A. Quasi-Newton procedure

As input to the quasi-Newton procedure, it is required to find the gradient vector, Inline graphic, as in (28). Recall that the DDEM has multiple delays. Based on the log-likelihood, Inline graphic is defined as

graphic file with name 41598_2025_7227_Article_Equ41.gif 41

Denoting Inline graphic and Inline graphic, the first-order partial derivatives involve derivatives of Inline graphic with respect to the parameters are as follows:

graphic file with name 41598_2025_7227_Article_Equ42.gif 42

where

graphic file with name 41598_2025_7227_Article_Equ43.gif 43

and

graphic file with name 41598_2025_7227_Article_Equ44.gif 44

where

graphic file with name 41598_2025_7227_Article_Equ45.gif 45

The derivative expressions Inline graphic and Inline graphic for Inline graphic; Inline graphic; Inline graphic, can be numerically obtained from respective DDEs.

The DDEM was mentioned above can be numerically solved based on this initial conditions and the values of Inline graphic can be obtained from Inline graphic for each Inline graphic. The case of Inline graphic is similar and already discussed in Sect.  “The grid procedure”.

Equations (42) and (44) also involve Inline graphic and Inline graphic. Recall (16), which is:

graphic file with name 41598_2025_7227_Article_Equ46.gif 46

By differentiating (16) regarding Inline graphic and Inline graphic, respectively, it fallows that:

graphic file with name 41598_2025_7227_Article_Equ47.gif 47

thus

graphic file with name 41598_2025_7227_Article_Equ48.gif 48

Similarly, from differentiating (16) with respect to Inline graphic, it follows that

graphic file with name 41598_2025_7227_Article_Equ49.gif 49

and hence,

graphic file with name 41598_2025_7227_Article_Equ50.gif 50

For the derivatives of l regarding its arguments, the explicit expressions are given as in the following:

For the DDE in (5) with Inline graphic and Inline graphic. The first-order partial derivatives of Inline graphic are as follows:

graphic file with name 41598_2025_7227_Article_Equ51.gif 51
graphic file with name 41598_2025_7227_Article_Equ52.gif 52
graphic file with name 41598_2025_7227_Article_Equ53.gif 53

These partial derivatives of Inline graphic can be numerically obtained from the derivative expression of Inline graphic and Inline graphic for Inline graphic since each of them form an additional DDE derived from (5) by differentiating it regarding the quantity of interest. Further it is obtained that

graphic file with name 41598_2025_7227_Article_Equ54.gif 54

Again, differentiating regarding the arguments of Inline graphic, the second-order partial derivatives will be on this form

graphic file with name 41598_2025_7227_Article_Equ55.gif 55
graphic file with name 41598_2025_7227_Article_Equ56.gif 56
graphic file with name 41598_2025_7227_Article_Equ57.gif 57
graphic file with name 41598_2025_7227_Article_Equ58.gif 58
graphic file with name 41598_2025_7227_Article_Equ59.gif 59
graphic file with name 41598_2025_7227_Article_Equ60.gif 60
graphic file with name 41598_2025_7227_Article_Equ61.gif 61
graphic file with name 41598_2025_7227_Article_Equ62.gif 62
graphic file with name 41598_2025_7227_Article_Equ63.gif 63

and

graphic file with name 41598_2025_7227_Article_Equ64.gif 64

Equations (58, (59), (63) are necessary for the quasi-Newton procedure.

B. Information matrix

The information matrix, Inline graphic can be obtained form

graphic file with name 41598_2025_7227_Article_Equ65.gif 65

Taking negative on the LHS of Eqs. (55)–(64), followed by expectation under the sampling distribution of each Inline graphic, it is noted that

graphic file with name 41598_2025_7227_Article_Equ66.gif 66

or

graphic file with name 41598_2025_7227_Article_Equ67.gif 67

on the RHS become zero since the expectation of Inline graphic equals Inline graphic Hence, it follows that

graphic file with name 41598_2025_7227_Article_Equ68.gif 68

as in (33). As well

graphic file with name 41598_2025_7227_Article_Equ69.gif 69

Finally, taking expectation in Eq. (64)

graphic file with name 41598_2025_7227_Article_Equ70.gif 70

Author contributions

Authors have worked equally to write and review the manuscript.

Data availability

The data that supports the findings of this study are available within the article.

Declarations

Competing interests

The authors declare no competing interests.

Footnotes

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Cushing, J. M. Integrodifferential Equations and Delay Models in Population Dynamics (Springer Science & Business Media, 2013). [Google Scholar]
  • 2.MacDonald, N. Time lags in biological models. Vol. 27. Springer Science & Business Media, 2013.
  • 3.Gopalsamy, K. Stability and Oscillations in Delay Differential Equations of Population Dynamics (Springer Science & Business Media, 1992). [Google Scholar]
  • 4.Kuang, Y. Delay Differential Equations: With Applications in Population Dynamics (Academic Press, 1993). [Google Scholar]
  • 5.Alenazy, A. H. S., Ebaid, A., Algehyne, E. A. & Al-Jeaid, H. K. Advanced Study on the delay differential equation y′(t) = ay(t) + by(ct). Mathematics10, 4302. 10.3390/math10224302 (2022). [Google Scholar]
  • 6.Polyanin, A. D., Sorokin, V. G. & Zhurov, A. I. Delay Ordinary and Partial Differential Equations (Chapman and Hall, 2024). [Google Scholar]
  • 7.Yamaoka, K., Tanigawara, Y., Nakagawa, T. & Uno, T. A pharmacokinetic analysis program (MULTI) for microcomputer. J. Pharmacobiodyn.4(11), 879–885 (1981). [DOI] [PubMed] [Google Scholar]
  • 8.Gomeni, R. PHARM—an interactive graphic program for individual and population pharmacokinetic parameter estimation. Comput. Biol. Med.14(1), 25–34 (1984). [DOI] [PubMed] [Google Scholar]
  • 9.Labat, C., Mansour, K., Malmary, M., Terrissol, M. & Oustrin, J. A variable reabsorption time-delay model for pharmacokinetics of drugs. Eur. J. Drug Metab. Pharmacokinet.12(2), 129–133 (1987). [DOI] [PubMed] [Google Scholar]
  • 10.Nerella, N. G., Block, L. H. & Noonan, P. K. The impact of lag time on the estimation of pharmacokinetic parameters I. One-compartment open model. Pharm. Res.10(7), 1031–1036 (1993). [DOI] [PubMed] [Google Scholar]
  • 11.Savic, R. M., Jonker, D. M., Kerbusch, T. & Karlsson, M. O. Implementation of a transit compartment model for describing drug absorption in pharmacokinetic studies. J. Pharmacokinet. Pharmacodyn.34(5), 711–726 (2007). [DOI] [PubMed] [Google Scholar]
  • 12.Godfrey, K. R., Arundel, P. A., Dong, Z. & Bryant, R. Modelling the double peak phenomenon in pharmacokinetics. Comput. Methods Progr. Biomed.104(2), 62–69 (2011). [DOI] [PubMed] [Google Scholar]
  • 13.Shen, J., Boeckmann, A. & Vick, A. Implementation of dose superimposition to introduce multiple doses for a mathematical absorption model (transit compartment model). J. Pharmacokinet. Pharmacodyn.39(3), 251–262 (2012). [DOI] [PubMed] [Google Scholar]
  • 14.Koch, G., Krzyzanski, W., Pérez-Ruixo, J. J. & Schropp, J. Modeling of delays in PKPD: classical approaches and a tutorial for delay differential equations. J. Pharmacokinet. Pharmacodyn.41(4), 291–318 (2014). [DOI] [PubMed] [Google Scholar]
  • 15.Ljung, L. & Söderström, T. Theory and Practice of Recursive Identification (JSTOR, 1983). [Google Scholar]
  • 16.Goodwin, G. & Sin, K. Adaptive Filtering Prediction and Control (Prentice Hall, 1984). [Google Scholar]
  • 17.Mendel, J.-L. Lessons in Digital Estimation Theory (Prentice-Hall, 1987). [Google Scholar]
  • 18.Ljung, L. System identification. In Theory for the User (Prentice-Hall, 1987). [Google Scholar]
  • 19.Åström, K. J. & Wittenmark, B. Computer-Controlled Systems: Theory and Design (Prentice-Hall, 1997). [Google Scholar]
  • 20.Fowler, A. & Kember, G. Delay recognition in chaotic time series. Phys. Lett. A175(6), 402–408 (1993). [Google Scholar]
  • 21.Bünner, M. et al. Recovery of scaler time-delay systems from time series. Phys. Lett. A211(6), 345–349 (1996). [Google Scholar]
  • 22.Horbelt, W., Timmer, J. & Voss, H. Parameter estimation in nonlinear delayed feedback systems from noisy data. Phys. Lett. A299(5), 513–521 (2002). [Google Scholar]
  • 23.Baker, C. T. & Parmuzin, E. I. Identification of the initial function for discretized delay differential equations. J. Comput. Appl. Math.181(2), 420–441 (2005). [Google Scholar]
  • 24.Baker, C. T. & Parmuzin, E. I. Identification of the initial function for nonlinear delay differential equations. Russ. J. Numer. Anal. Math. Model.20(1), 45–66 (2005). [Google Scholar]
  • 25.Ellner, S. P., Kendall, B. E., Wood, S. N., McCauley, E. & Briggs, C. J. Inferring mechanism from time-series data: delay-differential equations. Phys. D110(3), 182–194 (1997). [Google Scholar]
  • 26.Wang, L. & Cao, J. Estimating parameters in delay differential equation models. J. Agric. Biol. Environ. Stat.17(1), 68–83 (2012). [Google Scholar]
  • 27.Murphy, K. A. Estimation of time-and state-dependent delays and other parameters in functional differential equations. SIAM J. Appl. Math.50(4), 972–1000 (1990). [Google Scholar]
  • 28.Bellman, R. & Roth, R. S. The use of splines with unknown end points in the identification of systems. J. Math. Anal. Appl.34(1), 26–33 (1971). [Google Scholar]
  • 29.Varah, J. A spline least squares method for numerical parameter estimation in differential equations. SIAM J. Sci. Stat. Comput.3(1), 28–46 (1982). [Google Scholar]
  • 30.Voit, E. O. & Almeida, J. Decoupling dynamical systems for pathway identification from metabolic profiles. Bioinformatics20(11), 1670–1681 (2004). [DOI] [PubMed] [Google Scholar]
  • 31.Liang, H. & Wu, H. Parameter estimation for differential equation models using a framework of measurement error in regression models. J. Am. Stat. Assoc.103(484), 1570–1583 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Chen, J. & Wu, H. Efficient local estimation for time-varying coefficients in deterministic dynamic models with applications to HIV-1 dynamics. J. Am. Stat. Assoc.103(481), 369–384 (2008). [Google Scholar]
  • 33.Brunel, N. J. Parameter estimation of ODE’s via nonparametric estimators. Electron. J. Stat.2, 1242–1267 (2008). [Google Scholar]
  • 34.Gugushvili, S. & Klaassen, C. A. √ n-consistent parameter estimation for systems of ordinary differential equations: bypassing numerical integration via smoothing. Bernoulli18(3), 1061–1098 (2012). [Google Scholar]
  • 35.Nelder, J. A. & Wedderburn, R. W. M. Generalized linear models. J. Royal Statistic. Soc. Series A: Statis. Soc. 135 (3), 370–384 (1972).
  • 36.Mehrkanoon, S., Mehrkanoon, S. & Suykens, J. A. Parameter estimation of delay differential equations: an integration-free LS-SVM approach. Commun. Nonlinear Sci. Numer. Simul.19(4), 830–841 (2014). [Google Scholar]
  • 37.Mehrkanoon, S., Shardt, Y. A., Suykens, J. A. & Ding, S. X. Estimating the unknown time delay in chemical processes. Eng. Appl. Artif. Intell.55, 219–230 (2016). [Google Scholar]
  • 38.Wood, S. N. Partially specified ecological models. Ecol. Monogr.71(1), 1–25 (2001). [Google Scholar]
  • 39.Cangelosi, A. R. & Hooten, M. B. Models for bounded systems with continuous dynamics. Biometrics65(3), 850–856 (2009). [DOI] [PubMed] [Google Scholar]
  • 40.Calderhead, B., Girolami, M. & Lawrence, N. D. Accelerating Bayesian inference over nonlinear differential equations with Gaussian processes. Adv. Neural Inf. Process. Syst.21, 217–224 (2009). [Google Scholar]
  • 41.Dondelinger, F., Husmeier, D., Rogers, S. & Filippone, M. ODE parameter inference using adaptive gradient matching with Gaussian processes. In Artificial Intelligence and Statistics 216–228 (PMLR, 2013). [Google Scholar]
  • 42.Fisher, R. A. On the mathematical foundations of theoretical statistics. Philos. Trans. R. Soc. Lond. Ser. A222, 309–368 (1922). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Fisher, R. A. Theory of statistical estimation. Math. Proc. Cambridge Philos. Soc.22(5), 700–725 (1925). [Google Scholar]
  • 44.Berk, R. H. Limiting behavior of posterior distributions when the model is incorrect. Ann. Math. Stat.37(1), 51–58 (1966). [Google Scholar]
  • 45.Berk, R. H. Consistency a posteriori. Ann. Math. Stat. 894–906 (1970).
  • 46.Huber, P. J. The behavior of maximum likelihood estimates under nonstandard conditions. Proc. Fifth Berkeley Sympos. Math. Stat. Probab.1(1), 221–233 (1967). [Google Scholar]
  • 47.Wald, A. Note on the consistency of the maximum likelihood estimate. Ann. Math. Stat.20(4), 595–601 (1949). [Google Scholar]
  • 48.Akaike, H. Information theory and an extension of the maximum likelihood principle. In Selected Papers of Hirotugu Akaike 199–213 (Springer, 1998). [Google Scholar]
  • 49.Kullback, S. & Leibler, R. A. On information and sufficiency. Ann. Math. Stat.22(1), 79–86 (1951). [Google Scholar]
  • 50.Kermack, W. O. & McKendrick, A. G. A contribution to the mathematical theory of epidemics. Proc. R. Soc. Lond. A Math. Phys. Eng. Sci.115(772), 700–721 (1927). [Google Scholar]
  • 51.Anderson, R. M., May, R. M. & Anderson, B. Infectious Diseases of Humans: Dynamics and Control (Wiley, 1992). [Google Scholar]
  • 52.Hethcote, H. W. Qualitative analyses of communicable disease models. Math. Biosci.28(3–4), 335–356 (1976). [Google Scholar]
  • 53.Hethcote, H. W. The mathematics of infectious diseases. SIAM Rev.42(4), 599–653 (2000). [Google Scholar]
  • 54.Beretta, E., Capasso, V. & Rinaldi, F. Global stability results for a generalized Lotka-Volterra system with distributed delays. J. Math. Biol.26(6), 661–688 (1988). [DOI] [PubMed] [Google Scholar]
  • 55.Mena-Lorcat, J. & Hethcote, H. W. Dynamic models of infectious diseases as regulators of population sizes. J. Math. Biol.30(7), 693–716 (1992). [DOI] [PubMed] [Google Scholar]
  • 56.Jin, Y., Wang, W. & Xiao, S. An SIRS model with a nonlinear incidence rate. Chaos Solit. Fract.34(5), 1482–1497 (2007). [Google Scholar]
  • 57.Gakkhar, S. & Negi, K. Pulse vaccination in SIRS epidemic model with non-monotonic incidence rate. Chaos Solit. Fract.35(3), 626–638 (2008). [Google Scholar]
  • 58.Liu, J. & Zhou, Y. Global stability of an SIRS epidemic model with transport-related infection. Chaos Solit. Fract.40(1), 145–158 (2009). [Google Scholar]
  • 59.Tchuenche, J. M. & Nwagwo, A. Local stability of an SIR epidemic model and effect of time delay. Math. Methods Appl. Sci.32(16), 2160–2175 (2009). [Google Scholar]
  • 60.Shulgin, B., Stone, L. & Agur, Z. Pulse vaccination strategy in the SIR epidemic model. Bull. Math. Biol.60(6), 1123–1148 (1998). [DOI] [PubMed] [Google Scholar]
  • 61.Ma, W., Song, M. & Takeuchi, Y. Global stability of an SIR epidemicmodel with time delay. Appl. Math. Lett.17(10), 1141–1145 (2004). [Google Scholar]
  • 62.Beretta, E., Hara, T., Ma, W. & Takeuchi, Y. Global asymptotic stability of an SIR epidemic model with distributed time delay. Nonlinear Anal. Theory Methods Appl.47(6), 4107–4115 (2001). [Google Scholar]
  • 63.Ma, W., Takeuchi, Y., Hara, T. & Beretta, E. Permanence of an SIR epidemic model with distributed time delays. Tohoku Math. J.54(4), 581–591 (2002). [Google Scholar]
  • 64.Takeuchi, Y., Ma, W. & Beretta, E. Global asymptotic properties of a delay SIR epidemic model with finite incubation times. Nonlinear Anal. Theory Methods Appl.42(6), 931–947 (2000). [Google Scholar]
  • 65.Wang, J.-J., Zhang, J.-Z. & Jin, Z. Analysis of an SIR model with bilinear incidence rate. Nonlinear Anal. Real World Appl.11(4), 2390–2402 (2010). [Google Scholar]
  • 66.Zhang, J.-Z., Jin, Z., Liu, Q.-X. & Zhang, Z.-Y. Analysis of a delayed SIR model with nonlinear incidence rate. Discret. Dyn. Nat. Soc.2008, 636153 (2009). [Google Scholar]
  • 67.Harrison, L. I. & Gibaldi, M. Influence of cholestasis on drug elimination: pharmacokinetics. J. Pharm. Sci.65(9), 1346–1348 (1976). [DOI] [PubMed] [Google Scholar]
  • 68.Chen, H. S. G. & Gross, J. F. Pharmacokinetics of drugs subject to enterohepatic circulation. J. Pharm. Sci.68(6), 792–794 (1979). [DOI] [PubMed] [Google Scholar]
  • 69.Reeve, E. & Bailey, H. Mathematical models describing the distribution of I131-albumin in man. J. Lab. Clin. Med.60(6), 923–943 (1962). [PubMed] [Google Scholar]
  • 70.Berman, M. et al. Iodine kinetics in man—a model. J. Clin. Endocrinol. Metab.28(1), 1–14 (1968). [DOI] [PubMed] [Google Scholar]
  • 71.Quarfordt, S. H., Frank, A., Shames, D. M., Berman, M. & Steinberg, D. Very low density lipoprotein triglyceride transport in type IV hyperlipoproteinemia and the effects of carbohydrate-rich diets. J. Clin. Investig.49(12), 2281–2297 (1970). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Cobelli, C. & Rescigno, A. Some observations on the physical realizability of compartmental models with delays. IEEE Trans. Biomed. Eng.3, 294–295 (1978). [DOI] [PubMed] [Google Scholar]
  • 73.Steimer, J. L., Plusquellec, Y., Guillaume, A. & Boisvieux, J. F. A time-lag model for pharmacokinetics of drugs subject to enterohepatic circulation. J. Pharm. Sci.71(3), 297–302 (1982). [DOI] [PubMed] [Google Scholar]
  • 74.Mahmoud, A. A., Dass, S. C., Muthuvalu, M. S. & Asirvadam, V. S. Maximum likelihood inference for univariate delay differential equation models with multiple delays. Complexity2017, 6148934 (2017). [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data that supports the findings of this study are available within the article.


Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES