Abstract
Accurate predictions of glucose concentrations are necessary to develop an artificial pancreas (AP) system for people with type 1 diabetes (T1D). In this work, a novel glucose forecasting paradigm based on a model fusion strategy is developed to accurately characterize the variability and transient dynamics of glycemic measurements. To this end, four different adaptive filters and a fusion mechanism are proposed for use in the online prediction of future glucose trajectories. The filter fusion mechanism is developed based on various prediction performance indexes to guide the overall output of the forecasting paradigm. The efficiency of the proposed model fusion based forecasting method is evaluated using simulated and clinical datasets, and the results demonstrate the capability and prediction accuracy of the data-based fusion filters, especially in the case of limited data availability. The model fusion framework may be used in the development of an AP system for glucose regulation in patients with T1D.
Keywords: adaptive filtering algorithms, model fusion strategy, online glucose prediction, type 1 diabetes
1. Introduction
Type 1 diabetes (T1D) is a chronic disease that is characterized by the inability of the pancreas to produce insulin required for the regulation of blood glucose concentration (BGC). People with T1D must administer exogenous insulin to maintain their BGC within the desired range (70–180 mg/dL). If BGC is not tightly regulated, the glycemic excursions may cause hypoglycemia (low BGC) or hyperglycemia (high BGC), which may lead to a variety of hazardous, long-term complications (Centers for Disease Control and Prevention 2011).
To mitigate hypo- and hyperglycemic excursions, closed-loop AP systems that incorporate continuous glucose sensors, insulin pumps, and appropriate control algorithms have been developed to automatically calculate and administer the required insulin dosage. A hybrid AP has been announced with availability in 2017 (Garg et al. 2017). However, the conventional AP systems typically involve proportional-integral-derivative control techniques that ordinarily rely on the current glucose measurements and a rudimentary model of the glucose-insulin dynamics (Percival et al. 2008). The recent development of accurate continuous glucose monitoring (CGM) systems have increased interest in the predictive modeling of glucose concentrations, which is useful in hypo- and hyperglycemic early warning alarms (Chico et al. 2003) and model-based predictive control in advanced AP systems (Hovorka et al. 2004, Cobelli et al. 2009, Ellingsen et al. 2009, Kovatchev et al. 2009, Dassau et al. 2010, Pappada et al. 2011, Bequette 2012, Cobelli et al. 2012, Eren-Oruklu et al. 2012, Haidar et al. 2013, Jacobs et al. 2014, Kirchsteiger et al. 2015, Kovatchev et al. 2016, Haidar et al. 2017, Turksoy et al. 2017, Wang et al. 2017). Nevertheless, accurately predicting the future glucose trajectories is a challenging problem as BGC is influenced by several factors including meals, administered insulin, exercise (Diabetes Research in Children Network Study Group 2005, Breton et al. 2014, Peyser et al. 2014, DeBoer et al. 2016, Jacobs et al. 2016, Turksoy et al. 2016a, Turksoy et al. 2016b, Pasieka et al. 2017, Turksoy et al. 2017) and emotional state (related to the concentration of certain hormones) (Nomura et al. 2000). Moreover, different physiological phenomena and the diverse lifestyles of individuals result in significant variability in glucose dynamics over time and among patients (Brazeau et al. 2008). These causes of glucose variability pose substantial challenges for the accurate prediction of future glucose trajectories.
To address this problem, previous research studies (Parker et al. 1999, Reifman et al., Gani et al. 2010, Pérez-Gandía et al. 2010, Nixon and Pickup 2011, Pappada et al. 2011, Zhao et al. 2011, Eren-Oruklu et al. 2012, Turksoy et al. 2014, Zhao et al. 2014, Kirchsteiger et al. 2015, Zhao and Yu 2015) have utilized various types of models for BGC prediction (or even development of AP systems) that can generally be divided into two main categories: physiological models and data-driven empirical models. Physiological models describe the glucose dynamics based on the fundamental understanding of the biological and chemical phenomena. Despite the abundant use of physiological models (Bergman 1989, Lehmann and Deutsch 1992, Parker et al. 1999, Parker et al. 2000, Hovorka et al. 2004), it may be difficult to develop a model that is personalized to individual patients because the model parameters may not be readily estimated from the limited measurements available (Dalla Man et al. 2016, Messori et al. 2016, Piccinini et al. 2016, Visentin et al. 2016, Toffanin et al. 2017). Daily adaptation of physiological model was proposed recently (Dalla Man et al. 2016, Messori et al. 2016, Piccinini et al. 2016, Visentin et al. 2016, Toffanin et al. 2017). Alternatively, data-driven models offer a simpler structure that is sufficient for online prediction yet computationally tractable for online and adaptive estimation, thus able to capture the time-varying relationships among the system variables (Cherkassky and Mulier 2007, Araghinejad 2013, Wang et al. 2013, Turksoy et al. 2014, Cinar et al. 2016, Turksoy et al. 2016a, Turksoy et al. 2016b, Turksoy et al. 2017). Once such relationships are identified, they can be used to train models that complement or replace physiological models.
In general, empirical models predict the future glucose values based on a combination of either the predicted or measured current and historical glucose signals. Such types of models can be divided into linear and nonlinear models. For linear models, AR (autoregressive) or ARX (autoregressive with exogenous inputs) modeling methods were developed by using the current and previous BG values or adding exogenous inputs. Since these models usually consider the output predictions to be a linear combination of the model inputs, the model parameters can be readily updated online. The advantages of using linear methods are simplicity, computational tractability, and rapid convergence of the model parameters without the onerous demands of requiring abundant training data. The disadvantage is that, for more reliable prediction results, the ARX models need information that cannot be captured or computed autonomously in real time applications (such as carbohydrate content of meals, concentration of some hormones, etc.). For nonlinear modeling approaches, a large training dataset is typically required to characterize the nonlinear temporal dynamics of blood glucose metabolism, while the learning algorithms may be more time-consuming and computationally expensive. However, a personalized nonlinear dynamic model may result in more accurate predictions, provided the training data are sufficient to identify the nonlinear relationships.
A recent trend is to construct a hybrid data-driven model (Azmi et al. 2010) through the combination of various model types (linear/nonlinear or AR/ARX) obtained from different modeling algorithms (See and Abrahart 2001). Nevertheless, an inherent challenge of designing the BGC predictor through hybrid models is to ensure that different data-driven models are appropriately combined and coordinated with a suitable decision-making mechanism. Along this direction, recent work (Stahl et al. 2012) used a probabilistic framework approach to combine three parallel predictors using a soft switcher derived from the Bayesian model averaging technique to find the best individual predictor.
Motivated by the above considerations, an online data-driven prediction strategy is proposed in this work that employs filtering fusion and a decision-making mechanism for accurate glucose concentration predictions in people with T1D. Considering the complexities of glucose dynamics, it is not practical to develop a universal/global prediction model for all subjects. A more suitable approach is to train a personalized model using present and historical data from CGM sensors. Since the characteristics of various kinds of adaptive filters may be better suited to different dynamic processes, training sizes, time-variant and noise environments, the filter fusion methodology is utilized and the parameters of each filter are appropriately designed so that the overall combinational filter can be used in various situations for online glucose prediction. The linear adaptive filters (recursive least squares [RLS] and extended recursive least squares [EX-RLS]) generally require less data for updating the model parameters than the nonlinear kernel-based filters (kernel recursive least squares [KRLS] and extended kernel recursive least squares [EX-KRLS]) (Liu et al. 2011). However, kernel-based filters usually have better prediction results than the linear filters if the data are inherently nonlinear. Furthermore, a decision-making mechanism for filter fusion is proposed based on different prediction performance indices to guide the overall output of the filter to have better prediction accuracy than the individual filters. The accuracy of the proposed predictor is demonstrated by predicting the glucose measurements of in silico and clinical subjects. The performance of fusion filtering method is also compared with each of the adaptive filtering models for short-term (5–30 min) online glucose prediction. The rest of this paper is organized as follows. Section 2 outlines the four adaptive filtering algorithms and analyzes their characteristics. Then, a detailed description of the model selection and filtering fusion mechanism for online glucose prediction is developed. Section 3 contains the description of the computational experiments and the accompanying results. Section 4 presents the highlights of the experiments as well as a discussion of the findings. Section 5 concludes the paper.
2. Methodology
2.1 Hybrid models with different adaptive filtering algorithms
To improve the accuracy of online prediction, adaptive filters (Goodwin and Sin 2014), various candidate models with unique and distinguished characteristics are applied to obtain candidate data-driven models. Based on the complex features of the glucose dynamics, recursive least squares (RLS) (Haykin 2008), extended recursive least squares (EX-RLS) (Sayed 2003), kernel recursive least squares (KRLS) (Engel et al. 2004) and extended kernel recursive least squares (EX-KRLS) (Liu et al. 2009) are selected for training the candidate models.
RLS is a well-known linear regression algorithm which follows the Wiener solution at each iteration (Sayed 2003). EX-RLS provides a state-space model and variant hidden states, which can improve the tracking performance of RLS and model uncertainty (Liu et al. 2009). To solve nonlinear adaptive filtering problems, kernel methods have been proposed recently (Aronszajn 1950, Liu et al. 2011) that formulate nonlinear functions in terms of inner products in high-dimensional reproducing kernel Hilbert spaces (RKHS). Therefore, linear adaptive filter algorithms can be constructed in the kernel feature space obtained by mapping the original CGM measurements to a high-dimensional feature space via appropriate kernel functions. KRLS is such a kernel variant algorithm of RLS that can approximate online the underlying nonlinear function based on the training dataset. EX-KRLS is another kernel version of EX-RLS that has the theoretic framework to deal with nonlinear state-space model estimation (Liu et al. 2009). Furthermore, EX-KRLS improves upon the capability of KRLS model, thus EX-KRLS is able to handle the small variations or slow drift issues in the nonlinear data. These four adaptive filter algorithms are proposed in this section as the basis of developing candidate models. Then, their characteristics are compared to develop a reasonable fusion mechanism.
In an autoregressive model, an output signal d(i) at the ith iteration can be expressed as a linear combination of historically observed signals
| (1) |
where u(i) is the input vector at the ith iteration, w(i) represents the weights to be estimated, and ν(i) denotes the random white noise in the process.
RLS finds the weight vector w that best represents the correlations in the desired output d(i). With regards to state-space model formulations, RLS can be written in a the mathematically equivalent form (Haykin 2008)
| (2) |
where the state vector x(i) is constant and the optimal weights w(i), which need to be learned from the training data {d(i),u(i)} at the ith iteration, are unable to track time-varying trajectories.
To solve this problem, the EX-RLS approach has a more general linear state-space model and variant hidden states (Haykin 2008)
| (3) |
where A denotes the state transition matrix, ν1(i) represents the state noise and ν2(i) is the observation noise. By using the EX-RLS algorithm, the tracking performance of a process with time-varying parameters can be improved effectively.
For a nonlinear process, Mercer theorem is used (Aronszajn 1950) to compute RLS and EX-RLS models in the feature space to transform the input vector u(i) into the RKHS as φ(u(i)), described as φ(i), and formulate regression algorithms on the sequence {d(i),φ(i)}. Then for a newly available input-output pair {d(i),u(i)}, the optimal weights w(i) at the ith iteration are computed such that the weights minimize a specific cost function. Table 1 summarizes different model structures and cost functions of the four algorithms (Liu et al. 2009).
Table 1.
summary of different state space models and cost functions of the four algorithms.
| Algorithms | Models | Cost functions | |
|---|---|---|---|
| RLS |
x(i +
1) =
x(i) d(i) = u(i)Tx(i) + υ(i) |
|
|
| EX-RLS |
x(i +
1) = Ax(i) +
υ1(i) d(i) = u(i)Tx(i) + υ2(i) |
|
|
| KRLS |
x(i +
1) =
x(i) d(i) = φ(i)Tx(i) + υ(i) |
|
|
| EX-KRLS |
x(i +
1) =
αx(i) +
υ(i) d(i) = φ(i)Tx(i) + υ2(i) |
|
For the state-space model of EX-RLS, A is the state transition matrix. In the identification process, the state variables are considered as time-invariant (identified by RLS or KRLS) or very slow time-variant (identified by EX-based filters). Therefore, the matrix A is considered as the unit matrix in the RLS/KRLS algorithms. For EX-KRLS, α is a scaling factor that indicates a unidirectional change in the state (A = αI). If the model shows a slow process with time-varying parameters, the factor α can be set close to 1. Moreover, ω = [ω1, ω2,…, ωn]T is the coefficient vector, and λ is the regularization parameter to control the initial state vector norm in the cost functions, β is the forgetting factor to incorporate an exponential weighting on the past data and q is proportional to the state noise variance that provides trade-off between the measurement disturbance and modeling variation. Therefore, state noise can be excluded by setting q = 0, and with α = 1 the EX-based algorithms will be degraded to the conventional RLS/KRLS algorithms. Further, φ(i) is a transformation of the input vector u(i) into the RKHS as given by Mercer's theorem, and can be readily calculated by a kernel function.
The cost functions of EX-RLS and EX-KRLS are more complex quadratic optimization problems with linear constraints compared to the constraint-free cost functions of RLS and KRLS (Table 1). The optimization problems in Table 1 do not need to be solved directly at each sampling instance. Rather, the weights can be calculated recursively from their previous estimate without explicitly solving any optimization. Table 2 presents the recursive procedure for updating weights in the four adaptive filtering techniques.
Table 2. Summary of correlated adaptive filtering algorithms.
| Algorithm 1: RLS | Algorithm 2: EX-RLS | ||
|---|---|---|---|
| Initialization w(0) = 0, P(0) = λ−1I | Initialization w(0) = 0, P(0) = λ−1I | ||
| Iterate for i ≥ 1 |
Iterate for i ≥ 1 |
||
|
| |||
| Algorithm 3: KRLS | Algorithm 4: EX-KRLS | ||
|
| |||
|
Initialization |
Initialization |
||
| Iterate for i ≥ 1 |
Iterate for i ≥ 1 |
||
In Table 2, the weight vector w(i) for the ith iteration is updated from the last estimate of the weights based on a correction factor that is directly proportional to both the prediction error for the observation d(i), denoted e(i), and the gain vector, denoted k(i). Furthermore, the matrix P(i) of dimension L×L is the inverse of the data autocorrelation matrix, and β is called the forgetting factor (usually specified close to 1), λ is the regularization parameter to control the initial state vector norm in the cost functions, and q indicates the trade-off between the measurement error and state noise. The parameter α is a scaling factor, which indicates a uni-directional change in state. Thus, if the system dynamics evolve gradually over time, α is close to 1. Furthermore, a represents the parametrization of the weights ω = [ω1, ω2,…, ωn]T, while Q and ρr are used to parameterize the matrix P for the development of the computational tractable recursive algorithms. One advantage of the recursive least squares algorithms is that they compute updated weights at each iteration, which is appealing for the artificial pancreas application where CGM measurements are available at each sampling instance. A framework for combining the various candidate models is presented next.
2.2 Model selection and filtering fusion mechanism
Developing hybrid or multiple models is an effective approach to leverage the strengths of each model while mitigating their respective drawbacks. This subsection focuses on the fusion mechanism of the multi-model approach, which combines the four data-driven models presented.
For improving the capability of the combined models and designing a proper fusion mechanism, it is necessary to provide an overview and summarize the different features (strengths and weaknesses) of each candidate model. Each model was analyzed to evaluate its strengths and weaknesses, such as the ability to model nonlinear systems and multivariate systems, and the uncertainty of processes for instance. Furthermore, the simplicity and ease of calibration of the models and their complexity of formulation are other important characteristics that are considered when evaluating the strengths or limitations of the models. Table 3 provides a comparative analysis of the four candidate models using various evaluation criteria (Sayed 2003, Liu et al. 2008, Liu et al. 2009, Liu et al. 2011, Araghinejad 2013).
Table 3. Comparison of candidate models.
| Models | Strengths | Weaknesses |
|---|---|---|
| RLS | Simplicity of
calibration; Generalization; Rapid convergence; Better performance for limited training data; |
Poorer tracking performance for process with
time-varying parameters; Disability for nonlinear process; (with respect to the other three methods) |
| EX-RLS | Good tracking performance for linear process
with time-varying parameters; Applicable to model uncertainty; |
Lack of flexibility; Disability for nonlinear process; Sensitive to parameters; |
| KRLS | Ability to represent nonlinear problems; | Computation complexity increases with the
training data size; Need more training data to approximate a nonlinear process; |
| EX-KRLS | Better tracking performance for dynamic
nonlinear process; Ability of estimating nonlinear state space model; Ability of modeling nonlinear systems with slow time-variant states; |
Computation complexity increases with the
training data size; More training data is needed to approximate the nonlinear process; Sensitive to parameters; Too complex in case of the model order is higher; |
In Table 3, “simplicity of calibration” gains further importance and preference over other models in situations where the prediction accuracy of the models is relatively similar. “Generalization” refers to the ability of the models to perform well in both extrapolation and interpolation circumstances, and to be readily employed in calibration and validation studies (Araghinejad 2013).
When considering the task of predicting BGC values online, it is not trivial to settle on a specific model structure that suits the diverse and often competing expectations such as accurate predictions and computational efficiency. Further complicating the model selection is the fact that the prediction error is highly sensitive to time-varying dynamics of the process. In addition, at the initialization of the training phase, the data available for identifying the model parameters is often limited. Therefore, linear filtering algorithms such as RLS and EX-RLS may provide better results initially. However, as more data are collected online and a sufficient quantity of data becomes available for model training, the kernel versions of the algorithms may offer better performance. To increase prediction accuracy, the fusion mechanism is proposed that can effectively combine the various models based on certain indexes.
To develop the hybrid model, each candidate data-driven model is described by the following equation:
| (4) |
To address the problem of online prediction, equation (4) can be represented by considering similar inputs as the following matrix form (Araghinejad 2013):
| (5) |
where ŷ(i) is the matrix of y(i) combined by different candidate models and m is the number of models that can be used to predict y(i). According to the data fusion scheme, ŷ(i) can be calculated through the linear weighted method of each estimation of y(i):
| (6) |
To update the combination weights w, the stack method (Shu and Burn 2004) is used to find the optimal weight vector
| (7) |
For robustness and efficiency considerations in online BGC prediction, all four prediction models developed by different adaptive algorithms are not employed simultaneously in the hybrid model. Rather, two of them are chosen through two specific criteria. “Criterion 1” is designed to find the prediction model with the lowest mean value of the prediction error. In this way, the filtering algorithm with the best transient performance will be selected. “Criterion 2” is designed to find the prediction model with the lowest learning error with the certain sliding window of past training samples. Therefore, the model with the best fit (while avoiding overfitting) in current dynamic process will be selected for the following convex combination. Meanwhile, the stack method is used to update the combination weights for these two candidate models. Therefore, the fusion result could be calculated via a linear weighted method, and the overall online prediction of BGC value will be obtained through a smoothing filter to avoiding abrupt fluctuations. The flowchart in Figure 1 describes the details of the combination mechanism for incorporating the output from the candidate models to provide a final prediction output.
Figure 1.
Flowchart of multi-model data fusion procedure for online prediction.
The flowchart of hybrid prediction procedure based on fusion mechanism is shown in Figure 1. First, the observed value x(i) from the i-th iteration CGM signal is obtained, providing a new input vector x(i) as well as a desired value for the short-term previous prediction ỹ(i). For four candidate models developed by RLS, EX-RLS, KRLS, EX-KRLS, four prediction results and their error evaluations are provided for further selection. Then, according to the design criteria evaluating aspects of prediction error and learning error, two optimal prediction outputs are fused through the linear weighted method. The parameters of convex combination are updated by the slack method. Finally, for avoiding noise variations in the time-variant model identification, an additional filter is applied to smooth the prediction outputs to mitigate the noise and abrupt variability.
2.3 In Silico/Clinical Subjects and Evaluation Criteria
2.3.1 In Silico Subjects
For in silico evaluation, the FDA-approved UVa/Padova metabolic simulator (Kovatchev et al. 2009) is used for prediction validation. The academic version of the FDA-approved Type 1 diabetic simulator has 30 in silico subjects (10 children, 10 adolescents and 10 adults). Each subject completed 10 scenarios, each lasting 3 days, based on closed-loop control with a general predictive controller (Turksoy et al. 2014). Then, the CGM dataset of the subjects is used to assess the accuracy of the designed hybrid predictor. For both the training and testing datasets, CGM signals without any preprocessing are used for prediction of glucose concentration values. The sampling interval is 5 minutes and the initial parameters for each candidate filters are specified (Table 4).
Table 4. Parameters for the four algorithms.
| Model | Regularization Factor λ | Forgetting Factor β | α for A = αI | q for q = q1/q2 |
|---|---|---|---|---|
| RLS | 0.001 | 0.99 | - | - |
| EX-RLS | 0.001 | 0.99 | 1 | 0.01 |
| KRLS | 0.001 | 0.99 | - | - |
| EX-KRLS | 0.001 | 0.99 | 1 | 0.01 |
2.3.2 Clinical Subjects
Clinical experiment data from both open- and closed-loop protocols involving subjects with T1D are used to assess the performance of the proposed approach. For the closed-loop clinical experiments, the subjects, aged 18–35 years, were recruited from the University of Chicago Medical Center, Kovler Diabetes Center and were scheduled for a visit at the University of Chicago General Clinical Research Center. The experiments were approximately 60-hours long and the subjects' own insulin type and pump were used during the experiments (Turksoy et al. 2014). The Guardian REAL-time CGM was utilized to collect the subjects' BGC information every 5 minutes. The open-loop experiments were performed at the University of Illinois-Chicago, College of Nursing (UIC-CON). The subjects used continuous subcutaneous insulin infusion pump therapy for their glucose regulation based on their own meal bolus and correction insulin calculation methods prescribed by their own diabetes care provider. The subjects met with the investigators at the UIC-CON for a total of 3 days; however, some subjects opted split day(s) into 4-hour blocks of time totaling 24 hours. Based on some subjects' schedule, some of the experiments took 2 weeks to 8 weeks (total hours stay at UIC-CON is still the same). The closed-loop experiments involved the artificial pancreas system to automatically compute the required amount of insulin bolus for maintaining the CGM measurements close to the desired target. The open-loop experiments involved subjects regulating their own blood glucose concentration through monitoring their CGM sensor readings and making insulin dosing decisions as they normally would make. Research ethics approvals were obtained and the experimental protocols were certified by the respective institutional review boards (IRB) of the organizations involved. Overall, there are 9 clinical experiments used to evaluate the hybrid predictor, and Table 5 shows the characteristics of the participants of the clinical studies. Based on these clinical experiments, three cases are considered to evaluate the accuracy of the designed hybrid predictor.
Table 5. Demographic information of the nine clinical subjects (six open-loop and three closed-loop).
| Demographic criteria | Mean ± standard deviation |
|---|---|
| Age (years) | 24.43 ± 6.24 |
| Body weight (kg) | 72.21 ± 16.77 |
| Height (cm) | 166.96 ± 9.62 |
| Body mass index (kgm-2) | 25.97 ± 5.87 |
| Duration of time with diabetes (years) | 14.71 ± 8.91 |
| Waist (cm) | 84.75 ± 12.77 |
The closed-loop clinical subjects are used to evaluate the hybrid predictor in two different ways. The first approach, called Case 1, uses three-day closed-loop CGM data (approximately 56 hours or 670 samples) from each subject to identify the hybrid and regular models and compare their respective predictive performances. The first 70 samples are used to train the models, and subsequently provide predictions for the 30-minutes-ahead glucose outputs online using CGM data up to 200 samples. The prediction results are compared against measurements from CGM and illustrated in Figure 4(a). The second approach, called Case 2, uses a model trained using data from one subject while evaluating the model for on-line predictions in another randomly selected subject. The subject used for collecting training data to develop the model and the subject used to test the model are both selected at random. Such a cross-trained scenario demonstrates the need for personalized models that perform better than the models trained on another subject's data. In this scenario, 200-samples of closed-loop CGM data from a subject denoted A are chosen as training dataset, while the proposed hybrid model is tested using the online measurements of subject B to assess model prediction accuracy. In this way, the ability of prediction could be analyzed at the start point of modeling and the generalization performance of the hybrid model could be presented as well. All the closed-loop experiments considered are randomly divided into either Case 1 or 2, while the open-loop experiments constitute Case 3.
Figure 4.
Comparison of measurements and 30-min predicted glucose profiles for subjects (A1, B1 and C1) in clinical experiments based on hybrid predictor. Subplot (c) plots the first 600 samples and subplot (d) the complete 2000 samples from subject C1 for easy comparison of trends. Associated PRED-EGA analysis shown in Figure 5 and summary statistics provided in Table 8.
With regards to the open-loop data, Case 3 employs 10-day open-loop CGM data (about 3000 samples with 5-min sampling interval) from subjects to evaluate the long-term performance of the proposed predictor. As the open-loop data showed, the glucose concentration values are not well regulated, with the CGM of the subjects in this case, denoted by the identifier tag C, often exceeding the target range (70-180 mg/dl) and potentially leading to hypo- and hyperglycemia complications. Further, subjects in this group were allowed to recalibrate the CGM at their own preference, which caused rapid changes to the regular glucose dynamics. This presents a serious obstacle to the accurate online prediction of glucose values.
2.4 Evaluation Criteria
To characterize the accuracy of glucose concentration prediction compared with actual CGM values, the following metrics are used:
-
Mean absolute relative deviation [MARD (%)] (Noujaim et al. 2007)
(8) where ŷ(i) is the predicted value, y(i) is the measurement, and N is the number of samples. This metric indicates how closely the prediction results and measurement results match.
-
Root-mean-square error [RMSE (mg/dL)] (Gani et al. 2010)
(9) RMSE has similar units as the predicted variable, making analysis of prediction performance easier.
Prediction-error grid analysis (PRED-EGA) (Kovatchev et al. 2004, Sivananthan et al. 2011) PRED-EGA is a new version of the continuous glucose-error grid analysis (CG-EGA) (Clarke et al. 1987). This metric is a reliable and robust approach to evaluate the prediction accuracy of CGM systems because it measures accuracy on both BGC and direction of BGC fluctuations. For evaluating the predictor's accuracy, the point-error grid analysis (P-EGA) is used to describe the correct predictions of BGC. For assessing the predictor's tracking performance, the rate-error grid analysis (R-EGA) is utilized to present the ability to accurately capture the direction of BGC fluctuations.
3. Results
All the prediction methods mentioned above were programmed in MATLAB R2012a for online training and short-term (30-minutes-ahead or equivalently 6 sampling instances ahead) glucose concentration prediction. The dataset containing the hybrid model inputs and desired glucose response are used for updating the model and online prediction. The desired response of a certain prediction horizon (PH) is unknown in real-time, but the current measurement can be used as a desired target for the sample obtained at the t–PH sampling instance to update the parameters of the prediction models.
A. In Silico Subjects
The recursive filters and the proposed hybrid filtering algorithm are applied for on-line glucose prediction using the 30 in silico subjects (10 for each of adults, adolescents, and children). The average errors observed across all the in silico subjects for each category (adults, adolescents, and children) are reported in Table 6. It is readily observed that the performance of the proposed hybrid filtering algorithm is superior to the other filtering algorithms considered in this work.
Table 6. Glucose prediction accuracy for 30 in silico subjects (average results of RMSE, Median, and COD for 10 adults, 10 adolescents and 10 children).
| Subject Category | Model | MEAN ±STANDARD DEVIATION | MEDIAN±MAD | COD |
|---|---|---|---|---|
| Adult | RLS | 10.4798+/-8.6218 | 8.7184+/-6.8603 | 0.7409 |
| EX-RLS | 11.6128+/-9.6402 | 9.4767+/-8.34 | 0.6653 | |
| KRLS | 11.2607+/-9.0504 | 9.5461+/-7.9239 | 0.7097 | |
| EX-KRLS | 10.9972+/-8.9339 | 8.8897+/-7.4717 | 0.7056 | |
| Hybrid Model | 9.8618+/-8.1756 | 7.9837+/-6.352 | 0.7811 | |
|
| ||||
| Adolescent | RLS | 10.6663+/-8.8758 | 8.2589+/-7.4142 | 0.7484 |
| EX-RLS | 11.9492+/-9.8108 | 9.4063+/-8.4958 | 0.6498 | |
| KRLS | 10.7712+/-8.8494 | 8.3097+/-7.4097 | 0.7257 | |
| EX-KRLS | 11.4954+/-9.2759 | 9.0602+/-7.4663 | 0.7005 | |
| Hybrid Model | 10.2443+/-8.3716 | 7.6631+/-6.4068 | 0.7804 | |
|
| ||||
| Child | RLS | 11.1526+/-9.4226 | 8.9929+/-7.8486 | 0.722 |
| EX-RLS | 12.5995+/-10.6147 | 9.6729+/-8.2804 | 0.6923 | |
| KRLS | 11.1498+/-9.5053 | 8.6996+/-7.7384 | 0.749 | |
| EX-KRLS | 12.3321+/-10.137 | 9.6123+/-7.9072 | 0.6948 | |
| Hybrid Model | 10.6077+/-9.104 | 7.9573+/-6.8943 | 0.7941 | |
The 30-min-ahead glucose predictions from three randomly selected in silico subjects (adult #5, adolescent #3 and child #8) are shown in Figure 2, with the corresponding PRED-EGA analysis in Figure 3 and the summary statistics tabulated in Table 7. The prediction results of the hybrid model for selected in silico subjects (Figure 2) indicate that the fitted prediction model is accurate and the glucose trends are well captured. For further evaluating the predictor's accuracy in a clinically acceptable metric, the PRED-EGA metric is utilized in terms of both accurate BGC values (P-EGA) and accurate rate and direction of BGC fluctuations (R-EGA) (Kovatchev et al. 2004). Glucose prediction accuracy for in silico subjects is shown in Table 7.
Figure 2.
Comparison of representative measured and 30-min predicted glucose concentration profiles for Subjects #5 (top), #3 (middle) and #8 (bottom) based on hybrid predictor. Associated PRED-EGA analysis shown in Figure 3 and summary statistics provided in Table 7.
Figure 3.
PRED-EGA for adult subjects #5 (a), adolescent subject #3 (b) and child subject #8 (c) based on hybrid predictor. P-EGA compares the predicted CGM to the actual measured CGM. R-EGA compares the rate of change of the predicted CGM (Estimated Rate) to the actual rate of change of the measured CGM (Reference Rate). Associated glucose prediction profiles shown in Figure 2 and summary statistics provided in Table 7.
Table 7. Glucose prediction accuracy for in silico subjects (Adult 5#, Adolescent 3# and Child 8#).
| Subject No. |
Model | MARD (%) |
MEAN ±STANDARD DEVIATION |
BG ≤ 70mg/dl | BG 70–180mg/dl | BG ≥ 180mg/dl | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| ||||||||||||
| Accurate (%) |
Benign (%) |
Error (%) |
Accurate (%) |
Benign (%) |
Error (%) |
Accurate (%) |
Benign (%) |
Error (%) |
||||
| Adult 5# | RLS | 6.051 | 7.935+/-6.875 | - | - | - | 96.81 | 2.30 | 0.88 | 97.22 | 2.78 | 0 |
| EX-RLS | 8.977 | 10.389+/-8.166 | - | - | - | 95.74 | 3.19 | 1.06 | 96.67 | 8.33 | 0 | |
| KRLS | 8.344 | 11.132+/-9.021 | - | - | - | 95.74 | 3.72 | 0.53 | 100 | 0 | 0 | |
| EX-KRLS | 6.323 | 7.644+/-6.469 | - | - | - | 96.28 | 3.55 | 0.18 | 100 | 0 | 0 | |
| Hybrid Model | 5.994 | 7.538+/-6.514 | - | - | - | 96.99 | 2.30 | 0.71 | 100 | 0 | 0 | |
|
| ||||||||||||
| Adolescent 3# | RLS | 7.096 | 10.748+/-9.585 | - | - | - | 93.37 | 5.59 | 1.04 | 94.87 | 3.42 | 1.71 |
| EX-RLS | 5.830 | 8.369+/-7.561 | - | - | - | 94.20 | 4.35 | 1.45 | 97.44 | 2.56 | 0 | |
| KRLS | 6.145 | 8.902+/-8.244 | - | - | - | 93.58 | 5.38 | 1.04 | 95.73 | 4.27 | 0 | |
| EX-KRLS | 6.653 | 9.146+/-9.066 | - | - | - | 93.58 | 5.38 | 1.04 | 95.73 | 0.85 | 1.71 | |
| Hybrid Model | 5.876 | 8.221+/-7.593 | - | - | - | 94.20 | 4.55 | 1.24 | 97.44 | 2.56 | 0 | |
|
| ||||||||||||
| Child 8# | RLS | 7.591 | 8.134+/-7.982 | - | - | - | 93.02 | 5.62 | 1.36 | 94.05 | 3.57 | 2.38 |
| EX-RLS | 6.551 | 7.594+/-7.500 | - | - | - | 93.02 | 6.20 | 0.78 | 90.48 | 4.76 | 4.76 | |
| KRLS | 8.979 | 11.360+/-11.147 | - | - | - | 93.22 | 5.62 | 1.16 | 95.24 | 3.57 | 1.19 | |
| EX-KRLS | 7.712 | 10.967+/-11.185 | - | - | - | 93.99 | 4.84 | 1.16 | 95.24 | 3.57 | 1.19 | |
| Hybrid Model | 6.598 | 7.596+/-7.447 | - | - | - | 93.41 | 5.43 | 1.16 | 96.43 | 2.38 | 1.19 | |
Table 7 summarizes the 30-minutes-ahead prediction accuracy for the hybrid method compared with the four individual candidate filters for three in silico subjects in different groups. The metrics (MARD, RMSE and PRED-EGA) are used to assess their prediction performance. Prediction errors given by MARD and RMSE are presented in the third and fourth columns respectively, and prediction assessments measured by PRED-EGA are given in the last nine columns of Table 7.
In Table 7, predictions are classified as accurate if the predictions fall within the A or B zones of both the P-EGA and the R-EGA. The benign errors refer to predictions with acceptable point accuracy (A or B zones in P-EGA) yet with more significant errors in the rate accuracy (C, D, or E zones in R-EGA). The benign errors are unlikely to lead to negative clinical consequences as the blood glucose predictions are relatively close to the measured values with only the derivative or rate of change of the blood glucose values not predicted accurately. The erroneous predictions (C, D, or E zones of the P-EGA regardless of the corresponding R-EGA zone), labeled under the error heading in Table 7, refers to the samples that have significant prediction errors in the nominal blood glucose values, which could potentially lead to negative clinical actions and outcomes (Kovatchev et al. 2004).
As the glucose of in silico subjects is well controlled (Turksoy et al. 2014), the hypoglycemia is avoided completely. Based on these results, one can observe differences between various prediction models. In general, the proposed hybrid model has higher prediction accuracy than its candidate models in most situations, since it is developed by the model fusion mechanism. This is readily observed in Table 7, where the proposed method has most of the predictions as highly accurate, with only a few samples with benign errors that would not have significant consequences in clinical results. Furthermore, the proposed approach results in lower erroneous predictions that would have negative clinical outcomes, thus improving the overall results compared to the other individual models. It should be noted that it is unrealistic to expect a prediction model that always performs better than others in all three metrics. Table 7 also shows that none of the candidate models could provide as good of a prediction ability at all times and across all subjects as the hybrid model because glucose concentration dynamics often combine different characteristics that require different adaptive models to cover various conditions. Although in a few occasions a candidate model did perform slightly better than the hybrid predictor, this occurred rarely and the hybrid model still performed comparably to the best model in terms of predictive performance. The consistently improved prediction ability of the hybrid model can be attributed to the better characterization of the glucose trajectories. For example, model parameters may be able to fit the data when glucose is increasing, but unable to capture the response fluctuations when glucose declines. Moreover, a specific model may give responses with varying degrees of accuracy to the different subjects. In contrast, the hybrid method provides better prediction and tracking ability, which may result from the fact that the hybrid predictor is developed by online updating based on the fusion mechanism that may overcome the problem of excessive reliance on each candidate model.
B. Clinical Subjects
The glucose predictions from selected clinical subjects are shown in Figure 4, with the corresponding PRED-EGA analysis in Figure 5 and the summary statistics tabulated in Table 8. The hybrid predictor is evaluated using three subjects in each case (subjects A1-3 for case 1, subjects B1-3 for case 2, and subjects C1-3 for case 3). For the sake of brevity, only one set of prediction results is shown in the figures for each of the three cases to demonstrate the efficiency of the modeling approach. The 30-min prediction results for clinical subject A1 (Figure 4) indicate good prediction ability with an acceptable delay, a small RMSE (8.9325 mg/dL) and good accuracy in the PRED-EGA. For the cross-trained model for subject B1, the prediction accuracy is decreased because of subject-depended training data. It presents considerable phase shifts, a larger RMSE of 11.189 mg/dL and a lower accuracy of PRED-EGA. The results for case 2 demonstrate that if training data from another subject is used, the models will always be of lower accuracy as the model dynamics are not in agreement with the test subject. In certain cases, the models identified and used on different subjects may perform reasonably well, though this is only expected in rare cases where the training data involved are similar to the subject's glucose dynamics. For subject C1, the first 600-point comparison of measurement and prediction results is shown in Figure 4(c), and the full 2000-point comparison was shown in Figure 4(d). Figure 4(c) illustrates that the fitted prediction model is accurate even for open-loop glucose prediction and the glucose trends containing more uncertain dynamics are well captured. The detailed analysis with the three metrics shows that the prediction performance of hybrid model is still acceptable and reliable even in such a complex case.
Figure 5.
PRED-EGA for a select number of subjects (A1, B1 and C1) in clinical experiments based on hybrid predictor. P-EGA compares the predicted CGM to the actual measured CGM. R-EGA compares the rate of change of the predicted CGM (Estimated Rate) to the actual rate of change of the measured CGM (Reference Rate). Associated glucose prediction profiles shown in Figure 4 and summary statistics provided in Table 8.
Table 8. Glucose prediction accuracy for clinical subjects (A1, B1 and C1).
| Subject No. | Model | MARD (%) | MEAN ±STANDARD DEVIATION | BG ≤ 70mg/dl | BG 70–180mg/dl | BG ≥ 180mg/dl | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| ||||||||||||
| Accurate (%) | Benign (%) | Error (%) | Accurate (%) | Benign (%) | Error (%) | Accurate (%) | Benign (%) | Error (%) | ||||
| Subject A1 | RLS | 8.141 | 9.112+/-7.635 | 97.40 | 1.30 | 1.30 | 96.83 | 2.54 | 0.63 | 94.12 | 5.88 | 0 |
| EX-RLS | 7.995 | 9.188+/-7.543 | 97.40 | 1.30 | 1.30 | 95.98 | 3.38 | 0.63 | 94.12 | 5.88 | 0 | |
| KRLS | 9.644 | 11.164+/-9.397 | 90.91 | 0 | 9.09 | 97.25 | 1.90 | 0.84 | 94.12 | 5.88 | 0 | |
| EX-KRLS | 9.741 | 11.235+/-9.799 | 93.51 | 0 | 6.49 | 98.31 | 1.06 | 0.63 | 95.59 | 4.41 | 0 | |
| Hybrid Model | 7.846 | 8.933+/-7.814 | 97.40 | 1.30 | 1.30 | 96.83 | 2.54 | 0.63 | 95.59 | 4.41 | 0 | |
|
| ||||||||||||
| Subject B1 | RLS | 10.602 | 12.967+/-11.606 | 66.67 | 0 | 33.33 | 85.16 | 12.26 | 2.58 | 93.71 | 3.14 | 3.14 |
| EX-RLS | 8.945 | 10.582+/-11.063 | 77.78 | 0 | 22.22 | 85.16 | 12.26 | 2.58 | 92.46 | 4.40 | 3.14 | |
| KRLS | 11.687 | 13.28+/-11.694 | 55.56 | 0 | 44.44 | 75.48 | 21.29 | 3.23 | 91.82 | 3.77 | 4.40 | |
| EX-KRLS | 10.17 | 12.516+/-11.815 | 55.56 | 0 | 44.44 | 77.42 | 20 | 2.58 | 93.71 | 2.52 | 3.77 | |
| Hybrid Model | 9.559 | 11.189+/-10.987 | 77.78 | 0 | 22.22 | 82.58 | 14.84 | 2.58 | 93.08 | 2.52 | 4.40 | |
|
| ||||||||||||
| Subject C1 | RLS | 12.284 | 17.676+/-16.252 | 93.48 | 0.43 | 6.09 | 92.40 | 4.75 | 2.85 | 77.78 | 14.81 | 7.41 |
| EX-RLS | 13.692 | 23.762+/-29.683 | 89.57 | 1.30 | 9.13 | 90.74 | 6.41 | 2.85 | 68.52 | 24.07 | 7.41 | |
| KRLS | 12.695 | 15.684+/-26.452 | 94.78 | 0.87 | 4.35 | 93.82 | 4.04 | 2.14 | 77.78 | 11.11 | 11.11 | |
| EX-KRLS | 13.518 | 17.149+/-28.393 | 90.87 | 1.74 | 7.39 | 92.39 | 4.51 | 3.09 | 75.93 | 11.11 | 12.96 | |
| Hybrid Model | 11.862 | 15.004+/-18.730 | 94.35 | 0.87 | 4.78 | 94.06 | 3.80 | 2.14 | 79.63 | 12.96 | 7.41 | |
Figure 5 shows the PRED-EGA with the 30-min prediction results for these three clinical experiments (subjects A1, B1, and C1). The performance evaluation (Table 8) shows the model prediction accuracy of a hybrid method compared with four candidate methods for three groups of clinical subjects with predictor outputs. According to the results, the proposed hybrid model has better prediction accuracy in real test environment based on the online adjustment. For subject A1, at the beginning of the online prediction, the accuracy of the hybrid predictor is not adequate because the training data for updating the model is insufficient. As training data accumulates and more data become available for updating the model, the prediction performance improves and the glucose trends are well captured. According to PRED-EGA, 95.59% to 97.40% of the results fall in the clinically-accurate level on full range of BG values. For subject B1, as prediction models are trained by data from another subject, the beginning portion of the online prediction has large errors and delay, which reduces the accuracy rate of the samples in the hypoglycemia range as shown in PRED-EGA. However, the predictions are relatively accurate for hyperglycemia with 93.08% of the samples in the hyperglycemia range accurately predicted to be in that range, for 30-min ahead predictions. For subject C1, as open-loop CGM data are used and the glucose measurements are often out of the target range, compounded with the adverse effects of frequent calibration, the MARD and RMSE are higher than other cases. However, according the PRED-EGA results, the hybrid model still has the 94.35% and 94.06% clinically-accurate glucose predictions in hypoglycemia and euglycemia ranges, respectively. While the number of samples accurately predicted to be within the hyperglycemia range decreases for the 30-minutes-ahead prediction, the predictive accuracy for various prediction horizons is still in a reasonable range.
The impact of the prediction horizon (PH) on prediction accuracy is evaluated by comparing the hybrid method in different cases. The median value and the first and third quartiles of the RMSE metric are presented as an error bar. As shown in Figure 6, PH for online prediction is set from 1 to 8 (the prediction period is 5-min to 40-min) and other parameters of the prediction model are the same as the previous simulation. With increasing the PH, the prediction accuracy decreases for all cases analyzed above. In general, case 1 with data from subject A1 shows better prediction accuracy than other cases, as it has well-regulated glucose than case 3 (subject C1) and more adequate empirical training data than case 2 (subject B1).
Figure 6.
Prediction accuracy assessed with different prediction horizons (PH) by the median and first/third quartile of the RMSE.
4. Discussion
Hybrid prediction algorithms have the benefit of assigning greater weighting to the more accurate candidate models compared to other models with higher predictions errors to improve the overall performance. The proposed approach also recursively updates the model parameters at each sampling instance, which generally translates to an even distribution of computation load to each sampling instance. This recursive nature of the model estimation is advantageous for the artificial pancreas application where CGM measurements are sampled uniformly over time. Despite the computational tractability of recursive least squares algorithms, there may in instances where candidate models are identified that do not have sufficient prediction accuracy to merit the computation involved in recursively updating their parameters. This drawback can be mitigated by removing any candidate models from the pool that consistently underperform. Nevertheless, the computational efficiency element of recursive least squares is a topic of future research studies.
In contrast to the RLS model employed in the artificial pancreas application, the proposed hybrid predictor determines weights to effectively combine multiple predictors in order to provide the best prediction performance. As such, in numerous scenarios of the in silico and clinical experiments the prediction results of the hybrid predictor outperformed that of the candidate models. Therefore, the proposed hybrid predictor can outperform the previous model implemented in the AP system, which has predictive performance similar to the RLS approach. In recent multi-model work, a probabilistic framework approach is proposed to combine three parallel predictors using a soft switcher derived from the Bayesian model averaging technique. Although this work shares notions of combining multiple predictors to form a global predictor, the Bayesian model averaging based work showed the merged prediction has predictive performance that is comparable to the best individual predictor. On the other hand, the proposed hybrid predictor in this work determines weights to combine the two models that best characterize the current glucose trends and that provide the best fitting results for the training data. Consequently, the hybrid predictor has some capacity to avoid overfitting of the past training samples and is thus capable of outperforming even the best candidate model on several instances.
As with other data-driven modeling approaches, the veracity and quantity of training samples is of concern in the proposed hybrid predictor approach. This is readily seen in the open-loop results where the subjects rely on their own physician prescribed insulin dosing strategy, which results in more time spent outside the target glycemic zone. This relatively poorer glycemic control in comparison to the closed-loop study, along with the sensor recalibrations, results in CGM data that span a wider range of data. This necessitates models valid over a wider glycemic range, which deteriorates the predictive performance of the models. Nevertheless, the hybrid predictor performed satisfactorily as it usually performs favorably in comparison to the candidate models. Based on the analysis of data from both the in silico and clinical subjects, challenges such as the impact of noise and shifts in CGM sensor readings need to be addressed in future research.
5. Conclusion
In this paper, a hybrid model is developed for online glucose concentration prediction using the model fusion strategy. Combining four candidate filtering algorithms, a fusion mechanism and appropriate weighting scheme are proposed to make accurate predictions. A new hybrid model is designed and applied for short-term online glucose prediction in people with T1D. The work illustrates that the predictive capability of the proposed hybrid model is better compared to each individual prediction model. Moreover, the hybrid method presents a better online prediction accuracy, which can be indicated as a practical and effective approach especially in cases with limited data.
Supplementary Material
9 Clinical Experiment Results.xls, Table: Results for Nine Clinical Experiments. The results for linear adaptive filters (recursive least squares [RLS] and extended recursive least squares [EX-RLS]) and the nonlinear kernel-based filters (kernel recursive least squares [KRLS] and extended kernel recursive least squares [EX-KRLS]) for the experimental data of 9 subjects.
30 Virtual Patient Results.xls: Table: Results for Thirty Virtual Patients. The results for linear adaptive filters (recursive least squares [RLS] and extended recursive least squares [EX-RLS]) and the nonlinear kernel-based filters (kernel recursive least squares [KRLS] and extended kernel recursive least squares [EX-KRLS]) for the 30 subjects of the UVa/Padova simulator.
Acknowledgments
This work is supported by the National Institutes of Health (NIH) under grants 1DP3DK101075-01 and 1DP3DK101077-01. Dr. Xia Yu acknowledges China Scholarship Council (CSC) for scholarship funding for her research at Illinois Institute of Technology.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- Araghinejad S. Data-driven modeling: using MATLAB® in water resources and environmental engineering. Springer Science & Business Media 2013 [Google Scholar]
- Aronszajn N. Theory of reproducing kernels. Transactions of the American mathematical society. 1950;68:337–404. [Google Scholar]
- Azmi M, Araghinejad S, Kholghi M. Multi model data fusion for hydrological forecasting using K-nearest neighbour method. Iranian Journal of Science and Technology. 2010;34:81. [Google Scholar]
- Bequette BW. Challenges and recent progress in the development of a closed-loop artificial pancreas. Annual Reviews in Control. 2012;36:255–266. doi: 10.1016/j.arcontrol.2012.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bergman RN. Toward physiological understanding of glucose tolerance: minimal-model approach. Diabetes. 1989;38:1512–1527. doi: 10.2337/diab.38.12.1512. [DOI] [PubMed] [Google Scholar]
- Brazeau AS, Rabasa-Lhoret R, Strychar I, Mircescu H. Barriers to physical activity among patients with type 1 diabetes. Diabetes Care. 2008;31:2108–2109. doi: 10.2337/dc08-0720. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breton MD, Brown SA, Karvetski CH, Kollar L, Topchyan KA, Anderson SM, Kovatchev BP. Adding heart rate signal to a control-to-range artificial pancreas system improves the protection against hypoglycemia during exercise in type 1 diabetes. Diabetes technology & therapeutics. 2014;16:506–511. doi: 10.1089/dia.2013.0333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Centers for Disease Control and Prevention. National diabetes fact sheet: national estimates and general information on diabetes and prediabetes in the United States, 2011. Vol. 201 Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention; 2011. [Google Scholar]
- Cherkassky V, Mulier FM. Learning from data: concepts, theory, and methods. John Wiley & Sons; 2007. [Google Scholar]
- Chico A, Vidal-Ríos P, Subirà M, Novials A. The continuous glucose monitoring system is useful for detecting unrecognized hypoglycemias in patients with type 1 and type 2 diabetes but is not better than frequent capillary glucose measurements for improving metabolic control. Diabetes Care. 2003;26:1153–1157. doi: 10.2337/diacare.26.4.1153. [DOI] [PubMed] [Google Scholar]
- Cinar A, Turksoy K, Hajizadeh I. Multivariable artificial pancreas method and system. Google Patents 2016 [Google Scholar]
- Clarke WL, Cox D, Gonder-Frederick LA, Carter W, Pohl SL. Evaluating clinical accuracy of systems for self-monitoring of blood glucose. Diabetes Care. 1987;10:622–628. doi: 10.2337/diacare.10.5.622. [DOI] [PubMed] [Google Scholar]
- Cobelli C, Dalla Man C, Sparacino G, Magni L, De Nicolao G, Kovatchev BP. Diabetes: models, signals, and control. IEEE reviews in biomedical engineering. 2009;2:54–96. doi: 10.1109/RBME.2009.2036073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cobelli C, Renard E, Kovatchev BP, Keith-Hynes P, Ben Brahim N, Place J, Del Favero S, Breton M, Farret A, Bruttomesso D. Pilot studies of wearable outpatient artificial pancreas in type 1 diabetes. Diabetes Care-Alexandria. 2012;35:e65. doi: 10.2337/dc12-0660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dalla Man C, Micheletto F, Sathananthan M, Vella A, Cobelli C. Model-Based Quantification of Glucagon-Like Peptide-1–Induced Potentiation of Insulin Secretion in Response to a Mixed Meal Challenge. Diabetes technology & therapeutics. 2016;18:39–46. doi: 10.1089/dia.2015.0146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dassau E, Zisser H, Percival MW, Grosman B, Jovanovic L, Doyle FJ., III . Diabetes. Amer Diabetes Assoc 1701 n Beauregard ST, Alexandria, VA 22311-1717 USA; 2010. Clinical results of automated artificial pancreatic beta-cell system with unannounced meal using multi-parametric MPC and insulin-on-board; pp. A94–A94. [Google Scholar]
- DeBoer MD, Cherñavvsky DR, Topchyan K, Kovatchev BP, Francis GL, Breton MD. Heart rate informed artificial pancreas system enhances glycemic control during exercise in adolescents with T1D. Pediatric diabetes. 2016 doi: 10.1111/pedi.12454. [DOI] [PubMed] [Google Scholar]
- Diabetes Research in Children Network Study Group. Impact of exercise on overnight glycemic control in children with type 1 diabetes mellitus. The Journal of pediatrics. 2005;147:528–534. doi: 10.1016/j.jpeds.2005.04.065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ellingsen C, Dassau E, Zisser H, Grosman B, Percival MW, Jovanovič L, Doyle FJ., III Safety constraints in an artificial pancreatic β cell: an implementation of model predictive control with insulin on board. Journal of diabetes science and technology. 2009;3:536–544. doi: 10.1177/193229680900300319. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Engel Y, Mannor S, Meir R. The kernel recursive least-squares algorithm. IEEE Transactions on Signal Processing. 2004;52:2275–2285. [Google Scholar]
- Eren-Oruklu M, Cinar A, Rollins DK, Quinn L. Adaptive system identification for estimating future glucose concentrations and hypoglycemia alarms. Automatica. 2012;48:1892–1897. doi: 10.1016/j.automatica.2012.05.076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gani A, Gribok AV, Lu Y, Ward WK, Vigersky RA, Reifman J. Universal glucose models for predicting subcutaneous glucose concentration in humans. IEEE Transactions on Information Technology in Biomedicine. 2010;14:157–165. doi: 10.1109/TITB.2009.2034141. [DOI] [PubMed] [Google Scholar]
- Garg SK, Weinzimer SA, Tamborlane WV, Buckingham BA, Bode BW, Bailey TS, Brazg RL, Ilany J, Slover RH, Anderson SM. Glucose outcomes with the in-home use of a hybrid closed-loop insulin delivery system in adolescents and adults with type 1 diabetes. Diabetes technology & therapeutics. 2017;19:155–163. doi: 10.1089/dia.2016.0421. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goodwin GC, Sin KS. Adaptive filtering prediction and control. Courier Corporation 2014 [Google Scholar]
- Haidar A, Legault L, Dallaire M, Alkhateeb A, Coriati A, Messier V, Cheng P, Millette M, Boulet B, Rabasa-Lhoret R. Glucose-responsive insulin and glucagon delivery (dual-hormone artificial pancreas) in adults with type 1 diabetes: a randomized crossover controlled trial. Canadian Medical Association Journal. 2013;185:297–305. doi: 10.1503/cmaj.121265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haidar A, Messier V, Legault L, Ladouceur M, Rabasa-Lhoret R. Outpatient 60 - hour day - and - night glucose control with dual - hormone artificial pancreas, single - hormone artificial pancreas, or sensor - augmented pump therapy in adults with type 1 diabetes: An open - label, randomised, crossover, controlled trial. Diabetes, Obesity and Metabolism. 2017 doi: 10.1111/dom.12880. [DOI] [PubMed] [Google Scholar]
- Haykin SS. Adaptive filter theory. Pearson Education India 2008 [Google Scholar]
- Hovorka R, Canonico V, Chassin LJ, Haueter U, Massi-Benedetti M, Federici MO, Pieber TR, Schaller HC, Schaupp L, Vering T. Nonlinear model predictive control of glucose concentration in subjects with type 1 diabetes. Physiological measurement. 2004;25:905. doi: 10.1088/0967-3334/25/4/010. [DOI] [PubMed] [Google Scholar]
- Jacobs PG, El Youssef J, Castle J, Bakhtiani P, Branigan D, Breen M, Bauer D, Preiser N, Leonard G, Stonex T. Automated control of an adaptive bihormonal, dual-sensor artificial pancreas and evaluation during inpatient studies. IEEE Transactions on Biomedical Engineering. 2014;61:2569–2581. doi: 10.1109/TBME.2014.2323248. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacobs PG, El Youssef J, Reddy R, Resalat N, Branigan D, Condon J, Preiser N, Ramsey K, Jones M, Edwards C. Randomized trial of a dual?hormone artificial pancreas with dosing adjustment during exercise compared with no adjustment and sensor?augmented pump therapy. Diabetes, Obesity and Metabolism. 2016;18:1110–1119. doi: 10.1111/dom.12707. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kirchsteiger H, Jørgensen JB, Renard E, Del Re L. Prediction Methods for Blood Glucose Concentration: Design, Use and Evaluation. Springer; 2015. [Google Scholar]
- Kovatchev B, Tamborlane WV, Cefalu WT, Cobelli C. The artificial pancreas in 2016: a digital treatment ecosystem for diabetes. Diabetes Care. 2016;39:1123–1126. doi: 10.2337/dc16-0824. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kovatchev BP, Breton M, Dalla Man C, Cobelli C. In silico preclinical trials: a proof of concept in closed-loop control of type 1 diabetes. Journal of diabetes science and technology. 2009;3:44–55. doi: 10.1177/193229680900300106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kovatchev BP, Gonder-Frederick LA, Cox DJ, Clarke WL. Evaluating the accuracy of continuous glucose-monitoring sensors continuous glucose–error grid analysis illustrated by therasense freestyle navigator data. Diabetes Care. 2004;27:1922–1928. doi: 10.2337/diacare.27.8.1922. [DOI] [PubMed] [Google Scholar]
- Lehmann E, Deutsch T. A physiological model of glucose-insulin interaction in type 1 diabetes mellitus. Journal of biomedical engineering. 1992;14:235–242. doi: 10.1016/0141-5425(92)90058-s. [DOI] [PubMed] [Google Scholar]
- Liu W, Park I, Wang Y, Principe JC. Extended Kernel Recursive Least Squares Algorithm. IEEE Transactions on Signal Processing. 2009;57:3801–3814. [Google Scholar]
- Liu W, Pokharel PP, Principe JC. The kernel least-mean-square algorithm. IEEE Transactions on Signal Processing. 2008;56:543–554. [Google Scholar]
- Liu W, Principe JC, Haykin S. Kernel adaptive filtering: a comprehensive introduction. John Wiley & Sons; 2011. [Google Scholar]
- Messori M, Toffanin C, Del Favero S, De Nicolao G, Cobelli C, Magni L. Model individualization for artificial pancreas. Computer Methods and Programs in Biomedicine. 2016 doi: 10.1016/j.cmpb.2016.06.006. [DOI] [PubMed] [Google Scholar]
- Nixon R, Pickup JC. Fear of hypoglycemia in type 1 diabetes managed by continuous subcutaneous insulin infusion: is it associated with poor glycemic control? Diabetes technology & therapeutics. 2011;13:93–98. doi: 10.1089/dia.2010.0192. [DOI] [PubMed] [Google Scholar]
- Nomura M, Fujimoto K, Higashino A, Denzumi M, Miyagawa M, Miyajima H, Nada T, Kondo Y, Tada Y, Kawaguchi R. Stress and coping behavior in patients with diabetes mellitus. Acta diabetologica. 2000;37:61–64. doi: 10.1007/s005920070020. [DOI] [PubMed] [Google Scholar]
- Noujaim SE, Horwitz D, Sharma M, Marhoul J. Accuracy requirements for a hypoglycemia detector: an analytical model to evaluate the effects of bias, precision, and rate of glucose change. Journal of diabetes science and technology. 2007;1:652–668. doi: 10.1177/193229680700100509. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pappada SM, Cameron BD, Rosman PM, Bourey RE, Papadimos TJ, Olorunto W, Borst MJ. Neural network-based real-time prediction of glucose in patients with insulin-dependent diabetes. Diabetes technology & therapeutics. 2011;13:135–141. doi: 10.1089/dia.2010.0104. [DOI] [PubMed] [Google Scholar]
- Parker RS, Doyle FJ, Peppas NA. A model-based algorithm for blood glucose control in type I diabetic patients. IEEE Transactions on Biomedical Engineering. 1999;46:148–157. doi: 10.1109/10.740877. [DOI] [PubMed] [Google Scholar]
- Parker RS, Doyle FJ, Ward JH, Peppas NA. Robust H∞ glucose control in diabetes using a physiological model. AIChE Journal. 2000;46:2537–2549. [Google Scholar]
- Pasieka AM, Riddell MC, Turner D, Luzio S, Gray B, Bain S, Hanley S, Richards A, Rhydderch D, Martin R. Advances in Exercise, Physical Activity, and Diabetes Mellitus. Diabetes technology & therapeutics. 2017;19:S-94–S-104. [Google Scholar]
- Percival MW, Zisser H, Jovanovic L, Doyle FJ., III Closed-loop control and advisory mode evaluation of an artificial pancreatic β cell: Use of proportional-integral-derivative equivalent model-based controllers. Journal of diabetes science and technology. 2008;2:636–644. doi: 10.1177/193229680800200415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pérez-Gandía C, Facchinetti A, Sparacino G, Cobelli C, Gómez E, Rigla M, De Leiva A, Hernando M. Artificial neural network algorithm for online glucose prediction from continuous glucose monitoring. Diabetes technology & therapeutics. 2010;12:81–88. doi: 10.1089/dia.2009.0076. [DOI] [PubMed] [Google Scholar]
- Peyser T, Dassau E, Breton M, Skyler JS. The artificial pancreas: current status and future prospects in the management of diabetes. Annals of the New York Academy of Sciences. 2014;1311:102–123. doi: 10.1111/nyas.12431. [DOI] [PubMed] [Google Scholar]
- Piccinini F, Dalla Man C, Vella A, Cobelli C. A Model for the Estimation of Hepatic Insulin Extraction After a Meal. IEEE Transactions on Biomedical Engineering. 2016;63:1925–1932. doi: 10.1109/TBME.2015.2505507. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reifman J, Rajaraman S, Gribok A, Ward WK. Predictive monitoring for improved management of glucose levels. Journal of diabetes science and technology. 2007;1:478–486. doi: 10.1177/193229680700100405. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sayed AH. Fundamentals of adaptive filtering. John Wiley & Sons; 2003. [Google Scholar]
- See L, Abrahart RJ. Multi-model data fusion for hydrological forecasting. Computers & geosciences. 2001;27:987–994. [Google Scholar]
- Shu C, Burn DH. Artificial neural network ensembles and their application in pooled flood frequency analysis. Water Resources Research. 2004;40 [Google Scholar]
- Sivananthan S, Naumova V, Man CD, Facchinetti A, Renard E, Cobelli C, Pereverzyev SV. Assessment of blood glucose predictors: the prediction-error grid analysis. Diabetes technology & therapeutics. 2011;13:787–796. doi: 10.1089/dia.2011.0033. [DOI] [PubMed] [Google Scholar]
- Stahl F, Johansson R, Renard E Ieee. 2012 Annual International Conference of the Ieee Engineering in Medicine and Biology Society. Ieee; New York: 2012. Bayesian Combination of Multiple Plasma Glucose Predictors; pp. 2839–2844. [DOI] [PubMed] [Google Scholar]
- Toffanin C, Visentin R, Messori M, Di Palma F, Magni L, Cobelli C. Towards a Run-to-Run Adaptive Artificial Pancreas. Silico Results IEEE Transactions on Biomedical Engineering. 2017 doi: 10.1109/TBME.2017.2652062. [DOI] [PubMed] [Google Scholar]
- Turksoy K, Kilkus J, Hajizadeh I, Samadi S, Feng J, Sevil M, Lazaro C, Frantz N, Littlejohn E, Cinar A. Hypoglycemia Detection and Carbohydrate Suggestion in an Artificial Pancreas. Journal of diabetes science and technology. 2016a:1932296816658666. doi: 10.1177/1932296816658666. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turksoy K, Monforti C, Park M, Griffith G, Quinn L, Cinar A. Use of Wearable Sensors and Biometric Variables in an Artificial Pancreas System. Sensors. 2017;17:532. doi: 10.3390/s17030532. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turksoy K, Quinn L, Littlejohn E, Cinar A. Multivariable adaptive identification and control for artificial pancreas systems. IEEE Transactions on Biomedical Engineering. 2014;61:883–891. doi: 10.1109/TBME.2013.2291777. [DOI] [PubMed] [Google Scholar]
- Turksoy K, Samadi S, Feng J, Littlejohn E, Quinn L, Cinar A. Meal detection in patients with type 1 diabetes: a new module for the multivariable adaptive artificial pancreas control system. IEEE journal of biomedical and health informatics. 2016b;20:47–54. doi: 10.1109/JBHI.2015.2446413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Visentin R, Dalla Man C, Cobelli C. One-Day Bayesian Cloning of Type 1 Diabetes Subjects: Toward a Single-Day UVA/Padova Type 1 Diabetes Simulator. IEEE Transactions on Biomedical Engineering. 2016;63:2416–2424. doi: 10.1109/TBME.2016.2535241. [DOI] [PubMed] [Google Scholar]
- Wang YQ, Wu XW, Mo X. A Novel Adaptive-Weighted-Average Framework for Blood Glucose Prediction. Diabetes technology & therapeutics. 2013;15:792–801. doi: 10.1089/dia.2013.0104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang YQ, Zhang JP, Zeng FM, Wang N, Chen XP, Zhang B, Zhao D, Yang WY, Cobelli C. “Learning” Can Improve the Blood Glucose Control Performance for Type 1 Diabetes Mellitus. Diabetes technology & therapeutics. 2017;19:41–48. doi: 10.1089/dia.2016.0328. [DOI] [PubMed] [Google Scholar]
- Zhao C, Dassau E, Harvey RA, Seborg DE, Doyle FJ. Predictive glucose monitoring for type 1 diabetes using latent variable-based multivariate statistical analysis. IFAC Proceedings Volumes. 2011;44:7102–7107. [Google Scholar]
- Zhao C, Dassau E, Zisser HC, Jovanovič L, Doyle FJ, Seborg DE. Online prediction of subcutaneous glucose concentration for type 1 diabetes using empirical models and frequency - band separation. AIChE Journal. 2014;60:574–584. [Google Scholar]
- Zhao C, Yu C. Rapid model identification for online subcutaneous glucose concentration prediction for new subjects with type I diabetes. IEEE Trans Biomed Eng. 2015;62:1333–1344. doi: 10.1109/TBME.2014.2387293. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
9 Clinical Experiment Results.xls, Table: Results for Nine Clinical Experiments. The results for linear adaptive filters (recursive least squares [RLS] and extended recursive least squares [EX-RLS]) and the nonlinear kernel-based filters (kernel recursive least squares [KRLS] and extended kernel recursive least squares [EX-KRLS]) for the experimental data of 9 subjects.
30 Virtual Patient Results.xls: Table: Results for Thirty Virtual Patients. The results for linear adaptive filters (recursive least squares [RLS] and extended recursive least squares [EX-RLS]) and the nonlinear kernel-based filters (kernel recursive least squares [KRLS] and extended kernel recursive least squares [EX-KRLS]) for the 30 subjects of the UVa/Padova simulator.






