Optimal control of glucose balance in ICU patients based on GlucoSafe model
© Marheineke et al.; licensee Springer. 2014
Received: 7 May 2012
Accepted: 19 March 2014
Published: 3 June 2014
Model-based medical decision support in terms of computer simulations, predictions and optimization gains increasing importance in health care systems worldwide. This work deals with the control of the glucose balance in intensive care unit (ICU) patients providing nutrition and insulin. The basis of the investigations is the bio-medical model GlucoSafe by Pielmeier et al. (Comput. Methods Programs Biomed. 97(3):211-222, 2010) that describes the temporal evolution of the blood glucose and insulin concentrations in the human body by help of a nonlinear dynamic system of first-order ordinary differential equations. This paper aims at the theoretical analysis and numerical treatment of the arising optimal control problem. Numerical results demonstrate the controllability and applicability of the model, in particular critical hyper- and hypoglycemic initial states are considered.
Keywordsbio-medical modeling blood glucose regulation optimal control ordinary differential equations
Glucose is the major carbohydrate fuel of the human body. Blood glucose refers to the amount of sugar (glucose) circulating in the blood. The human red cell and brain depend entirely on the blood glucose for the energy metabolism, about 80% of the human body’s daily glucose consumption (in total about 200 g) is due to these cells . The maintenance of a normal concentration of blood glucose (5 mmol/l; 100 mg/dl) - i.e. only one-fifth of a teaspoon of sugar in a liter of blood - is essential for survival. When the blood glucose decreases to less than 2.25 mmol/l, hypoglycemia (low blood glucose) develops and compromises the brain function, leading to confusion, disorientation and possibly life-threatening coma. Hypoglycemia poses an immediate threat to life , on the other hand persisting hyperglycemia (high blood glucose) with concentrations greater than 6.25 mmol/l puts a human at risk for renal, vascular and eye diseases. The anabolic hormone insulin plays a key role in the regulation of the blood glucose. In healthy individuals with a normal insulin response glucose levels are relatively stable and average at different times of day at 5-6 mmol/l with a standard deviation of about 0.8-1.0 mmol/l [3, 4]. But patients who are critically ill are often insulin resistant, i.e. a given amount of insulin produces a less than expected response. So, more insulin is required in a critically ill state to cause the ‘normal’ effect. In intensive care units (ICUs) worldwide it has become standard practice - also for nondiabetic patients - to measure blood glucose concentrations frequently (mostly using measurement intervals of 2-3 hours for nondiabetics) and to administer insulin by infusion or injection if the patient is hyperglycemic (>7-8 mmol/l) .
The glucose normalization in ICU patients is a desired goal, as studies have demonstrated that normal glucose levels with low variability (fluctuations) are associated with reduced mortality and less complications in the healing process, compared to hyperglycemic ICU patients . So far, clinical standard regulation procedures rely on the use of ad-hoc insulin protocols that are primarily based on experience. In combination with the unpredictable sudden changes in the insulin resistance that are typical for ICU patients  and/or with clinical modifications of the nutrition support, the protocol approach result in highly variable blood glucose levels being characterized by periods of hyper- or hypoglycemia and oscillations between these states . The risk of (life-threatening) hypoglycemia increases up to sixfold with these standard insulin protocols, and even for very tight (1 hour or less) measurement intervals the risk is significantly higher. Therefore, model-based medical decision support gains increasingly importance, see  and references within. There is a strong need for more rigorous investigations, long-time predictions and optimal control on basis of computer simulations that model-based medical decision support methods bring to this type of problem. Apart from the medical benefit also the socio-economic profit of a safe and efficacious glucose control in the ICU might be considerable. The United States’ spending on critical care amounts to 1% of its gross domestic product. Cost analysis studies in Europe and the United States estimate that 2,640 Euros or US$ 1,580, respectively can be saved per patient staying in the ICU with a tight model/simulation-based glucose control .
This work deals with the optimal control of the glucose balance in ICU patients, regarding insulin therapy and appropriate food supply. The basis is the bio-medical model GlucoSafe developed by Pielmeier et al. . The temporal evolution of glucose and insulin concentrations is described by a nonlinear dynamic system of first-order ordinary differential equations (ODE) that is closed by a parameter estimate for the insulin saturation. We perform a theoretical analysis of the model (regarding existence, uniqueness) and propose an adequate and efficient numerical method. The simulation results demonstrate the controllability and applicability of the model. Thereby, we particularly focus on long-time predictions and the control of hyper- and hypoglycemic initial states, in comparison to measurements. A large randomized clinical study to test the described approach is in progress.
The paper is structured as follows. Starting with a short introduction into the bio-medical problem, we formulate the optimal control problem as -minimization with ODE-constraints in Section 2. Sections 3 and 4 deal with the theoretical investigation and numerical handling, respectively. Simulation results for prognosis/prediction and optimization are presented and discussed in view of the medical circumstances in Section 5. We conclude with perspectives for future model extensions and modifications.
2 Optimal control problem
Our goal is the optimal control of the blood glucose concentration in ICU patients using the supply of nutrition and insulin as control variables. The optimization is based on an ODE-model for the compartmental description of the glucose metabolism.
Compartmental-based ODE-model for glucose metabolism
Here denotes the measured blood glucose value at the discrete time point and is the corresponding numerical result computed in dependence on the parameter σ, in particular , is considered. For further explanations about the underlying bio-medical processes and respective closure relations to (1) we refer to .
Remark 1 Alternatively to (2) one might also think about a weighted fit where recent measurements are considered to be of higher relevance for the insulin effect adaption than older ones, . However, the data set is relatively small because the typical measurement intervals due to clinical standards are 2-3 hours and the insulin effect changes over the day. Practically, only 2-3 measured values (within the last 6 hours) are taken into account in (2) (see Figure 3 in Section 5).
Note that only the blood glucose G can be measured, but not D, I and P. This makes the initialization of (1) at a certain time inexact. In combination to the measured blood glucose , reference values for D, I, P at might be taken from literature . The initial perturbation that is carried into the system decreases over time due to the asymptotic stability of the ODE-model, see Section 3. During the course of a medical treatment previous simulation results are used as better initial guesses. For the parameter calibration of σ in (2), the same initialization procedure is applied, only with the exception that (1) is solved backward in time to yield in the past.
ODE-constrained minimization problem
where is the desired blood glucose concentration and is the desired control based on bio-medical and economic reasons with weights . The control space is specified in the following.
3 Theoretical investigation
The optimal control problem for the blood glucose stated in (3) can be embedded in the well-established theory of ODE-constrained optimization problems. Since the theoretical investigations can be performed by help of standard techniques [18, 19], we restrict ourselves to the presentation of the analytic results, omitting the respective derivations. In addition, we specify the space of admissible controls .
The underlying initial value problem (1) for the glucose metabolism is well-posed in the sense of Hadamard, i.e. there exists a unique solution that depends continuously on the initial conditions. For continuous controls the initial value problem is solvable in the classical sense. Existence and uniqueness of the solution are given according to the Picard-Lindelöf theorem for the sufficiently smooth model functions on the right-hand side of (1). However, bio-medical reasons require in general the use of noncontinuous controls. Considering , the system (1) has got a unique nonnegative solution in the sense of Carathéodory for every choice of nonnegative initial values. This stands in accordance with biological demands (i.e. nonnegative state and control variables). In the following, we consider the space of piecewise constant nonnegative bounded functions as set of admissible controls . This is reasonable and sufficient for the application regarding insulin and food supply via infusions. Moreover, the structure of the dynamic system allows the decoupling into a linear system for I and P, a Riccati equation for D and a nonlinear equation for G. The differential equations for I, P and D posses explicit solution formulas for the chosen control space . However, due to the required very technical case-by-case analysis the formulas are quite lengthy and omitted here, see . Furthermore, for each steady state there exist a constant control and steady states , so that all together satisfy (1). It can be shown that this solution is asymptotically stable in all medically relevant cases and for all possible patient data. So, the controllability of arbitrary stationary states is possible in . The existence of optimal controls in the space can be proven straight forward for (3), following the ideas and procedure prescribed in . Uniqueness is lacked due to the nonlinearity of (1); however, this is not necessary from a user point of view.
4 Numerical approach
The medical decision support in ICUs requires an efficient numerical handling of the optimal control problem in view of computation time and accuracy. Therefore, it is advantageous to consider the associated equivalent reduced problem , .
To solve ODEs efficient techniques have been developed, [20, 21]. As the GlucoSafe model (1) is not stiff, the numerical computation can be performed by standard explicit Runge-Kutta methods. We use the Dormand-Prince method (DOPRI) to calculate fifth- and fourth-order accurate solutions. The difference between these solutions is considered as error of the (fourth-order) solution and integrated in the adaptive step-size control . The computational effort can be even reduced by a factor of two when the analytical solution formulas for D, I, P are used for the calculation for G.
The optimal control problem (3) can be approached by direct and indirect methods . Testing various of them we have compared conditional gradient method, gradient projection method and Newton-type methods as indirect methods with the direct SQP-method. Regarding accuracy and computational efficiency, the indirect methods cannot compete with the direct one for this special problem (3); they are slower by a factor of about 50. Hence, we use the SQP-method with numerically calculated gradients  in the following.
Remark 2 Note that the SQP-method is also applied to the identification of the parameter σ in the insulin effect quantity , cf. parameter calibration/fitting problem in (2).
Remark 3 The implementation is realized in MATLAB, version 7.7. Thereby, we use the MATLAB routines ode45 and fmincon for the Dormand-Prince method and the SQP-method, respectively. The adaptive step-size control of the ODE-solver meets absolute and relative error tolerances of and . The optimization is run with the termination criteria: function evaluations, 500 iterations and tolerance for variable/cost function of 10−12 for the following numerical results.
5 Results and discussion
Gender (female: 0, male: 1)
Diabetes type (no: 0, yes⋆: 1, 2)
P 99 (a|b)
P 111 (a|b)
- (a): supply of insulin, no nutrition,
- (b): supply of insulin and enteral nutrition (via gastric tube),
- (c): supply of insulin and nutrition.
Figure 4 illustrates the control of a hyperglycemic initial state (). In all three control cases the blood glucose concentration is decreased to the desired level after the first hour. But it is interesting to see that the choice of controls differs. Allowing all kind of supplies, the insulin rate is exaggerated and combined with additional nutrition. Thereby, the use of parenteral nutrition affects the blood glucose directly (intravenous access) and yields the desired result at fastest. The recommended combination of insulin and nutrition provides a very stable blood glucose level for the next hours. Studying the influence of the diabetes type (adult-onset diabetes in Figure 4(top) or juvenile-onset diabetes in Figure 4(bottom)) it turns out that the required supply is generally higher for adult-onset diabetes (type 2). Moreover, the blood glucose concentration is more fluctuating around the desired level as expected. However, this is not worth mentioning in view of the high oscillations that are in general observed in the traditional ad-hoc insulin protocol approaches at ICUs. So, the optimization results for hyperglycemic initial states are very satisfying and clearly differ (positively) from the ones of the ad-hoc approaches. Similar results are achieved starting with an already balanced blood glucose of 5-6 mmol/l, here the desired state can be even reached within 20 minutes (see Figure 5, Case c). Although ICU patients suffer mostly from hyperglycemia, we are also interested in the controllability and applicability of our approach for hypoglycemia. Figure 6(top) shows a very critical life-threatening scenario of a patient after a medical diet with a initial blood glucose level . As expected the exclusive insulin supply (Case a) provides no help for a nondiabetic person. But the other control strategies are successful in the glucose normalization. In analogy to the hyperglycemic problems, Case c yields the desired state at fastest within 20 minutes. But certainly the composition of the controls is different: the enteral tube feeding plays here the major role. The parenteral nutrition is just applied as support within the first 30 minutes in combination with a little rate of insulin. Without the intravenous access (Case b) it takes longer to reach the desired state (more than 2 hours). The results are reasonable and show again a very stabilized blood glucose level at the end of the observation interval without any fluctuations. Repeating the computations for diabetes type 1 yields comparable results, but the supplies of enteral nutrition and insulin are longer and higher (Figure 6(bottom)). Only the simulation of Case a raises questions as the exclusive supply of insulin causes an increase of the blood glucose concentration. This is unexpected and requires further investigations.
A statistical validation of the numerical results is not yet possible due to the relatively small sample of measurements at hand. But the described approach has been implemented in a software tool at the Center of Model-based Medical Decision Support, University Aalborg that is recently applied and tested in a large clinical study.
6 Conclusion and outlook
This paper presented a theoretical and numerical investigation of the bio-medical model GlucoSafe. It shows the controllability and applicability of the model for the optimal control of the blood glucose concentration in ICU patients via the supply of parenteral and enteral nutrition as well as exogenous insulin. In view of long-time predictions and optimization (regulation) the simulation results are very convincing, in particular for ICU patients having a temporal relatively stable pharmacodynamic effect of the insulin on the glucose intake. Arising changes in the insulin effect are incorporated in the model by frequent parameter adaptions. A large randomized clinical study to test the described approach is in progress.
Improvements of the model rely surely on a better bio-medical understanding of the insulin effect on the glucose intake, implying a concrete definition of the insulin function . But also the modeling of the liver balance h as well as the endogenous insulin intake n being assumed to be constant so far pose open research questions to the bio-medical experts. The introduction of a glucose-dependent n would lead to a fully coupled dynamic system for all state variables. An interesting future task (from the bio-medical and mathematical point of view) is the consideration and incorporation of uncertainties coming from the patient data and the measurements. This results in a stochastic control problem for which sensitivity/robustness and controllability have to be investigated.
The research team by Steen Andreassen, Center for Model-based Medical Decision Support, Aalborg University is acknowledged for providing a sample of patient and clinical treatment data.
- Baynes JW, Dominiczak MH: Medical Biochemistry. Elsevier Mosby, Maryland Heights; 2005.Google Scholar
- Egi M, Bellomo R, Stachowski E, French CJ, Hart GK, Taori G, Hegarty C, Bailey M: Hypoglycemia and outcome in critically ill patients. Mayo Clin. Proc. 2010,85(3):217–224. 10.4065/mcp.2009.0394View ArticleGoogle Scholar
- Mazze RS, Strock E, Wesley D, Borgman S, Morgan B, Bergenstal R, Cuddihy R: Characterizing glucose exposure for individuals with normal glucose tolerance using continuous glucose monitoring and ambulatory glucose profile analysis. Diabetes Technol. Ther. 2008,10(3):149–159. 10.1089/dia.2007.0293View ArticleGoogle Scholar
- Borg R, Kuenen J, Carstensen B, Zheng H, Nathan D, Heine R, Nerup J, Borch-Johnsen K, Witte D: Real-life glycaemic profiles in non-diabetic individuals with low fasting glucose and normal HbA1c: the A1C-Derived Average Glucose (ADAG) study. Diabetologia 2012,53(8):1608–1611.View ArticleGoogle Scholar
- Hirshberg E, Lacroix J, Sward K, Willson D, Morris AH: Blood glucose control in critically ill adults and children: a survey on stated practice. Chest 2008,133(6):1328–1335. 10.1378/chest.07-2702View ArticleGoogle Scholar
- Bilotta F, Rosa G: Glycemia management in critical care patients. World J. Diabetes 2012,3(7):130–134. 10.4239/wjd.v3.i7.130View ArticleGoogle Scholar
- Pretty CG, Compte AJL, Chase JG, Shaw GM, Preiser JC, Penning S, Desaive T: Variability of insulin sensitivity during the first 4 days of critical illness: implications for tight glycemic control. Ann. Intensive Care 2012., 2: Article ID 17 Article ID 17Google Scholar
- Chase JG, Shaw GM, Wong XW, Lotz T, Lin J, Hann CE: Model-based glycaemic control in critical care - A review of the state of the possible. Biomed. Signal Process. Control 2006, 1: 3–21. 10.1016/j.bspc.2006.03.002View ArticleGoogle Scholar
- Pielmeier U: Decision support for blood glucose control in critically ill patients: development and clinical pilot testing of the GlucoSafe system. PhD thesis. Aalborg University, Department of Health Science and Technology, Denmark; 2010. [ISBN 978–87–7094–073–3]. Pielmeier U: Decision support for blood glucose control in critically ill patients: development and clinical pilot testing of the GlucoSafe system. PhD thesis. Aalborg University, Department of Health Science and Technology, Denmark; 2010. [ISBN 978-87-7094-073-3].
- Scurlock C, Raikhelkar J, Mechanick JI: The economics of glycemic control in the ICU in the United States. Curr. Opin. Clin. Nutr. Metab. Care 2011,14(2):209–212. 10.1097/MCO.0b013e3283437bc4View ArticleGoogle Scholar
- Pielmeier U, Andreassen S, Nielsen BS, Chase JG, Haure P: A simulation model of insulin saturation and glucose balance for glycaemic control in ICU patients. Comput. Methods Programs Biomed. 2010,97(3):211–222. 10.1016/j.cmpb.2009.06.004View ArticleGoogle Scholar
- Zierler K: Whole body glucose metabolism. Am. J. Physiol: Endocrinol. Metab. 1999,276(39):E409-E426.Google Scholar
- van Cauter E, Mestrez F, Sturis J, Polonsky KS: Estimation of insulin secretion rates from C-peptide levels. Comparison of individual and standard kinetic parameters for C-peptide clearance. Diabetes 1992,41(3):368–377. 10.2337/diab.41.3.368View ArticleGoogle Scholar
- Arleth T, Andreassen S, Federici MO, Benedetti MM: A model of the endogenous glucose balance incorporating the characteristics of glucose transporters. Comput. Methods Programs Biomed. 2000,62(3):219–234. 10.1016/S0169-2607(00)00069-9View ArticleGoogle Scholar
- Matthaei S, Stumvoll M, Kellerer M, Häring HU: Pathophysiology and pharmacological treatment of insulin resistance. Endocr. Rev. 2000,21(6):585–618.Google Scholar
- Andreassen S, Pielmeier U, Chase G: Receptor-based models of insulin saturation dynamics. Proceedings of the Sixth IASTED International Conference on Biomedical Engineering 2008, 182–186. No. 601–066. No. 601-066.Google Scholar
- Cibis TM: Optimale Steuerung des Glukosehaushalts bei intensiv-gepflegten Patienten. Master’s thesis. Johannes Gutenberg-Universität Mainz, Department Mathematics, Germany; 2010. Cibis TM: Optimale Steuerung des Glukosehaushalts bei intensiv-gepflegten Patienten. Master’s thesis. Johannes Gutenberg-Universität Mainz, Department Mathematics, Germany; 2010.
- Tröltzsch F: Optimale Steuerung partieller Differentialgleichungen: Theorie, Verfahren und Anwendungen. Vieweg, Wiesbaden; 2005.View ArticleGoogle Scholar
- Alt W: Nichtlineare Optimierung: Eine Einführung in Theorie, Verfahren und Anwendungen. Vieweg, Wiesbaden; 2002.View ArticleGoogle Scholar
- Hairer E, Norsett SP, Wanner G: Solving Ordinary Differential Equations I - Nonstiff Problems. Springer, Berlin; 1993.MATHGoogle Scholar
- Hairer E, Wanner G: Solving Ordinary Differential Equations II - Stiff and Differential-Algebraic Problems. Springer, Berlin; 1996.MATHView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.