Abstract
This paper discusses the application of optimal and sub-optimal controls to a SEQIJR SARS model via the Pontryagin’s Maximum Principle. To this end, two control variables representing the quarantine and isolation strategies are considered in the model. The numerical optimal control laws are implemented in an iterative method, and the sub-optimal solution is computed using a genetic algorithm. The simulation results demonstrate that the maximal applications of quarantining and isolation strategies in the early stage of the epidemic are of very critical impacts in both cases of optimal and sub-optimal control. Otherwise, the control effect will be much worse. This gives a theoretical interpretation to the practical experiences that the early quarantine and isolation strategies are critically important to control the outbreaks of epidemics. Furthermore, our results also show that the proposed sub-optimal control can lead to performances close to the optimal control, but with much simpler strategies for long periods of time in practical use.
Keywords: Optimal and sub-optimal control, Quarantine, Isolation, SARS model, Epidemics control, Genetic algorithm
1. Introduction
Severe acute respiratory syndrome (SARS), a new, highly contagious, viral disease, emerged in China late in 2002 and quickly spread to 32 countries and regions, causing in excess of 774 deaths and 8098 infections worldwide [1]. Since there are no valid medicines or vaccines for SARS, measures to control the spread of SARS had to take two major forms: isolation of symptomatic individuals and quarantining and close observation of asymptomatic individuals [2]. It had been shown that quarantining and isolating diseased individuals is a critically important strategy that can control SARS outbreaks, because of a reduction in the contact rate between susceptible and diseased individuals [2], [3], [4]. Moreover, Gumel [3] examines the impact of isolation and quarantine on the control of SARS during the outbreaks in Toronto, Hong Kong, Singapore and Beijing in a mathematical way. It uses a deterministic model that closely mimics the data for cumulative infected cases and SARS-related deaths.
In addition, mathematical models have recently been used to examine the transmission dynamics and to model the control of SARS in the literature [3], [4], [5], [6], [7], [8], [9], [10], [11], [12], [13], [14], [15]. But most of them are mainly in the purely simulative levels [5], [6], [7], [8], [9], [10]. Wang and Ruan [9] propose a mathematical model consists of six subpopulations, namely susceptible, exposed, quarantined, suspect, probable, and removed, to simulate the SARS outbreak in Beijing. Chowell and Castillo-Chavez [10] use the uncertainty and sensitivity analysis of the basic reproductive number to assess the role that the model parameters play in outbreak control, and the results show that the transmission rate and isolation effectiveness have the largest fractional effect on . Shi [11] and Lloyd-Smith [12] present a stochastic dynamic model of SARS spreading, and a stochastic model of a SARS outbreak in a community and its hospital, respectively. Furthermore, small-world networks have been introduced to study the propagation of SARS by Naoki Masuda [13] and Small [14]. It has been shown that if all infectious individuals are isolated as rapidly as they are identified, the severity of the outbreak would be minimal [14]. Moreover, Gumel [3] and Chowell [4] attempt to obtain a threshold for the basic reproductive number for assessing the strategies of quarantine and isolation, and discuss the control of SARS by looking at the role of disease transmission parameters in the reduction of and the prevalence of the disease, while the discrete case has been studied by Zhou and Ma [15]. However, those models do not consider control strategies, since their discussions are based on prevalence of disease at equilibria. In Swan’s work [16], optimal control theory is applied to obtain maximal benefits in terms of social benefits from the parsimonious use of insufficient public funds in the control of epidemics. Moreover, the Pontryagin’s Maximum Principle [17] and the time dependent control strategies are also applied for the studies of HIV models [18], mosquito-borne diseases [19], insect transmitted diseases [20], dengue models [21], tuberculosis models [22] and others [23].
In this paper, we consider the optimal and sub-optimal control strategies associated with quarantining asymptomatic individuals and isolating symptomatic individuals for a SARS SEQIJR model presented by Gumel [3]. The model monitors the dynamics of six sub-populations (classes), namely susceptible, asymptomatic, quarantined, symptomatic, isolated, and recovered individuals. We introduce, for the first time, into this model two control variables representing the rate of quarantining of asymptomatic individuals who have been exposed to the virus, but have not yet developed clinical symptoms, and the rate of isolating of symptomatic individuals, respectively.
The rest of the paper is organized as follows. Section 2 describes the SEQIJR SARS model. The analysis of optimization problems and the sub-optimal solution are presented in Sections 3, 4, respectively. In Section 5, we present the numerical method and the simulation results. Finally, the conclusions are summarized in Section 6.
2. Dynamic model for SARS epidemics
In this section, we use the dynamic SEQIJR model for SARS presented by Gumel [3]. By choosing the proper parameters, the simulation results from such a model fit the available data fairly well (see Section 3 in [3]).
(1) |
with given. Here, the host population is divided into the following epidemiological classes (state variables):
: Susceptible individuals;
: Asymptomatic individuals who have been exposed to the virus but have not yet developed clinical symptoms of SARS;
: Quarantined individuals;
: Symptomatic individuals;
: Isolated individuals;
: Recovered individuals;
The model synthesizes some demographic effects by assuming a proportional natural death rate in each of the six sub-populations of the model and the constant recruitment rate . In addition, it also includes a net inflow of asymptomatic individuals into the region at a rate per unit time. This parameter includes new births, immigration and emigration. Owing to the continuing inflow of travellers into the community during the SARS outbreaks, and the absence of a rapid and effective screening test, it is assumed that some of these travellers are asymptomatically infected and enter the community at a rate per day. In this work, we set to zero for simplicity. We assume that a susceptible individual may be infected through contacts with an asymptomatic individual, a quarantined individual, an infected individual, or an isolated individual.
The transmission coefficients for these four classes of infected individuals are , , , and respectively. Although SARS is believed to be transmitted exclusively by symptomatic individuals, a very low rate of transmission by asymptomatic individuals cannot yet be ruled out. In the model this possibility is depicted by employing the modification parameter , where .
The modification parameter represents varying levels of hygiene precautions during quarantine, and a similar interpretation is given to the modification parameter during isolation [3]. An asymptomatic individual is transferred into the symptomatic class (at a rate ), and a quarantined individual is transferred into the isolated class (at a rate ) because of the development of clinical symptoms. and are per-capita disease induced death rates for the symptomatic individuals and isolated individuals, respectively. In addition, and are per-capita recovery rates for the symptomatic individuals and isolated individuals, respectively.
The control variables, and , are bounded, Lebesgue integrable functions [22]. The control represents the rate of quarantining of people who have been in contact with an infected individual by a quarantine program and educational campaigns. The control represents the rate of isolating of symptomatic individuals by an isolation program. Furthermore, from the epidemiological modeling viewpoint, the transfer rate corresponds to an exponential waiting time , as the fraction that is still in the asymptomatic class units after entering this class and to as the mean waiting time [24]. And the interpretation of is similar to .
3. The optimal control problems
The problem is to minimize the cost function
(2) |
subject to the differential equations (1), where is the final time. This performance specification involves the numbers of individuals of symptomatic, asymptomatic, quarantined, or isolated, respectively, as well as the cost for applying quarantine control () and isolation control (). The total cost includes not only the consumption for every individual, but also the cost of organization, management, and cooperation etc. Hence, the cost function should be nonlinear. In this paper, a quadratic function is implemented for measuring the control cost by reference to many papers in epidemic control [18], [19], [20], [21], [22]. The coefficients,, , , , and , are balancing cost factors due to size and importance of the six parts of the objective function. We seek to find an optimal control pair, and , such that
(3) |
Here and , are fixed positive constants.
Pontryagin’s Maximum Principle [17] provides the necessary conditions for an optimal control problem. This principle converts (1), (2), (3) into a problem of minimizing a Hamiltonian, , pointwise with respect to and :
(4) |
where is the right hand side of the differential equation of -th state variable. By applying Pontryagin’s Maximum Principle [17], we have the adjoint equations
i.e.
(5) |
with transversality conditions
(6) |
By the bounds in , the optimal control is given by
(7) |
and
(8) |
which are derived from the condition
Remark 1
Due to the a priori boundedness of the state and adjoint functions and the resulting Lipschitz structure of the ODEs, we obtain the uniqueness of the optimal control for small [22]. The uniqueness of the optimal control pair follows from the uniqueness of the optimality system, which consists of (1), (5), (6) with characterizations (7), (8). There is a restriction on the length of the time interval in order to guarantee the uniqueness of the optimality system. This smallness restriction on the length on the time interval is due to the opposite time orientations of (1), (5), (6); the state problem has initial values and the adjoint problem has final values. This restriction is very common in control problems (see [18], [22]).
Remark 2
The problem described above is a Two Point Boundary Value Problem (TPBVP), with specified initial conditions for the state equation (1), and terminal boundary conditions (6) for the adjoint equation (5). It can be numerically solved by the iteration method presented in Section 5.
4. A sub-optimal solution
In this section, the sub-optimal solution is obtained by a genetic algorithm which follows the idea of [21]. Let the class of admissible controls be restricted to the collection of functions of type
(9) |
where are constants, and are closed intervals such that if . Therefore, the restricted class admissible controls consist of pulses of height and width , starting at time .
In order to simplify the actual policy implementation, we assume that the two controls are to be of pulsed form. Let be admissible controls with pulses, characterized by . Therefore, the sub-optimal control problem is to minimize
where is the same as defined in (2).
Let for the case of pulses, and the sub-optimal control problem is simply
In this work, the search for a global minimum of is implemented by an extended method based on the Genetic Algorithm [25]. This extension admits the constraints , , , and ,.
5. Numerical simulation
In this section, we investigate the numerical algorithm for optimal control in SARS model. The optimal Quarantine and Isolation Control is obtained by solving the optimality conditions, consisting of twelve ODEs from the state and their adjoint equations. This problem (TPBVP) is solved by using the multiple shooting method (see, for instance, [21], [26], [27]) as follows:
-
(1)
Select nodes to divide the interval , or, .
-
(2)
Choose , .
-
(3)
Integrate (1), (5) for each time interval using as the initial conditions, and obtaining .
-
(4)
Compute where .
-
(5)
If is sufficiently close to a minimum value, then stop; Else modify the initial conditions for the next iteration (using, for instance, the Newton–Raphson algorithm to make ) and go to step (3).
In this work, the optimal control was computed using the multiple shooting method with 30 nodes, up to a tolerance of 10−5 for . Considering the four weight factors associated with , , and , we choose , and to illustrate the optimal strategies.
Remark 3
We assume that the weight factor associated with control is much larger than , which is associated with control . This assumption is based on the following facts: The cost associated with mainly includes the cost of monitoring and quarantining programs, while the cost associated with includes the cost of monitoring and isolating programs, and the hospital treatment resource. The ideal weights are very hard to obtain in practice. It needs a lot of work on data mining, analyzing, and fitting. Hence, the acquisition of appropriate practical weights is a difficult problem and it still remains for further investigations. It should be pointed out that the weights in the simulations here are of only theoretical interest to illustrate the control strategies proposed in this paper.
In the simulation, we study the impact of optimal quarantine and isolation control on SARS during the outbreaks in Beijing. We choose the upper bound of equals 0.50, according to the reasonable case in China that it took at least an average of 2 days to quarantine the asymptomatic individuals who had been exposed to the virus, but had not yet developed clinical symptoms. And the choice of upper bound of is similar to . The sub-optimal control was computed for the case and specified time intervals: , and . Parameters such as population size for the genetic algorithm, generation gap and others were adjusted ad hoc [21]. The data and parameters we used, as shown in Table 1 , are mainly from the published data [3], [9]. In order to evaluate the effect of the uncertainty on the model parameters, simulations were repeated with values of , , , , , , , , , and , altered by random values in the range ±10% (normal distribution), while the inputs and were kept identical to the computed optimal values.
Table 1.
Parameters | Values | Computational parameters | Values |
---|---|---|---|
0.2 | 12 million | ||
0.3 | 1565 | ||
0 | 292 | ||
0.1 | 695 | ||
0.000034 | 326 | ||
20 | |||
0 | Final time | 1 year | |
0.1 | Time step duration | 1 day | |
0.125 | Upper bound for | 0.50 | |
0.0079 | Lower bound for | 0.05 | |
0.0068 | Upper bound for | 0.50 | |
0.0337 | Lower bound for | 0.05 | |
0.0386 |
Fig. 1 shows the time dependent optimal and sub-optimal quarantine and isolation control laws. In order to minimize the total infected individuals, , the optimal control is at its upper bound during more than the half of the year, and then is steadily decreased to the lower bound, while the optimal control stays at its upper bound for a short time, about 70 days and then steadily decreases to the lower bound over the rest simulated time. The sub-optimal control laws and stay at the upper bound during the first two time intervals and the first time interval, respectively.
In fact, at the beginning of simulated time, both the optimal control and sub-optimal control are staying at their upper bounds in order to quarantine and isolate as many as asymptomatic individuals () and symptomatic individuals () to prevent the increasing of the number of the infected individuals. For both and , the steady decrease to the lower bound in the optimal control case, and the staying at a proper value in the sub-optimal case, are determined by the balance between the cost of the infected individuals and the cost of the controls.
A comparison of the optimal control, the sub-optimal control and the constant controls and throughout the simulated time are also implemented (Fig. 2 ). It is easy to see that the optimal control and sub-optimal control are much more effective for reducing the number of infected individuals and decreasing the time-span of the epidemic. As normally expected, in the early phase of the epidemic breakouts, keeping the quarantine and isolation controls at their upper bounds will directly lead to decreasing of the number of the infected people. Moreover, Fig. 3 shows that if we take the lower bound values for each control throughout the simulated time, the number of infected individuals would reach about 4.1919×106 (nearly 35% of the total population). This illustrates that the quarantine and isolation strategies are critically important to control the outbreaks of SARS. In addition, in order to illustrate the overall of picture of the epidemic, the number of infected and recovered individuals under the optimal control, the sub-optimal control, the constant control and the lower bound control are shown, respectively, in Fig. 4, Fig. 5, Fig. 6, Fig. 7, Fig. 8, Fig. 9 .
The costs achieved by the optimal control and sub-optimal control are much less than the constant control and the lower bound control, as shown in Fig. 10, Fig. 11 . It is interesting to note that the cost achieved by the sub-optimal control is very close to that of the optimal control, despite the fact that the sub-optimal control is much easier to implement than the optimal control.
6. Conclusions
In this paper, we introduced, for the first time, two control variables to represent the quarantine and isolation strategies in epidemic control. The optimal and sub-optimal quarantine and isolation controls for a SEQIJR SARS model were studied. The numerical results show both the optimal and sub-optimal strategy for SARS epidemic control are effective. Furthermore, this idea of introducing these two new control variables is helpful for further discussions on catastrophic epidemic control. It should be pointed out that, as was mentioned in [23], the ideal time-varying optimal strategy might not be applied in practice easily. Nevertheless, it does provide a reference basis on which to design the practical quasi-optimal control strategies or policies, and to assess their effectiveness. However, the proposed sub-optimal control in this paper can provide much simpler strategies, which, as verified by numerical simulations, can also lead to a performance very similar to that achieved by the optimal control. In practical implementations, it is considerably easier to use such a sub-optimal control.
Acknowledgements
This work was jointly supported by the National Natural Science Foundation of China under Grant Nos. 60474078, 60574015, 60304001.
Contributor Information
Xiefei Yan, Email: yanxiefei@hotmail.com.
Yun Zou, Email: zouyun@vip.163.com.
References
- 1.Lingappa J.R., McDonald L.C., Simone P., Parashar U.D. Wresting SARS from uncertainty. Emerging Infectious Diseases. 2004;10:167–170. doi: 10.3201/eid1002.031032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.WHO, Consensus document on the epidemiology of severe acute respiratory syndrome (SARS). http://www.who.int/csr/sars/en/WHOconsensus.pdf, 2003
- 3.Gumel A.B. Modelling strategies for controlling SARS outbreaks. Proceedings of the Royal Society of London - B. 2004;271:2223–2232. doi: 10.1098/rspb.2004.2800. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Chowell G., Fenimore P.W., Castillo-Garsow M.A., Castillo-Chavez C. SARS outbreaks in Ontario, Hong Kong and Singapore: The role of diagnosis and isolation as a control mechanism. Journal of Theoretical Biology. 2003;224:1–8. doi: 10.1016/S0022-5193(03)00228-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Dye C., Gay N. Modeling the SARS epidemic. Science. 2003;300:1884–1885. doi: 10.1126/science.1086925. [DOI] [PubMed] [Google Scholar]
- 6.Riley S. Transmission dynamics of etiological agent of SARS in Hong Kong: Impact of public health interventions. Science. 2003;300:1961–1966. doi: 10.1126/science.1086478. [DOI] [PubMed] [Google Scholar]
- 7.Lipsitch M. Transmission dynamics and control of severe acute respiratory syndrome. Science. 2003;300:1966–1970. doi: 10.1126/science.1086616. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Donnelly C.A. Epidemiological determinants of spread of causal agent of SARS in Hong Kong. Lancet. 2003;361:1761–1766. doi: 10.1016/S0140-6736(03)13410-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Wang W., Ruan S. Simulating the SARS outbreak in Beijing with limited data. Journal of Theoretical Biology. 2004;227:369–379. doi: 10.1016/j.jtbi.2003.11.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Chowell G. Model parameters and outbreak control for SARS. Emerging Infectious Diseases. 2004;10(7):1258–1263. doi: 10.3201/eid1007.030647. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Shi Y.L. Stochastic dynamic model of SARS spreading. Chinese Science Bulletin. 2003;48(13):1287–1292. doi: 10.1007/BF03184164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Lloyd-Smith J.O., Galvani A.P., Getz W.M. Curtailing transmission of severe acute respiratory syndrome within a community and its hospital. Proceedings of the Royal Society of London - B. 2003;270(1528):1979–1989. doi: 10.1098/rspb.2003.2481. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Masuda Naoki, Konno Norio, Aihara Kazuyuki. Transmission of severe acute respiratory syndrome in dynamical small-world networks. Physical Review E. 2004;69:031917-1-6. doi: 10.1103/PhysRevE.69.031917. [DOI] [PubMed] [Google Scholar]
- 14.Small M., Tse C.K. Small world and scale free model of transmission of SARS. International Journal of Bifurcation and Chaos. 2005;15(5):1745–1755. [Google Scholar]
- 15.Zhou Y.C., Ma Z.E. A discrete epidemic model for SARS transmission and control in China. Mathematical and Computer Modelling. 2004;40:1491–1506. doi: 10.1016/j.mcm.2005.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Swan G.W. Marcel Dekker; New York: 1984. Applications of Optimal Control Theory in Biomedicine. [Google Scholar]
- 17.Pontryagin L.S., Boltyanskii V.G., Gamkrelidze R.V., Mishchenko E.F. Wiley; New York: 1962. The Mathematical Theory of Optimal Processes. [Google Scholar]
- 18.Kirschner D., Lenhart S., Serbin S. Optimal control of the chemotherapy of HIV. Journal of Mathematical Biology. 1997;35:775–792. doi: 10.1007/s002850050076. [DOI] [PubMed] [Google Scholar]
- 19.J.A.M. Felippe de Souza, T. Yoneyama, Optimization of investment policies in the control of mosquito-borne diseases, in: Proceedings of the American Control Conference, 1992 ACC, Chicago, IL, USA, 1992, pp. 681–682
- 20.J.A.M. Felippe de Souza, T. Yoneyama, Optimization of the investment in educational campaigns in the control of insect transmited diseases, in: Proceedings of the 3rd IEEE Conference on Control Applications, Glasgow, Scotland, Aug. 1994, pp. 1689–1694
- 21.Caetano M.A.L., Yoneyama T. Optimal and sub-optimal control in Dengue epidemics. Optimal Control - Applications and Methods. 2001;22:63–73. [Google Scholar]
- 22.Jung E., Lenhart S., Feng Z. Optimal control of treatments in a two-strain tuberculosis model. Discrete and Continuous Dynamical Systems-Series B. 2002;2(4):473–482. [Google Scholar]
- 23.Gupta N.K., Rink R.E. Optimal control of epidemics. Mathematical Biosciences. 1973;18:383–396. [Google Scholar]
- 24.Hethcote H.W. The mathematics of infectious diseases. SIAM Review. 2000;42:599–653. [Google Scholar]
- 25.Davis L. Pitman; London: 1987. Genetic Algorithms and Simulated Annealing. [Google Scholar]
- 26.Bulirsch R., Stoer J. Springer; Berlin: 1980. Introduction to Numerical Analysis. [Google Scholar]
- 27.Pesch H.J. Real time computation of feedback controls for constrained optimal control problems. Part 2: A correction method based on multiple shooting. Optimal Control Applications and Methods. 1989;10:147–171. [Google Scholar]