∎
University Hassan II of Casablanca, P.O. Box 146, Mohammedia, Morocco
33email: allali@hotmail.com 44institutetext: S. Harroudi55institutetext: 55email: sanaa.harroudi@gmail.com 66institutetext: D. F. M. Torres (✉) 77institutetext: Center for Research and Development in Mathematics and Applications (CIDMA),
Department of Mathematics, University of Aveiro, 3810-193 Aveiro, Portugal
77email: delfim@ua.pt
Analysis and optimal control of an intracellular
delayed HIV model
with CTL immune response
Abstract
A delayed model describing the dynamics of HIV (Human Immunodeficiency Virus) with CTL (Cytotoxic T Lymphocytes) immune response is investigated. The model includes four nonlinear differential equations describing the evolution of uninfected, infected, free HIV viruses, and CTL immune response cells. It includes also intracellular delay and two treatments (two controls). While the aim of first treatment consists to block the viral proliferation, the role of the second is to prevent new infections. Firstly, we prove the well-posedness of the problem by establishing some positivity and boundedness results. Next, we give some conditions that insure the local asymptotic stability of the endemic and disease-free equilibria. Finally, an optimal control problem, associated with the intracellular delayed HIV model with CTL immune response, is posed and investigated. The problem is shown to have an unique solution, which is characterized via Pontryagin’s minimum principle for problems with delays. Numerical simulations are performed, confirming stability of the disease-free and endemic equilibria and illustrating the effectiveness of the two incorporated treatments via optimal control.
Keywords:
HIV modeling Treatment Intracellular time delay Stability Optimal controlMSC:
34C60 49K15 92D301 Introduction
Human immunodeficiency virus (HIV) is recognized as a viral pathogen causing the well known acquired immunodeficiency syndrome (AIDS), which is considered the end-stage of the infection. After this stage, the immune system fails to play its principal role, which is to protect the whole body against harmful intruders. This failure is due to destruction of the vast majority of CD4+ T cells by the HIV virus, reducing them to an account below cells per 2 ; 1 .
During last decades, many mathematical models have been developed in order to better understand the dynamics of the HIV disease 5a ; 3 ; 4 ; 5b . Mathematical models of HIV and tuberculosis coinfection have been investigated in MyID:300 ; MyID:318 . An interesting case study, with real data from Cape Verde islands, has been carried out in MyID:359 , showing that the goal of the United Nations to end the AIDS epidemic by 2030 is a nontrivial task. For the importance of optimization techniques and optimal control in the study of HIV, we refer the reader to MyID:366 ; MyID:367 and references therein. Here we observe that, often, models introduce the effect of cellular immune response, also called the cytotoxic T-lymphocyte (CTL) response, which attacks and kills the infected cells rst . It has been shown that this cellular immune response can control the load of HIV viruses perel2 ; perel1 . In crs , it is assumed that CTL proliferation depends, besides infected cells, as usual, also on healthy cells. Moreover, an optimal control problem associated with the suggested model is studied crs . Recently, the same problem was tackled by introducing time delays rst . Here, we continue the investigation of such kind of problems by introducing the HIV virus dynamics to the system of equations. This is important because uninfected cells must be in contact with the HIV virus before they become infected. The proposed basic model, illustrating this type of scenario, is as follows:
(1) |
subject to given initial conditions , , , and . In this model, , , and denote, respectively, the concentrations at time of uninfected cells, infected cells, HIV virus, and CTL cells. The healthy CD cells grow at a rate , decay at a rate and become infected by the virus at a rate . Infected cells die at a rate and are killed by the CTL response at a rate . Free virus is produced by the infected cells at a rate and decay at a rate , where is the number of free virus produced by each actively infected cell during its life time. Finally, CTLs expand in response to viral antigen derived from infected cells at a rate and decay in the absence of antigenic stimulation at a rate .
The paper is organized as follows. Section 2 is devoted to the proof of existence, positivity and boundedness of solutions. Then, in Section 3, we do an optimization analysis of the viral infection model. In Section 4, we construct an appropriate numerical algorithm and give some simulations. Finally, conclusions are given in Section 5.
2 Analysis of the model with delay
In order to be realistic, let us introduce an intracellular time delay to the system of equations (1). Then, the model takes the following form:
(2) |
Here, the delay represents the time needed for infected cells to produce virions after viral entry. Model (2) is a system of delayed ordinary differential equations. For such kind of problems, initial functions need to be addressed and an appropriate functional framework needs to be specified. Let us first consider to be the Banach space of continuous mappings from to equipped with the sup-norm . We assume that the initial functions verify
(3) |
Also, from biological reasons, these initial functions , , and have to be nonnegative:
(4) |
2.1 Positivity and boundedness of solutions
For the solutions of (2) with initial functions satisfying conditions (3) and (4), the following theorem holds.
Theorem 2.1
Proof
By the standard functional framework of ordinary differential equations (see, for instance, hal and references therein), we know that there is a unique local solution to system (2) in . From system (2), we have the following:
and
This shows the positivity of solutions in . Next, for the boundedness of the solutions, we consider the following function:
This leads to
from which we have
If we set , then we have
This proves, via Gronwall’s lemma, that is bounded, and so are the functions , and . Now, we prove the boundedness of . From the last equation of (2), we have
Moreover, from the second equation of (2), it follows that
Thus, by integrating over time, we have
From the boundedness of , and , and by using integration by parts, it follows the boundedness of . Therefore, every local solution can be prolonged up to any time , which means that the solution exists globally.
2.2 The linearized problem around the steady-state solution
It is straightforward to establish that model (2) has one disease-free equilibrium given by
and two endemic equilibrium points given as follows:
and
Consider now the following transformation:
where denotes any equilibrium point , or . The linearized system of the previous model (2) is of form
(5) |
System (5) can be written in matrix form as follows:
where and are the two matrices given by
and
2.3 Stability of the disease-free equilibrium
We begin by studying the stability of the disease-free equilibrium . The following result holds.
Theorem 2.2
The local stability of the disease-free equilibrium depends on the value of . Precisely, we have:
-
1.
if , then the disease-free equilibrium is locally asymptotically stable for any time delay ;
-
2.
if , then the equilibrium is unstable for any time delay .
Proof
The characteristic equation of system (2) is given by
(6) |
Thus, at the disease-free equilibrium, the characteristic equation takes the form
(7) |
If we assume , then equation (7) becomes
(8) |
The four roots of (8) are:
It is clear that , and have negative real parts, while has negative real part if . Suppose that . To prove the stability of , we use Rouché’s theorem. For that, we need to prove that the roots of the characteristic equation (7) cannot have pure imaginary roots, that is, cannot cross the imaginary axis. Suppose the contrary. Let with a purely imaginary root of (7). Then, , that is, . By using Euler’s formula and by separating the real imaginary parts, we have
Adding the squares in the two equations, one obtains
Let . We have
which has no positive solution when . Therefore, there is no root with for (7), implying that the root of (7) cannot intersect the pure imaginary axis. Therefore, all roots of (7) have negative real parts and the disease-free equilibrium, , is locally asymptotically stable if . In addition, it is easy to show that (7) has a real positive root when . Indeed, let us put
Then, and . Consequently, has a positive real root and the disease-free equilibrium is unstable.
2.4 Stability of the endemic equilibria
We start by studying the local stability of the infected-equilibrium for any time delay .
Theorem 2.3
The local stability of the disease-free equilibrium depends on the value of
Precisely, we have:
-
1.
if , then is locally asymptotically stable for any positive time delay ;
-
2.
if , then is unstable for any positive time delay .
Proof
Let and . The characteristic equation (6) at is given by
(9) |
where
Note that
(10) |
is a solution of (9). If , then (10) is a real negative root of the characteristic equation (9), and we just need to analyze equation
(11) |
Consider now . From equation (11), we have
(12) |
where
Because , from the Routh–Hurwitz stability criterion, it follows that all roots of (12) have negative real part. Thus, is locally asymptotically stable for . Let . Suppose that (9) has pure imaginary roots with . If we replace in (11) by , and separate the real and imaginary parts, then we obtain
By adding up the squares of the two equations, and by using the fundamental trigonometric formula, we obtain that
Letting , yields
We have and . Hence, (11) has no positive solution because . Therefore, there is no root with for (11), implying that the root of (11) cannot cross the purely imaginary axis. Thus, all roots of (9) have negative real parts. Then, is locally asymptotically stable when .
For the second endemic equilibrium point , the following result holds.
Theorem 2.4
Assume that . If , then the infected equilibrium is locally asymptotically stable for .
Proof
Let . Suppose that (13) has pure imaginary roots . Replacing in (13) by , and separating the real and imaginary parts, we obtain that
with
By adding up the squares of both equations, and using the fundamental trigonometric formula, we obtain that
(14) |
where
Equation (14) admits at least two pure imaginary roots. Indeed, let , , , , , , , , . Then, equation (14) is given by
This equation admits four pure imaginary roots; due to length of their writing space, we give here their approximated values:
Therefore, from Rouché’s theorem, we cannot conclude anything about the stability of . Numerically, however, we can show that the endemic equilibrium is locally asymptotically stable for certain values of . For example, let , , , , , , , , and . In this case, it is easy to show analytically that the characteristic equation (13) is given by with
Thus, and the derivative is always positive for . Therefore, does not have nonnegative real roots. Analogously, we can show numerically that is locally asymptotically stable for some other positive values of the time delay . A general result remains, however, an open question.
3 Optimal control
In this section, we study an optimal control problem associated with the delayed HIV model with CTL immune response (2).
3.1 The optimization problem
We suggest the following delayed control system with two control variables and :
(15) |
where the controls belong to the control set defined by
Here, represents the efficiency of drug therapy in blocking new infections, so that the infection rate in presence of drug is ; while stands for the efficiency of drug therapy in inhibiting viral production, such that the virion production rate under therapy is . The optimization problem under consideration is to maximize the objective functional
(16) |
where is the time period of treatment and the positive constants and stand for the benefits and costs of the introduced treatment, subject to the control system (15). The two control functions, and , are assumed to be bounded and Lebesgue integrable. Summarizing, the optimal control problem under study consists to find and such that
(17) | ||||
Pontryagin’s minimum principle Gollmann provides necessary optimality conditions for such optimal control problem with delays. Roughly speaking, this principle reduces (17) to a problem of maximizing an Hamiltonian pointwisely with respect to and . In our case the Hamiltonian is given by
with
By applying Pontryagin’s minimum principle Gollmann , we obtain the following result.
Theorem 3.1
For any initial conditions (3)–(4), the system (15) has a unique solution. This solution is nonnegative and bounded for all . In addition, if and are optimal controls and , , and corresponding solutions of the state system (15), then there exists adjoint variables , , and satisfying the adjoint equations
with transversality conditions
Moreover, the optimal controls satisfy
(18) | ||||
Proof
The proof of positivity and boundedness of solutions is similar to the one of Theorem 2.1. It is enough to use the fact that , , which means that . For the rest of the proof, we remark that the adjoint equations and transversality conditions are obtained by using the Pontryagin minimum principle with delays of Gollmann , from which
From the optimality conditions,
that is,
Taking into account the bounds in for the two controls, one obtains and in form (18).
3.2 Existence of an optimal control pair
The existence of the optimal control pair can be directly obtained using the results in Fleming ; Lukes . More precisely, we have the following theorem.
Theorem 3.2
There exists an optimal control pair solution of (17).
Proof
To use the existence result in Fleming , we first need to check the following properties:
-
the set of controls and corresponding state variables is nonempty;
-
the control set is convex and closed;
-
the right-hand side of the state system is bounded by a linear function in the state and control variables;
-
the integrand of the objective functional is concave on ;
Using the result in Lukes , we obtain existence of solutions of system (15), which gives condition . The control set is convex and closed by definition, which gives condition . Since our state system is bilinear in and , the right-hand side of system (15) satisfies condition , using the boundedness of solutions. Note that the integrand of our objective functional is concave. Also, we have the last needed condition:
where depends on the upper bound on and , and since and . We conclude that there exists an optimal control pair such that
3.3 The optimality system
4 Numerical simulations
In order to solve the optimality system given in Section 3.3, we use a numerical scheme based on forward and backward finite difference approximations. Precisely, we implemented Algorithm 1.
Remark 1
Step 1:
for do:
end for;
for , do:
end for;
Step 2:
for , …, , do:
end for;
Step 3:
for , write:
end for.
In our simulations, the following parameters are used:
(19) |
Such values respect the HIV parameter ranges given in Table 1.
Parameters | Meaning | Value | References |
---|---|---|---|
source rate of CD4+ T cells | – cells days-1 | crs | |
decay rate of healthy cells | – days-1 | crs | |
rate at which CD4+ T cells become infected | – virion-1 days-1 | crs | |
death rate of infected CD4+ T cells, not by CTL | – days-1 | crs | |
clearance rate of virus | – days-1 | per | |
number of virions produced by infected CD4+ T-cells | – virion-1 | 5a ; 32 | |
clearance rate of infection | – ml virion days-1 | 5a ; 22 | |
activation rate of CTL cells | – days-1 | 5a | |
death rate of CTL cells | – days-1 | 5a | |
time delay | – days | 14 ; 17 |
In Figure 1, we use the two following initial conditions:
(20) |
and
(21) |
Moreover, besides parameters (19), we have chosen , which means that . According to Theorem 2.2, the disease-free equilibrium is locally asymptotically stable. The plots of Figure 1 confirm this result of local stability for both initial conditions (20) and (21).




In Figure 2, we have chosen , which means that and . According to Theorem 2.4, the endemic equilibrium is locally stable. Figure 2 confirms this result numerically: we clearly see the convergence to the equilibrium point . However, it is interesting to point out that, with control, a significant decrease of the infected cells, free viruses, and CTL cells, is observed (see Figure 2). The uninfected cells get maximized. It is worth to mention that with control treatment the infection dies very fast and the dynamics goes toward the disease-free equilibrium.






The behavior of the two treatments during time is given in Figure 3. We can see that the first control makes several switchings from zero to one and vice versa. We can understand from this that one can manage the first treatment to the patient periodically in full manner. In this figure, we can also see that the second control is almost equal to one but with sudden decreases, for some short periods of time, without vanishing.
5 Conclusion
In this work we have studied a delayed HIV viral infection model with CTL immune response. The considered model includes four differential equations describing the interaction between the uninfected cells, infected cells, HIV free viruses and CTL immune response. An intracellular time delay and two treatments are incorporated to the suggested model. First, existence, positivity and boundedness of solutions are established. Next, an optimization problem is formulated in order to search the better optimal control pair to maximize the number of uninfected cells, reduce the infected cells and minimize the viral load. Two control functions are incorporated in the model, which represent the efficiency of drug treatment in inhibiting viral production and preventing new infections. The existence of such optimal control pair is established and the optimality system is given and solved numerically, using a forward and backward difference approximation scheme. It was shown that the obtained optimal control pair increases considerably the number of CD4+ cells while reducing the number of infected. Moreover, it was also observed that, under optimal control, the viral load decreases significantly compared with the model without control, which will improve the life quality of the patient. It remains an open question how to prove stability of the endemic equilibrium of model (2) for an arbitrary intracellular time delay .
Acknowledgements.
This research is part of second author’s Ph.D., which is carried out at University of Hassan II Casablanca, Morocco. Torres was partially supported by project TOCCATA, reference PTDC/EEI-AUT/2933/2014, funded by Project 3599 – Promover a Produção Científica e Desenvolvimento Tecnológico e a Constituição de Redes Temáticas (3599-PPCDT) and FEDER funds through COMPETE 2020, Programa Operacional Competitividade e Internacionalização (POCI), and by Portuguese funds through Fundação para a Ciência e a Tecnologia (FCT) and CIDMA, within project UID/MAT/04106/2013. The authors are grateful to the referees for their valuable comments and helpful suggestions.References
- (1) Blattner, W., Gallo, R. C., Temin, H. M.: HIV causes AIDS, Science 241(4865), 515–516 (1988)
- (2) Busch, M. P., Satten, G. A.: Time course of viremia and antibody seroconversion following human immunodeficiency virus exposure, Amer. J. Med. 102(5B), 117–126 (1997)
- (3) Ciupe, M. S., Bivort, B. L., Bortz, D. M., Nelson, P. W.: Estimating kinetic parameters from HIV primary infection data through the eyes of three different mathematical models, Math. Biosci. 200(1), 1–27 (2006)
- (4) Culshaw, R., Ruan, S., Spiteri, R. J.: Optimal HIV treatment by maximising immune response, J. Math. Biol. 48(5), 545–562 (2004)
- (5) De Boer, R. J., Perelson, A. S.: Target cell limited and immune control models of HIV infection: a comparison, J. Theor. Biol. 190(3), 201–214 (1998)
- (6) Denysiuk, R., Silva, C. J., Torres, D. F. M.: Multiobjective optimization to a TB-HIV/AIDS coinfection optimal control problem, Computational and Applied Mathematics, in press. DOI: 10.1007/s40314-017-0438-9 arXiv:1703.05458
- (7) Fleming, W. H., Rishel, R. W.: Deterministic and stochastic optimal control, Springer, Berlin (1975)
- (8) Göllmann, L., Kern, D., Maurer, H.: Optimal control problems with delays in state and control variables subject to mixed control-state constraints, Optimal Control Appl. Methods 30(4), 341–365 (2009)
- (9) Hale, J. K., Verduyn Lunel, S. M.: Introduction to functional-differential equations, Applied Mathematical Sciences, 99, Springer, New York (1993)
- (10) Kahn, J. O., Walker, B. D.: Acute human immunodeficiency virus type 1 infection, New Engl. J. Med. 339(1), 33–39 (1998)
- (11) Kirschner, D.: Using mathematics to understand HIV immune dynamics, Notices Amer. Math. Soc. 43(2), 191–202 (1996)
- (12) Lukes, D. L.: Differential equations, Mathematics in Science and Engineering, 162, Academic Press, London (1982)
- (13) Nowak, M., May, R.: Mathematical biology of HIV infection: antigenic variation and diversity threshold, Math. Biosci. 106(1), 1–21 (1991)
- (14) Pawelek, K. A., Liu, S., Pahlevani, F., Rong, L.: A model of HIV-1 infection with two time delays: mathematical analysis and comparison with patient data, Math. Biosci. 235(1), 98–109 (2012)
- (15) Perelson, A. S., Nelson, P. W.: Mathematical analysis of HIV-1 dynamics in vivo, SIAM Rev. 41(1), 3–44 (1999)
- (16) Perelson, A. S., Neumann, A. U., Markowitz, M., Leonard, J. M., Ho, D. D.: HIV-1 dynamics in vivo: virion clearance rate, infected cell life-span, and viral generation time, Science 271(5255), 1582–1586 (1996)
- (17) Rocha, D., Silva, C. J., Torres, D. F. M.: Stability and optimal control of a delayed HIV model, Math. Methods Appl. Sci., in press. DOI: 10.1002/mma.4207 arXiv:1609.07654
- (18) Silva, C. J., Torres, D. F. M.: Modeling TB-HIV syndemic and treatment, J. Appl. Math. 2014, Art. ID 248407, 14 pp (2014) arXiv:1406.0877
- (19) Silva, C. J., Torres, D. F. M.: A TB-HIV/AIDS coinfection model and optimal control treatment, Discrete Contin. Dyn. Syst. 35(9), 4639–4663 (2015) arXiv:1501.03322
- (20) Silva, C. J., Torres, D. F. M.: A SICA compartmental model in epidemiology with application to HIV/AIDS in Cape Verde, Ecological Complexity 30, 70–75 (2017) arXiv:1612.00732
- (21) Silva, C. J., Torres, D. F. M.: Modeling and optimal control of HIV/AIDS prevention through PrEP, Discrete Contin. Dyn. Syst. Ser. S 11(1), 119–141 (2018) arXiv:1703.06446
- (22) Stafford, M. A., Corey, L., Cao, Y., Daar, E. S., Ho, D. D., Perelson, A. S.: Modeling plasma virus concentration during primary HIV infection, J. Theor. Biol. 203(3), 285–301 (2000)
- (23) Wang, Y., Zhou, Y., Brauer, F., Heffernan, J. M.: Viral dynamics model with CTL immune response incorporating antiretroviral therapy, J. Math. Biol. 67(4), 901–934 (2013)
- (24) Weiss, R.: How does HIV cause AIDS?, Science 260(5112), 1273–1279 (1993)