This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

11institutetext: K. Allali 22institutetext: S. Harroudi 33institutetext: Laboratory of Mathematics and Applications, Faculty of Sciences and Technologies,
University Hassan II of Casablanca, P.O. Box 146, Mohammedia, Morocco
33email: allali@hotmail.com
44institutetext: S. Harroudi55institutetext: 55email: sanaa.harroudi@gmail.com 66institutetext: D. F. M. Torres (✉) 77institutetext: Center for Research and Development in Mathematics and Applications (CIDMA),
Department of Mathematics, University of Aveiro, 3810-193 Aveiro, Portugal
77email: delfim@ua.pt

Analysis and optimal control of an intracellular delayed HIV model
with CTL immune response

Karam Allali    Sanaa Harroudi    Delfim F. M. Torres
(Received: 30 May 2017 / Revised: 22 January 2018 / Accepted: 30 January 2018)
Abstract

A delayed model describing the dynamics of HIV (Human Immunodeficiency Virus) with CTL (Cytotoxic T Lymphocytes) immune response is investigated. The model includes four nonlinear differential equations describing the evolution of uninfected, infected, free HIV viruses, and CTL immune response cells. It includes also intracellular delay and two treatments (two controls). While the aim of first treatment consists to block the viral proliferation, the role of the second is to prevent new infections. Firstly, we prove the well-posedness of the problem by establishing some positivity and boundedness results. Next, we give some conditions that insure the local asymptotic stability of the endemic and disease-free equilibria. Finally, an optimal control problem, associated with the intracellular delayed HIV model with CTL immune response, is posed and investigated. The problem is shown to have an unique solution, which is characterized via Pontryagin’s minimum principle for problems with delays. Numerical simulations are performed, confirming stability of the disease-free and endemic equilibria and illustrating the effectiveness of the two incorporated treatments via optimal control.

Keywords:
HIV modeling Treatment Intracellular time delay Stability Optimal control
MSC:
34C60 49K15 92D30

1 Introduction

Human immunodeficiency virus (HIV) is recognized as a viral pathogen causing the well known acquired immunodeficiency syndrome (AIDS), which is considered the end-stage of the infection. After this stage, the immune system fails to play its principal role, which is to protect the whole body against harmful intruders. This failure is due to destruction of the vast majority of CD4+ T cells by the HIV virus, reducing them to an account below 200200 cells per μl\mu l 2 ; 1 .

During last decades, many mathematical models have been developed in order to better understand the dynamics of the HIV disease 5a ; 3 ; 4 ; 5b . Mathematical models of HIV and tuberculosis coinfection have been investigated in MyID:300 ; MyID:318 . An interesting case study, with real data from Cape Verde islands, has been carried out in MyID:359 , showing that the goal of the United Nations to end the AIDS epidemic by 2030 is a nontrivial task. For the importance of optimization techniques and optimal control in the study of HIV, we refer the reader to MyID:366 ; MyID:367 and references therein. Here we observe that, often, models introduce the effect of cellular immune response, also called the cytotoxic T-lymphocyte (CTL) response, which attacks and kills the infected cells rst . It has been shown that this cellular immune response can control the load of HIV viruses perel2 ; perel1 . In crs , it is assumed that CTL proliferation depends, besides infected cells, as usual, also on healthy cells. Moreover, an optimal control problem associated with the suggested model is studied crs . Recently, the same problem was tackled by introducing time delays rst . Here, we continue the investigation of such kind of problems by introducing the HIV virus dynamics to the system of equations. This is important because uninfected cells must be in contact with the HIV virus before they become infected. The proposed basic model, illustrating this type of scenario, is as follows:

{dx(t)dt=λdx(t)βx(t)v(t),dy(t)dt=βx(t)v(t)ay(t)py(t)z(t),dv(t)dt=aNy(t)μv(t),dz(t)dt=cx(t)y(t)z(t)hz(t),\begin{cases}\displaystyle\frac{dx(t)}{dt}=\lambda-dx(t)-\beta x(t)v(t),\\[8.5359pt] \displaystyle\frac{dy(t)}{dt}=\beta x(t)v(t)-ay(t)-py(t)z(t),\\[8.5359pt] \displaystyle\frac{dv(t)}{dt}=aNy(t)-\mu v(t),\\[8.5359pt] \displaystyle\frac{dz(t)}{dt}=cx(t)y(t)z(t)-hz(t),\end{cases} (1)

subject to given initial conditions x(0)=x0x(0)=x_{0}, y(0)=y0y(0)=y_{0}, v(0)=v0v(0)=v_{0}, and z(0)=z0z(0)=z_{0}. In this model, x(t)x(t), y(t)y(t), v(t)v(t) and z(t)z(t) denote, respectively, the concentrations at time tt of uninfected cells, infected cells, HIV virus, and CTL cells. The healthy CD4+4^{+} cells grow at a rate λ\lambda, decay at a rate dx(t)dx(t) and become infected by the virus at a rate βx(t)v(t)\beta x(t)v(t). Infected cells (y)(y) die at a rate aa and are killed by the CTL response at a rate pp. Free virus (v)(v) is produced by the infected cells at a rate aNaN and decay at a rate μ\mu, where NN is the number of free virus produced by each actively infected cell during its life time. Finally, CTLs (z)(z) expand in response to viral antigen derived from infected cells at a rate cc and decay in the absence of antigenic stimulation at a rate hh.

The paper is organized as follows. Section 2 is devoted to the proof of existence, positivity and boundedness of solutions. Then, in Section 3, we do an optimization analysis of the viral infection model. In Section 4, we construct an appropriate numerical algorithm and give some simulations. Finally, conclusions are given in Section 5.

2 Analysis of the model with delay

In order to be realistic, let us introduce an intracellular time delay to the system of equations (1). Then, the model takes the following form:

{x˙(t)=λdx(t)βx(t)v(t),y˙(t)=βx(tτ)v(tτ)ay(t)py(t)z(t),v˙(t)=aNy(t)μv(t),z˙(t)=cx(t)y(t)z(t)hz(t).\begin{cases}\displaystyle\dot{x}(t)=\lambda-dx(t)-\beta x(t)v(t),\\ \displaystyle\dot{y}(t)=\beta x(t-\tau)v(t-\tau)-ay(t)-py(t)z(t),\\ \displaystyle\dot{v}(t)=aNy(t)-\mu v(t),\\ \displaystyle\dot{z}(t)=cx(t)y(t)z(t)-hz(t).\end{cases} (2)

Here, the delay τ\tau represents the time needed for infected cells to produce virions after viral entry. Model (2) is a system of delayed ordinary differential equations. For such kind of problems, initial functions need to be addressed and an appropriate functional framework needs to be specified. Let us first consider X=C([τ,0];4)X=C([-\tau,0];\mathbb{R}^{4}) to be the Banach space of continuous mappings from [τ,0][-\tau,0] to 4\mathbb{R}^{4} equipped with the sup-norm φ=supτt0|φ(t)|\displaystyle\|\varphi\|=\sup_{-\tau\leq t\leq 0}|\varphi(t)|. We assume that the initial functions verify

(x(θ),y(θ),v(θ),z(θ))X.\left(x(\theta),y(\theta),v(\theta),z(\theta)\right)\in X. (3)

Also, from biological reasons, these initial functions x(θ)x(\theta), y(θ)y(\theta), v(θ)v(\theta) and z(θ)z(\theta) have to be nonnegative:

x(θ)0,y(θ)0,v(θ)0,z(θ)0, for θ[τ,0].x(\theta)\geq 0,\quad y(\theta)\geq 0,\quad v(\theta)\geq 0,\quad z(\theta)\geq 0,\quad\text{ for }\theta\in[-\tau,0]. (4)

2.1 Positivity and boundedness of solutions

For the solutions of (2) with initial functions satisfying conditions (3) and (4), the following theorem holds.

Theorem 2.1

For any initial conditions (x(t),y(t),v(t),z(t))\left(x(t),y(t),v(t),z(t)\right) satisfying (3) and (4), the system (2) has a unique solution. In addition, the solution is nonnegative and bounded for all t0t\geq 0.

Proof

By the standard functional framework of ordinary differential equations (see, for instance, hal and references therein), we know that there is a unique local solution (x(t),y(t),v(t),z(t))(x(t),y(t),v(t),z(t)) to system (2) in [0,tm)[0,t_{m}). From system (2), we have the following:

x(t)=e0t(d+βv(ξ))𝑑ξ(x(0)+0tλe0η(d+βv(ξ))𝑑ξ𝑑η),\displaystyle x(t)=e^{-\displaystyle\int_{0}^{t}(d+\beta v(\xi))d\xi}\left(x(0)+\int_{0}^{t}\lambda e^{\displaystyle\int_{0}^{\eta}(d+\beta v(\xi))d\xi}d\eta\right),
y(t)=e0t(a+pz(ξ))𝑑ξ(y(0)+0tβv(ητ)x(ητ)e0η(a+pz(ξ))𝑑ξ𝑑η),\displaystyle y(t)=e^{-\displaystyle\int_{0}^{t}(a+pz(\xi))d\xi}\left(y(0)+\int_{0}^{t}\beta v(\eta-\tau)x(\eta-\tau)e^{\displaystyle\int_{0}^{\eta}(a+pz(\xi))d\xi}d\eta\right),
v(t)=eμt(v(0)+0taNy(η)eμη𝑑η),\displaystyle v(t)=e^{-\mu t}\left(v(0)+\int_{0}^{t}aNy(\eta)e^{\mu\eta}d\eta\right),

and

z(t)=z(0)e0t(cy(ξ)h)𝑑ξ.\displaystyle z(t)=z(0)e^{\displaystyle\int_{0}^{t}(cy(\xi)-h)d\xi}.

This shows the positivity of solutions in t[0,tm)t\in[0,t_{m}). Next, for the boundedness of the solutions, we consider the following function:

F(t)=aNx(t)+aNy(t+τ)+a2v(t+τ).F(t)=aNx(t)+aNy(t+\tau)+\frac{a}{2}v(t+\tau).

This leads to

dF(t)dt\displaystyle\frac{dF(t)}{dt} =aN(λdx(t)βv(t)x(t))\displaystyle=aN\left(\lambda-dx(t)-\beta v(t)x(t)\right)
+aN(βv(t)x(t)ay(t+τ)py(t+τ)z(t+τ))\displaystyle\quad+aN\left(\beta v(t)x(t)-ay(t+\tau)-py(t+\tau)z(t+\tau)\right)
+a2(aNy(t+τ)μv(t+τ)),\displaystyle\quad+\frac{a}{2}\left(aNy(t+\tau)-\mu v(t+\tau)\right),

from which we have

dF(t)dtλaNaNdx(t)a2N2y(t+τ)aμ2v(t+τ).\frac{dF(t)}{dt}\leq\lambda aN-aNdx(t)-\frac{a^{2}N}{2}y(t+\tau)-\frac{a\mu}{2}v(t+\tau).

If we set ϱ=min(d,a2,μ)\displaystyle\varrho=\min\left(d,\frac{a}{2},\mu\right), then we have

dF(t)dtλaNϱF(t).\frac{dF(t)}{dt}\leq\lambda aN-\varrho F(t).

This proves, via Gronwall’s lemma, that F(t)F(t) is bounded, and so are the functions x(t)x(t), y(t)y(t) and v(t)v(t). Now, we prove the boundedness of z(t)z(t). From the last equation of (2), we have

z˙(t)+hz(t)=cx(t)y(t)z(t).\dot{z}(t)+hz(t)=cx(t)y(t)z(t).

Moreover, from the second equation of (2), it follows that

z˙(t)+hz(t)=cpx(t)(βx(tτ)v(tτ)ay(t)y˙(t)).\dot{z}(t)+hz(t)=\frac{c}{p}x(t)\left(\beta x(t-\tau)v(t-\tau)-ay(t)-\dot{y}(t)\right).

Thus, by integrating over time, we have

z(t)=z(0)eht+0tcpx(s)(βx(sτ)v(sτ)ay(s)y˙(s))eh(st)𝑑s.z(t)=z(0)e^{-ht}+\int_{0}^{t}\frac{c}{p}x(s)\left(\beta x(s-\tau)v(s-\tau)-ay(s)-\dot{y}(s)\right)e^{h(s-t)}ds.

From the boundedness of xx, yy and vv, and by using integration by parts, it follows the boundedness of z(t)z(t). Therefore, every local solution can be prolonged up to any time tm>0t_{m}>0, which means that the solution exists globally.

2.2 The linearized problem around the steady-state solution

It is straightforward to establish that model (2) has one disease-free equilibrium given by

Ef=(λd,0,0,0)E_{f}=\left(\frac{\lambda}{d},0,0,0\right)

and two endemic equilibrium points given as follows:

E1=(μNβ,λβNdμaNβ,λβNdμμβ,0)E_{1}=\left(\frac{\mu}{N\beta},\frac{\lambda\beta N-d\mu}{aN\beta},\frac{\lambda\beta N-d\mu}{\mu\beta},0\right)

and

E2=(λμcβaNhdμc,dhμλμcβaNh,dhaNλμcβaNh,βaNμp(λμcβaNhdμc)ap).E_{2}=\left(\frac{\lambda\mu c-\beta aNh}{d\mu c},\frac{dh\mu}{\lambda\mu c-\beta aNh},\frac{dhaN}{\lambda\mu c-\beta aNh},\frac{\beta aN}{\mu p}\left(\frac{\lambda\mu c-\beta aNh}{d\mu c}\right)-\frac{a}{p}\right).

Consider now the following transformation:

X(t)=x(t)x¯,Y(t)=y(t)y¯,V(t)=v(t)v¯,Z(t)=z(t)z¯,X(t)=x(t)-\bar{x},\quad Y(t)=y(t)-\bar{y},\quad V(t)=v(t)-\bar{v},\quad Z(t)=z(t)-\bar{z},

where (x¯,y¯,v¯,z¯)\left(\bar{x},\bar{y},\bar{v},\bar{z}\right) denotes any equilibrium point EfE_{f}, E1E_{1} or E2E_{2}. The linearized system of the previous model (2) is of form

{X˙(t)=(dβv¯)X(t)βx¯V(t),Y˙(t)=(apz¯)Y(t)+βv¯X(tτ)+βx¯V(tτ)py¯Z(t),V˙(t)=aNY(t)μV(t),Z˙(t)=cy¯z¯X(t)+cx¯z¯Y(t)+(cx¯y¯h)Z(t).\begin{cases}\displaystyle\dot{X}(t)=\left(-d-\beta\bar{v}\right)X(t)-\beta\bar{x}V(t),\\ \displaystyle\dot{Y}(t)=\left(-a-p\bar{z}\right)Y(t)+\beta\bar{v}X(t-\tau)+\beta\bar{x}V(t-\tau)-p\bar{y}Z(t),\\ \displaystyle\dot{V}(t)=aNY(t)-\mu V(t),\\ \displaystyle\dot{Z}(t)=c\bar{y}\bar{z}X(t)+c\bar{x}\bar{z}Y(t)+(c\bar{x}\bar{y}-h)Z(t).\end{cases} (5)

System (5) can be written in matrix form as follows:

ddt(X(t)Y(t)V(t)Z(t))=A1(X(t)Y(t)V(t)Z(t))+A2(X(tτ)Y(tτ)V(tτ)Z(tτ)),\frac{d}{dt}\left(\begin{array}[]{c}X(t)\\ Y(t)\\ V(t)\\ Z(t)\end{array}\right)=A_{1}\left(\begin{array}[]{c}X(t)\\ Y(t)\\ V(t)\\ Z(t)\end{array}\right)+A_{2}\left(\begin{array}[]{c}X(t-\tau)\\ Y(t-\tau)\\ V(t-\tau)\\ Z(t-\tau)\end{array}\right),

where A1A_{1} and A2A_{2} are the two matrices given by

A1=(dβv¯0βx¯00apz¯0py¯0aNμ0cy¯z¯cx¯z¯0cx¯y¯h)A_{1}=\left(\begin{array}[]{cccc}-d-\beta\bar{v}&0&-\beta\bar{x}&0\\ 0&-a-p\bar{z}&0&-p\bar{y}\\ 0&aN&-\mu&0\\ c\bar{y}\bar{z}&c\bar{x}\bar{z}&0&c\bar{x}\bar{y}-h\\ \end{array}\right)

and

A2=(0000βv¯0βx¯000000000).A_{2}=\left(\begin{array}[]{cccc}0&0&0&0\\ \beta\bar{v}&0&\beta\bar{x}&0\\ 0&0&0&0\\ 0&0&0&0\\ \end{array}\right).

2.3 Stability of the disease-free equilibrium

We begin by studying the stability of the disease-free equilibrium EfE_{f}. The following result holds.

Theorem 2.2

The local stability of the disease-free equilibrium EfE_{f} depends on the value of NβλdμN\beta\lambda-d\mu. Precisely, we have:

  1. 1.

    if Nβλdμ<0N\beta\lambda-d\mu<0, then the disease-free equilibrium EfE_{f} is locally asymptotically stable for any time delay τ0\tau\geq 0;

  2. 2.

    if Nβλdμ>0N\beta\lambda-d\mu>0, then the equilibrium EfE_{f} is unstable for any time delay τ0\tau\geq 0.

Proof

The characteristic equation of system (2) is given by

Δ(ζ)=det(ζIdA1eζτA2)=0.\Delta(\zeta)=\det(\zeta Id-A_{1}-e^{-\zeta\tau}A_{2})=0. (6)

Thus, at the disease-free equilibrium, the characteristic equation takes the form

(ζ+d)(ζ+h)[ζ2+(μ+a)ζ+aμ(1Nβλdμeζτ)]=0.(\zeta+d)(\zeta+h)\left[\zeta^{2}+(\mu+a)\zeta+a\mu\left(1-\frac{N\beta\lambda}{d\mu}e^{-\zeta\tau}\right)\right]=0. (7)

If we assume τ=0\tau=0, then equation (7) becomes

(ζ+d)(ζ+h)[ζ2+(μ+a)ζ+aμ(1Nβλdμ)]=0.(\zeta+d)(\zeta+h)\left[\zeta^{2}+(\mu+a)\zeta+a\mu\left(1-\frac{N\beta\lambda}{d\mu}\right)\right]=0. (8)

The four roots of (8) are:

ζ1=d,ζ2=h,ζ3=(μ+a)(μ+a)24aμ(1Nβλdμ)2,ζ4=(μ+a)+(μ+a)24aμ(1Nβλdμ)2.\begin{split}\zeta_{1}&=-d,\\ \zeta_{2}&=-h,\\ \zeta_{3}&=\frac{-(\mu+a)-\sqrt{(\mu+a)^{2}-4a\mu\left(1-\frac{N\beta\lambda}{d\mu}\right)}}{2},\\ \zeta_{4}&=\frac{-(\mu+a)+\sqrt{(\mu+a)^{2}-4a\mu(1-\frac{N\beta\lambda}{d\mu})}}{2}.\end{split}

It is clear that ζ1\zeta_{1}, ζ2\zeta_{2} and ζ3\zeta_{3} have negative real parts, while ζ4\zeta_{4} has negative real part if Nβλdμ<0N\beta\lambda-d\mu<0. Suppose that τ>0\tau>0. To prove the stability of EfE_{f}, we use Rouché’s theorem. For that, we need to prove that the roots of the characteristic equation (7) cannot have pure imaginary roots, that is, cannot cross the imaginary axis. Suppose the contrary. Let ζ=ωi\zeta=\omega i with ω>0\omega>0 a purely imaginary root of (7). Then, (ωi)2+(μ+a)(ωi)+aμ(1Nβλdμeiωτ)=0(\omega i)^{2}+(\mu+a)(\omega i)+a\mu\left(1-\frac{N\beta\lambda}{d\mu}e^{-i\omega\tau}\right)=0, that is, ω2+(μ+a)ωi+aμ(1Nβλdμeiωτ)=0-\omega^{2}+(\mu+a)\omega i+a\mu\left(1-\frac{N\beta\lambda}{d\mu}e^{-i\omega\tau}\right)=0. By using Euler’s formula eiωτ=cos(ωτ)isin(ωτ)e^{-i\omega\tau}=\cos(\omega\tau)-i\sin(\omega\tau) and by separating the real imaginary parts, we have

{ω2+aμ=aNβλdcos(ωτ)(a+μ)ω=aNβλdsin(ωτ).\begin{cases}\displaystyle-\omega^{2}+a\mu=\frac{aN\beta\lambda}{d}\cos(\omega\tau)\\[8.5359pt] \displaystyle(a+\mu)\omega=-\frac{aN\beta\lambda}{d}\sin(\omega\tau).\end{cases}

Adding the squares in the two equations, one obtains

ω4+(a2+μ2)ω2+a2μ2(1(Nβλdμ)2)=0.\omega^{4}+\left(a^{2}+\mu^{2}\right)\omega^{2}+a^{2}\mu^{2}\left(1-\left(\frac{N\beta\lambda}{d\mu}\right)^{2}\right)=0.

Let X=ω2X=\omega^{2}. We have

X2+(a2+μ2)X+a2μ2(1(Nβλdμ)2)=0,X^{2}+\left(a^{2}+\mu^{2}\right)X+a^{2}\mu^{2}\left(1-\left(\frac{N\beta\lambda}{d\mu}\right)^{2}\right)=0,

which has no positive solution when Nβλdμ<0N\beta\lambda-d\mu<0. Therefore, there is no root ζ=iω\zeta=i\omega with ω0\omega\geq 0 for (7), implying that the root of (7) cannot intersect the pure imaginary axis. Therefore, all roots of (7) have negative real parts Nβλdμ<0N\beta\lambda-d\mu<0 and the disease-free equilibrium, EfE_{f}, is locally asymptotically stable if Nβλdμ<0N\beta\lambda-d\mu<0. In addition, it is easy to show that (7) has a real positive root when Nβλdμ>0N\beta\lambda-d\mu>0. Indeed, let us put

f(ζ)=ζ2+(μ+a)ζ+aμ(1Nβλdμeζτ).f(\zeta)=\zeta^{2}+\left(\mu+a\right)\zeta+a\mu\left(1-\frac{N\beta\lambda}{d\mu}e^{-\zeta\tau}\right).

Then, f(0)=aμ(1Nβλdμ)>0f(0)=a\mu\left(1-\frac{N\beta\lambda}{d\mu}\right)>0 and limζ+f(ζ)=+\lim_{\zeta\rightarrow+\infty}f(\zeta)=+\infty. Consequently, ff has a positive real root and the disease-free equilibrium is unstable.

2.4 Stability of the endemic equilibria

We start by studying the local stability of the infected-equilibrium E1E_{1} for any time delay τ\tau.

Theorem 2.3

The local stability of the disease-free equilibrium E1E_{1} depends on the value of

βN(μcλβhaN)μ2cd.\beta N(\mu c\lambda-\beta haN)-\mu^{2}cd.

Precisely, we have:

  1. 1.

    if βN(μcλβhaN)μ2cd<0\beta N(\mu c\lambda-\beta haN)-\mu^{2}cd<0, then E1E_{1} is locally asymptotically stable for any positive time delay τ\tau;

  2. 2.

    if βN(μcλβhaN)μ2cd>0\beta N(\mu c\lambda-\beta haN)-\mu^{2}cd>0, then E1E_{1} is unstable for any positive time delay τ\tau.

Proof

Let λβNdμ>0\lambda\beta N-d\mu>0 and μcλβhaN>0\mu c\lambda-\beta haN>0. The characteristic equation (6) at E1E_{1} is given by

(ζcx¯y¯+h)(ζ3+Aζ2+Bζ+Ceζτ(g1ζ+g2))=0,\left(\zeta-c\bar{x}\bar{y}+h\right)\left(\zeta^{3}+A\zeta^{2}+B\zeta+C-e^{-\zeta\tau}\left(g_{1}\zeta+g_{2}\right)\right)=0, (9)

where

A=d+μ+a+βv¯,B=μd+ad+aμ+μβv¯,C=aμ(d+βv¯)βaNdx¯,g1=βaNx¯,g2=βaNdx¯.\begin{split}A&=d+\mu+a+\beta\bar{v},\\ B&=\mu d+ad+a\mu+\mu\beta\bar{v},\\ C&=a\mu(d+\beta\bar{v})-\beta aNd\bar{x},\\ g_{1}&=\beta aN\bar{x},\\ g_{2}&=\beta aNd\bar{x}.\end{split}

Note that

ζ=βN(μcλβhaN)μ2cdaN2β2\zeta=\frac{\beta N\left(\mu c\lambda-\beta haN\right)-\mu^{2}cd}{aN^{2}\beta^{2}} (10)

is a solution of (9). If βN(μcλβhaN)μ2cd<0\beta N(\mu c\lambda-\beta haN)-\mu^{2}cd<0, then (10) is a real negative root of the characteristic equation (9), and we just need to analyze equation

ζ3+Aζ2+Bζ+Ceζτ(g1ζ+g2)=0.\zeta^{3}+A\zeta^{2}+B\zeta+C-e^{-\zeta\tau}(g_{1}\zeta+g_{2})=0. (11)

Consider now τ=0\tau=0. From equation (11), we have

ζ3+Pζ2+Qζ+R=0,\zeta^{3}+P\zeta^{2}+Q\zeta+R=0, (12)

where

P=d+μ+a+βv¯,Q=μd+ad+aμ+μβv¯aNβx¯,R=aμ(d+βv¯)2βaNdx¯.\begin{split}P&=d+\mu+a+\beta\bar{v},\\ Q&=\mu d+ad+a\mu+\mu\beta\bar{v}-aN\beta\bar{x},\\ R&=a\mu(d+\beta\bar{v})-2\beta aNd\bar{x}.\end{split}

Because βNλdμ>0\beta N\lambda-d\mu>0, from the Routh–Hurwitz stability criterion, it follows that all roots of (12) have negative real part. Thus, E1E_{1} is locally asymptotically stable for τ=0\tau=0. Let τ>0\tau>0. Suppose that (9) has pure imaginary roots ζ=ωi\zeta=\omega i with ω>0\omega>0. If we replace ζ\zeta in (11) by ζ=ωi\zeta=\omega i, and separate the real and imaginary parts, then we obtain

{Aω2+C=g2cos(ωτ)+g1ωsin(ωτ),ω3+Bω=g1ωcos(ωτ)g2sin(ωτ).\begin{cases}\displaystyle-A\omega^{2}+C=g_{2}\cos(\omega\tau)+g_{1}\omega\sin(\omega\tau),\\ -\omega^{3}+B\omega=g_{1}\omega\cos(\omega\tau)-g_{2}\sin(\omega\tau).\end{cases}

By adding up the squares of the two equations, and by using the fundamental trigonometric formula, we obtain that

ω6+(A22B)ω4+(B22ACg12)ω2+C2g22=0.\omega^{6}+(A^{2}-2B)\omega^{4}+(B^{2}-2AC-g_{1}^{2})\omega^{2}+C^{2}-g_{2}^{2}=0.

Letting X=ω2X=\omega^{2}, yields

F(X)=X3+(A22B)X2+(B22ACg12)X+C2g22=0.F(X)=X^{3}+(A^{2}-2B)X^{2}+(B^{2}-2AC-g_{1}^{2})X+C^{2}-g_{2}^{2}=0.

We have F(0)=λ2β2a2N2a2μ2d2>0F(0)=\lambda^{2}\beta^{2}a^{2}N^{2}-a^{2}\mu^{2}d^{2}>0 and limζ+f(ζ)=+\lim_{\zeta\rightarrow+\infty}f(\zeta)=+\infty. Hence, (11) has no positive solution because λβNdμ>0\lambda\beta N-d\mu>0. Therefore, there is no root ζ=ωi\zeta=\omega i with ω>0\omega>0 for (11), implying that the root of (11) cannot cross the purely imaginary axis. Thus, all roots of (9) have negative real parts. Then, E1E_{1} is locally asymptotically stable when βN(μcλβhaN)μ2cd<0\beta N(\mu c\lambda-\beta haN)-\mu^{2}cd<0.

For the second endemic equilibrium point E2E_{2}, the following result holds.

Theorem 2.4

Assume that λμcβaNh>0\lambda\mu c-\beta aNh>0. If βN(λμcβhaN)μ2cd>0\beta N(\lambda\mu c-\beta haN)-\mu^{2}cd>0, then the infected equilibrium E2E_{2} is locally asymptotically stable for τ=0\tau=0.

Proof

Let βN(λμcβhaN)μ2cd>0\beta N(\lambda\mu c-\beta haN)-\mu^{2}cd>0. The characteristic equation (6) at E2E_{2} is given by

ζ4+Aζ3+Bζ2+Cζ+D+[βaNx¯ζ2+(cβaNy¯x¯2βhaNx¯βaNdx¯)ζ+cβaNdy¯x¯2βhdaNx¯]eζτ=0,\zeta^{4}+A\zeta^{3}+B\zeta^{2}+C\zeta+D+[-\beta aN\bar{x}\zeta^{2}+(c\beta aN\bar{y}\bar{x}^{2}-\beta haN\bar{x}-\beta aNd\bar{x})\zeta\\ +c\beta aNd\bar{y}\bar{x}^{2}-\beta hdaN\bar{x}]e^{-\zeta\tau}=0, (13)

where

A\displaystyle A =μ+a+d+pz¯+βv¯,\displaystyle=\mu+a+d+p\bar{z}+\beta\bar{v},
B\displaystyle B =aμ+μd+ad+pμz¯+pdz¯phz¯+βμv¯+aβv¯+pβz¯v¯,\displaystyle=a\mu+\mu d+ad+p\mu\bar{z}+pd\bar{z}-ph\bar{z}+\beta\mu\bar{v}+a\beta\bar{v}+p\beta\bar{z}\bar{v},
C\displaystyle C =adμ+pμhz¯+phdz¯+pμdz¯+aμβv¯+phβz¯v¯+pμβz¯v¯,\displaystyle=ad\mu+p\mu h\bar{z}+phd\bar{z}+p\mu d\bar{z}+a\mu\beta\bar{v}+ph\beta\bar{z}\bar{v}+p\mu\beta\bar{z}\bar{v},
D\displaystyle D =pμhdz¯+pμhβz¯v¯aNpcβx¯z¯y¯2.\displaystyle=p\mu hd\bar{z}+p\mu h\beta\bar{z}\bar{v}-aNpc\beta\bar{x}\bar{z}\bar{y}^{2}.

If τ=0\tau=0, then the characteristic equation (13) becomes

ζ4+Eζ3+Fζ2+Gζ+H=0,\zeta^{4}+E\zeta^{3}+F\zeta^{2}+G\zeta+H=0,

where

E\displaystyle E =μ+a+d+pz¯+βv¯,\displaystyle=\mu+a+d+p\bar{z}+\beta\bar{v},
F\displaystyle F =aμ+μd+ad+pμz¯+pdz¯phz¯+βμv¯+aβv¯+pβz¯v¯βaNx¯,\displaystyle=a\mu+\mu d+ad+p\mu\bar{z}+pd\bar{z}-ph\bar{z}+\beta\mu\bar{v}+a\beta\bar{v}+p\beta\bar{z}\bar{v}-\beta aN\bar{x},
G\displaystyle G =adμ+pμhz¯+phdz¯+pμdz¯+aμβv¯+phβz¯v¯+pμβz¯v¯βaNdx¯,\displaystyle=ad\mu+p\mu h\bar{z}+phd\bar{z}+p\mu d\bar{z}+a\mu\beta\bar{v}+ph\beta\bar{z}\bar{v}+p\mu\beta\bar{z}\bar{v}-\beta aNd\bar{x},
H\displaystyle H =pμhdz¯+pμhβz¯v¯aNβphy¯z¯.\displaystyle=p\mu hd\bar{z}+p\mu h\beta\bar{z}\bar{v}-aN\beta ph\bar{y}\bar{z}.

Thus, E>0E>0, F>0F>0, G>0G>0, H>0H>0 and FGEH>0FG-EH>0, whenever βN(λμcβhaN)μ2cd>0\beta N(\lambda\mu c-\beta haN)-\mu^{2}cd>0.

Let τ>0\tau>0. Suppose that (13) has pure imaginary roots ζ=ωi\zeta=\omega i. Replacing ζ\zeta in (13) by ωi\omega i, and separating the real and imaginary parts, we obtain that

{ω4Iω2+J=Kω2+Lω+MOω3+Nω=Pω2+Qω+R\begin{cases}\displaystyle\omega^{4}-I\omega^{2}+J=K\omega^{2}+L\omega+M\\ -O\omega^{3}+N\omega=P\omega^{2}+Q\omega+R\end{cases}

with

I\displaystyle I =aμ+μd+ad+pμz¯+pdz¯phz¯+βμv¯+aβv¯+pβz¯v¯,\displaystyle=a\mu+\mu d+ad+p\mu\bar{z}+pd\bar{z}-ph\bar{z}+\beta\mu\bar{v}+a\beta\bar{v}+p\beta\bar{z}\bar{v},
J\displaystyle J =pμhdz¯+pμhβz¯v¯aNpcβx¯z¯y¯2,\displaystyle=p\mu hd\bar{z}+p\mu h\beta\bar{z}\bar{v}-aNpc\beta\bar{x}\bar{z}\bar{y}^{2},
K\displaystyle K =βaNx¯cos(ωτ),\displaystyle=-\beta aN\bar{x}\cos(\omega\tau),
L\displaystyle L =cβaNy¯x¯2sin(ωτ)+βhaNx¯sin(ωτ)+βaNdx¯sin(ωτ),\displaystyle=-c\beta aN\bar{y}\bar{x}^{2}\sin(\omega\tau)+\beta haN\bar{x}\sin(\omega\tau)+\beta aNd\bar{x}\sin(\omega\tau),
M\displaystyle M =cβaNdy¯x¯2cos(ωτ)+βhdaNx¯cos(ωτ),\displaystyle=-c\beta aNd\bar{y}\bar{x}^{2}\cos(\omega\tau)+\beta hdaN\bar{x}\cos(\omega\tau),
N\displaystyle N =adμ+pμhz¯+phdz¯+pμdz¯+aμβv¯+phβz¯v¯+pμβz¯v¯,\displaystyle=ad\mu+p\mu h\bar{z}+phd\bar{z}+p\mu d\bar{z}+a\mu\beta\bar{v}+ph\beta\bar{z}\bar{v}+p\mu\beta\bar{z}\bar{v},
O\displaystyle O =μ+a+d+pz¯+βv¯,\displaystyle=\mu+a+d+p\bar{z}+\beta\bar{v},
P\displaystyle P =βaNx¯sin(ωτ),\displaystyle=\beta aN\bar{x}\sin(\omega\tau),
Q\displaystyle Q =cβaNy¯x¯2cos(ωτ)+βhaNx¯cos(ωτ)+βaNdx¯cos(ωτ),\displaystyle=-c\beta aN\bar{y}\bar{x}^{2}\cos(\omega\tau)+\beta haN\bar{x}\cos(\omega\tau)+\beta aNd\bar{x}\cos(\omega\tau),
R\displaystyle R =cβaNdy¯x¯2sin(ωτ)βhdaNx¯sin(ωτ).\displaystyle=c\beta aNd\bar{y}\bar{x}^{2}\sin(\omega\tau)-\beta hdaN\bar{x}\sin(\omega\tau).

By adding up the squares of both equations, and using the fundamental trigonometric formula, we obtain that

ω8+Sω6+Tω4+Uω2+V=0,\omega^{8}+S\omega^{6}+T\omega^{4}+U\omega^{2}+V=0, (14)

where

S\displaystyle S =O22I,\displaystyle=O^{2}-2I,
T\displaystyle T =2J+I22NOβ2a2N2x¯2,\displaystyle=2J+I^{2}-2NO-\beta^{2}a^{2}N^{2}\bar{x}^{2},
U\displaystyle U =2IJ+N2c2β2a2N2y¯2x¯4+2cβ2a2N2hy¯x¯3\displaystyle=2IJ+N^{2}-c^{2}\beta^{2}a^{2}N^{2}\bar{y}^{2}\bar{x}^{4}+2c\beta^{2}a^{2}N^{2}h\bar{y}\bar{x}^{3}
β2a2N2h2x¯2+2cβ2a2N2dy¯x¯32β2a2N2hdx¯2\displaystyle\quad-\beta^{2}a^{2}N^{2}h^{2}\bar{x}^{2}+2c\beta^{2}a^{2}N^{2}d\bar{y}\bar{x}^{3}-2\beta^{2}a^{2}N^{2}hd\bar{x}^{2}
β2a2N2d2x¯22cβ2a2N2dy¯x¯3+2β2a2N2hdx¯2,\displaystyle\quad-\beta^{2}a^{2}N^{2}d^{2}\bar{x}^{2}-2c\beta^{2}a^{2}N^{2}d\bar{y}\bar{x}^{3}+2\beta^{2}a^{2}N^{2}hd\bar{x}^{2},
V\displaystyle V =J2+2cβ2a2N2d2hy¯x¯3β2h2d2a2N2x¯2.\displaystyle=J^{2}+2c\beta^{2}a^{2}N^{2}d^{2}h\bar{y}\bar{x}^{3}-\beta^{2}h^{2}d^{2}a^{2}N^{2}\bar{x}^{2}.

Equation (14) admits at least two pure imaginary roots. Indeed, let λ=1\lambda=1, d=110d=\frac{1}{10}, β=12\beta=\frac{1}{2}, a=15a=\frac{1}{5}, p=1p=1, c=110c=\frac{1}{10}, h=110h=\frac{1}{10}, N=1500N=1500, μ=1\mu=1. Then, equation (14) is given by

ω8+3262009360000ω64196094500000ω4+1060237300000000ω2+3132000000=0.\omega^{8}+\frac{3262009}{360000}\omega^{6}-\frac{419609}{4500000}\omega^{4}+\frac{1060237}{300000000}\omega^{2}+\frac{313}{2000000}=0.

This equation admits four pure imaginary roots; due to length of their writing space, we give here their approximated values:

0.1550207983i,0.1550207983i,3.008467478i and 3.008467478i.0.1550207983i,\quad-0.1550207983i,\quad 3.008467478i\ \text{ and }\ -3.008467478i.

Therefore, from Rouché’s theorem, we cannot conclude anything about the stability of E2E_{2}. Numerically, however, we can show that the endemic equilibrium E2E_{2} is locally asymptotically stable for certain values of τ\tau. For example, let τ=10\tau=10, λ=1\lambda=1, d=110d=\frac{1}{10}, β=0.00025\beta=0.00025, p=0.001p=0.001, a=0.2a=0.2, c=0.03c=0.03, N=1500N=1500, and μ=3\mu=3. In this case, it is easy to show analytically that the characteristic equation (13) is given by f(ζ)=0f(\zeta)=0 with

f(ζ)=ζ4+1997600ζ3+121120ζ2+4015000ζ+1200058eζτζ2116eζτζ.f(\zeta)=\zeta^{4}+\frac{1997}{600}\zeta^{3}+\frac{121}{120}\zeta^{2}+\frac{401}{5000}\zeta+\frac{1}{2000}-\frac{5}{8}e^{-\zeta\tau}\zeta^{2}-\frac{1}{16}e^{-\zeta\tau}\zeta.

Thus, f(0)=12000f(0)=\frac{1}{2000} and the derivative is always positive for τ0\tau\geq 0. Therefore, f(ζ)f(\zeta) does not have nonnegative real roots. Analogously, we can show numerically that E2E_{2} is locally asymptotically stable for some other positive values of the time delay τ\tau. A general result remains, however, an open question.

3 Optimal control

In this section, we study an optimal control problem associated with the delayed HIV model with CTL immune response (2).

3.1 The optimization problem

We suggest the following delayed control system with two control variables u1u_{1} and u2u_{2}:

{dx(t)dt=λdx(t)β(1u1(t))x(t)v(t),dy(t)dt=β(1u1(t))x(tτ)v(tτ)ay(t)py(t)z(t),dv(t)dt=aN(1u2(t))y(t)μv(t),dz(t)dt=cx(t)y(t)z(t)hz(t),\begin{cases}\displaystyle\frac{dx(t)}{dt}=\lambda-dx(t)-\beta(1-u_{1}(t))x(t)v(t),\\[8.5359pt] \displaystyle\frac{dy(t)}{dt}=\beta(1-u_{1}(t))x(t-\tau)v(t-\tau)-ay(t)-py(t)z(t),\\[8.5359pt] \displaystyle\frac{dv(t)}{dt}=aN(1-u_{2}(t))y(t)-\mu v(t),\\[8.5359pt] \displaystyle\frac{dz(t)}{dt}=cx(t)y(t)z(t)-hz(t),\end{cases} (15)

where the controls belong to the control set UU defined by

U={(u1,u2):ui is measurable,0ui(t)1,t[0,tf],i=1,2}.U=\left\{(u_{1},u_{2}):u_{i}\text{ is measurable},\quad 0\leq u_{i}(t)\leq 1,\quad t\in[0,t_{f}],\quad i=1,2\right\}.

Here, u1u_{1} represents the efficiency of drug therapy in blocking new infections, so that the infection rate in presence of drug is (1u1)(1-u_{1}); while u2u_{2} stands for the efficiency of drug therapy in inhibiting viral production, such that the virion production rate under therapy is (1u2)(1-u_{2}). The optimization problem under consideration is to maximize the objective functional

𝒥(u1,u2)=0tf{x(t)+z(t)[A12u12(t)+A22u22(t)]}𝑑t,\displaystyle\mathcal{J}(u_{1},u_{2})=\int^{t_{f}}_{0}\left\{x(t)+z(t)-\left[\frac{A_{1}}{2}u_{1}^{2}(t)+\frac{A_{2}}{2}u_{2}^{2}(t)\right]\right\}dt, (16)

where tft_{f} is the time period of treatment and the positive constants A1A_{1} and A2A_{2} stand for the benefits and costs of the introduced treatment, subject to the control system (15). The two control functions, u1()u_{1}(\cdot) and u2()u_{2}(\cdot), are assumed to be bounded and Lebesgue integrable. Summarizing, the optimal control problem under study consists to find u1u_{1}^{*} and u2u_{2}^{*} such that

J(u1,u2)\displaystyle J(u_{1}^{*},u_{2}^{*}) =max{𝒥(u1,u2):(u1,u2)U}\displaystyle=\max\{\mathcal{J}(u_{1},u_{2}):(u_{1},u_{2})\in U\} (17)
subject to (15),(3),(4).\displaystyle\text{subject to }\eqref{sy1},\eqref{2},\eqref{3}.

Pontryagin’s minimum principle Gollmann provides necessary optimality conditions for such optimal control problem with delays. Roughly speaking, this principle reduces (17) to a problem of maximizing an Hamiltonian HH pointwisely with respect to u1u_{1} and u2u_{2}. In our case the Hamiltonian is given by

H(x,y,v,z,xτ,vτ,u1,u2,ψ1,ψ2,ψ3,ψ4)=A12u12+A22u22xz+i=04ψifi(x,y,v,z,xτ,vτ,u1,u2)H(x,y,v,z,x_{\tau},v_{\tau},u_{1},u_{2},\psi_{1},\psi_{2},\psi_{3},\psi_{4})=\frac{A_{1}}{2}u_{1}^{2}+\frac{A_{2}}{2}u_{2}^{2}-x-z+\displaystyle\sum_{i=0}^{4}\psi_{i}f_{i}(x,y,v,z,x_{\tau},v_{\tau},u_{1},u_{2})

with

{f1=λdxβ(1u1)xv,f2=β(1u1)xτvτaypyz,f3=aN(1u2)yμv,f4=cxyzhz.\left\{\begin{aligned} f_{1}&=\lambda-dx-\beta(1-u_{1})xv,\\ f_{2}&=\beta(1-u_{1})x_{\tau}v_{\tau}-ay-pyz,\\ f_{3}&=aN(1-u_{2})y-\mu v,\\ f_{4}&=cxyz-hz.\end{aligned}\right.

By applying Pontryagin’s minimum principle Gollmann , we obtain the following result.

Theorem 3.1

For any initial conditions (3)–(4), the system (15) has a unique solution. This solution is nonnegative and bounded for all t0t\geq 0. In addition, if u1u_{1}^{*} and u2u_{2}^{*} are optimal controls and xx^{*}, yy^{*}, vv^{*} and zz^{*} corresponding solutions of the state system (15), then there exists adjoint variables ψ1\psi_{1}, ψ2\psi_{2}, ψ3\psi_{3} and ψ4\psi_{4} satisfying the adjoint equations

{ψ1(t)=1+ψ1(t)[d+(1u1(t))βv(t)]ψ4(t)cy(t)z(t)+χ[0,tfτ](t)ψ2(t+τ)(u1(t+τ)1)βv(t),ψ2(t)=ψ2(t)aψ3(t)(1u2(t))aNψ4(t)cx(t)z(t)+ψ2(t)pz(t),ψ3(t)=ψ1(t)[β(1u1(t))x(t)]+ψ3(t)μ+χ[0,tfτ](t)ψ2(t+τ)[β(u1(t+τ)1)x(t)],ψ4(t)=1+ψ2(t)py(t)+ψ4(t)[hcx(t)y(t)]\begin{cases}\psi^{\prime}_{1}(t)=1+\psi_{1}(t)\big{[}d+\big{(}1-u_{1}^{*}(t)\big{)}\beta v^{*}(t)\big{]}-\psi_{4}(t)cy^{*}(t)z^{*}(t)\\ \qquad\quad+\chi_{[0,t_{f}-\tau]}(t)\psi_{2}\big{(}t+\tau\big{)}\big{(}u_{1}^{*}\big{(}t+\tau\big{)}-1\big{)}\beta v^{*}(t),\\ \psi^{\prime}_{2}(t)=\psi_{2}(t)a-\psi_{3}(t)\big{(}1-u^{*}_{2}(t)\big{)}aN-\psi_{4}(t)cx^{*}(t)z^{*}(t)+\psi_{2}(t)pz^{*}(t),\\ \psi^{\prime}_{3}(t)=\psi_{1}(t)\big{[}\beta(1-u_{1}^{*}(t))x^{*}(t)\big{]}+\psi_{3}(t)\mu+\chi_{[0,t_{f}-\tau]}(t)\psi_{2}(t+\tau)\left[\beta(u^{*}_{1}(t+\tau)-1)x^{*}(t)\right],\\ \psi^{\prime}_{4}(t)=1+\psi_{2}(t)py^{*}(t)+\psi_{4}(t)\left[h-cx^{*}(t)y^{*}(t)\right]\end{cases}

with transversality conditions

ψi(tf)=0,i=1,,4.\psi_{i}(t_{f})=0,\quad i=1,\ldots,4.

Moreover, the optimal controls satisfy

u1(t)=\displaystyle u^{*}_{1}(t)= min(1,max(0,βA1[ψ2(t)v(tτ)x(tτ)ψ1(t)v(t)x(t)])),\displaystyle\min\bigg{(}1,\max\bigg{(}0,\frac{\beta}{A_{1}}\bigg{[}\psi_{2}(t)v^{*}(t-\tau)x^{*}(t-\tau)-\psi_{1}(t)v^{*}(t)x^{*}(t)\bigg{]}\bigg{)}\bigg{)}, (18)
u2(t)=\displaystyle u^{*}_{2}(t)= min(1,max(0,1A2ψ3(t)aNy(t))).\displaystyle\min\bigg{(}1,\max\bigg{(}0,\frac{1}{A_{2}}\psi_{3}(t)aNy^{*}(t)\bigg{)}\bigg{)}.
Proof

The proof of positivity and boundedness of solutions is similar to the one of Theorem 2.1. It is enough to use the fact that ui(t)Uu_{i}(t)\in U, i=1,2i=1,2, which means that ui(t)L1\|u_{i}(t)\|_{L^{\infty}}\leq 1. For the rest of the proof, we remark that the adjoint equations and transversality conditions are obtained by using the Pontryagin minimum principle with delays of Gollmann , from which

{ψ1(t)=Hx(t)χ[0,tfτ](t)Hxτ(t+τ),ψ1(tf)=0,ψ2(t)=Hy(t),ψ2(tf)=0,ψ3(t)=Hv(t)χ[0,tfτ](t)Hvτ(t+τ),ψ3(tf)=0,ψ4(t)=Hz(t),ψ4(tf)=0.\begin{cases}\psi^{\prime}_{1}(t)=-\frac{\partial H}{\partial x}(t)-\chi_{[0,t_{f}-\tau]}(t)\frac{\partial H}{\partial x_{\tau}}(t+\tau),\qquad&\psi_{1}(t_{f})=0,\\ \psi^{\prime}_{2}(t)=-\frac{\partial H}{\partial y}(t),\qquad&\psi_{2}(t_{f})=0,\\ \psi^{\prime}_{3}(t)=-\frac{\partial H}{\partial v}(t)-\chi_{[0,t_{f}-\tau]}(t)\frac{\partial H}{\partial v_{\tau}}(t+\tau),\qquad&\psi_{3}(t_{f})=0,\\ \psi^{\prime}_{4}(t)=-\frac{\partial H}{\partial z}(t),\qquad&\psi_{4}(t_{f})=0.\end{cases}

From the optimality conditions,

Hu1(t)=0,Hu2(t)=0,\frac{\partial H}{\partial u_{1}}(t)=0,\qquad\frac{\partial H}{\partial u_{2}}(t)=0,

that is,

A1u1(t)+βψ1(t)v(t)x(t)βψ2(t)v(tτ)x(tτ)=0,\displaystyle A_{1}u_{1}(t)+\beta\psi_{1}(t)v(t)x(t)-\beta\psi_{2}(t)v(t-\tau)x(t-\tau)=0,
A2u2(t)aNψ3(t)y(t)=0.\displaystyle A_{2}u_{2}(t)-aN\psi_{3}(t)y(t)=0.

Taking into account the bounds in UU for the two controls, one obtains u1u_{1}^{*} and u2u_{2}^{*} in form (18).

3.2 Existence of an optimal control pair

The existence of the optimal control pair can be directly obtained using the results in Fleming ; Lukes . More precisely, we have the following theorem.

Theorem 3.2

There exists an optimal control pair (u1,u2)U(u_{1}^{*},u_{2}^{*})\in U solution of (17).

Proof

To use the existence result in Fleming , we first need to check the following properties:

  1. (P1)(P_{1})

    the set of controls and corresponding state variables is nonempty;

  2. (P2)(P_{2})

    the control set UU is convex and closed;

  3. (P3)(P_{3})

    the right-hand side of the state system is bounded by a linear function in the state and control variables;

  4. (P4)(P_{4})

    the integrand of the objective functional is concave on UU;

  5. (P5)(P_{5})

    there exist constants c1,c2>0c_{1},c_{2}>0 and β>1\beta>1 such that the integrand

    L(x,z,u1,u2)=x+z(A12u12+A22u22)L(x,z,u_{1},u_{2})=x+z-\left(\frac{A_{1}}{2}u_{1}^{2}+\frac{A_{2}}{2}u_{2}^{2}\right)

    of the objective functional (16) satisfies

    L(x,z,u1,u2)c2c1(u12+u22)β2.L(x,z,u_{1},u_{2})\leq c_{2}-c_{1}(\mid u_{1}\mid^{2}+\mid u_{2}\mid^{2})^{{}^{\frac{\beta}{2}}}.

Using the result in Lukes , we obtain existence of solutions of system (15), which gives condition (P1)(P_{1}). The control set is convex and closed by definition, which gives condition (P2)(P_{2}). Since our state system is bilinear in u1u_{1} and u2u_{2}, the right-hand side of system (15) satisfies condition (P3)(P_{3}), using the boundedness of solutions. Note that the integrand of our objective functional is concave. Also, we have the last needed condition:

L(x,z,u1,u2)c2c1(u12+u22),L(x,z,u_{1},u_{2})\leq c_{2}-c_{1}\left(\mid u_{1}\mid^{2}+\mid u_{2}\mid^{2}\right),

where c2c_{2} depends on the upper bound on xx and zz, and c1>0c_{1}>0 since A1>0A_{1}>0 and A2>0A_{2}>0. We conclude that there exists an optimal control pair (u1,u2)U(u_{1}^{*},u_{2}^{*})\in U such that

J(u1,u2)=max(u1,u2)U𝒥(u1,u2)J(u_{1}^{*},u_{2}^{*})=\displaystyle\max_{(u_{1},u_{2})\in U}\mathcal{J}(u_{1},u_{2})

subject to (15), (3) and (4). The proof is complete.

3.3 The optimality system

The optimality system consists of the state system coupled with the adjoint equations, the initial conditions, transversality conditions, and the characterization of optimal controls (18). Precisely, if we substitute the expressions of u1u_{1}^{*} and u2u_{2}^{*} in (15), then we obtain the following optimality system:

{dx(t)dt=λdx(t)β(1u1(t))x(t)v(t),dy(t)dt=β(1u1(t))x(tτ)v(tτ)ay(t)py(t)z(t),dv(t)dt=aN(1u2(t))y(t)μv(t),dz(t)dt=cx(t)y(t)z(t)hz(t),dψ1(t)dt=1+ψ1(t)[d+(1u1(t))βv(t)]ψ4(t)cy(t)z(t)+χ[0,tfτ](t)ψ2(t+τ)(u1(t+τ)1)βv(t),dψ2(t)dt=ψ2(t)aψ3(t)(1u2(t))aNψ4(t)cx(t)z(t)+ψ2(t)pz(t),dψ3(t)dt=ψ1(t)[β(1u1(t))x(t)]+ψ3(t)μ+χ[0,tfτ](t)ψ2(t+τ)[β(u1(t+τ)1)x(t)],dψ4(t)dt=1+ψ2(t)py(t)+ψ4(t)[hcx(t)y(t)],u1=min(1,max(0,βA1[ψ2(t)vτxτψ1(t)v(t)x(t)])),u2=min(1,max(0,1A2ψ3(t)aNy(t))),ψi(tf)=0,i=1,,5.\begin{cases}\displaystyle\frac{dx^{*}(t)}{dt}=\lambda-dx^{*}(t)-\beta(1-u^{*}_{1}(t))x^{*}(t)v^{*}(t),\\[8.5359pt] \displaystyle\frac{dy^{*}(t)}{dt}=\beta(1-u^{*}_{1}(t))x^{*}(t-\tau)v^{*}(t-\tau)-ay^{*}(t)-py^{*}(t)z^{*}(t),\\[8.5359pt] \displaystyle\frac{dv^{*}(t)}{dt}=aN(1-u_{2}^{*}(t))y^{*}(t)-\mu v^{*}(t),\\[8.5359pt] \displaystyle\frac{dz^{*}(t)}{dt}=cx^{*}(t)y^{*}(t)z^{*}(t)-hz^{*}(t),\\[8.5359pt] \displaystyle\frac{d\psi_{1}(t)}{dt}=1+\psi_{1}(t)\big{[}d+\big{(}1-u_{1}^{*}(t)\big{)}\beta v^{*}(t)\big{]}-\psi_{4}(t)cy^{*}(t)z^{*}(t)\\[8.5359pt] \qquad\qquad+\chi_{[0,t_{f}-\tau]}(t)\psi_{2}\big{(}t+\tau\big{)}\big{(}u_{1}^{*}\big{(}t+\tau\big{)}-1\big{)}\beta v^{*}(t),\\[8.5359pt] \displaystyle\frac{d\psi_{2}(t)}{dt}=\psi_{2}(t)a-\psi_{3}(t)\big{(}1-u^{*}_{2}(t)\big{)}aN-\psi_{4}(t)cx^{*}(t)z^{*}(t)+\psi_{2}(t)pz^{*}(t),\\[8.5359pt] \displaystyle\frac{d\psi_{3}(t)}{dt}=\psi_{1}(t)\big{[}\beta(1-u_{1}^{*}(t))x^{*}(t)\big{]}+\psi_{3}(t)\mu+\chi_{[0,t_{f}-\tau]}(t)\psi_{2}(t+\tau)\big{[}\beta(u^{*}_{1}(t+\tau)-1)x^{*}(t)\big{]},\\[8.5359pt] \displaystyle\frac{d\psi_{4}(t)}{dt}=1+\psi_{2}(t)py^{*}(t)+\psi_{4}(t)\big{[}h-cx^{*}(t)y^{*}(t)\big{]},\\[8.5359pt] u^{*}_{1}=\min\bigg{(}1,\max\bigg{(}0,\frac{\beta}{A_{1}}\bigg{[}\psi_{2}(t)v^{*}_{\tau}x^{*}_{\tau}-\psi_{1}(t)v^{*}(t)x^{*}(t)\bigg{]}\bigg{)}\bigg{)},\\[8.5359pt] u^{*}_{2}=\min\bigg{(}1,\max\bigg{(}0,\frac{1}{A_{2}}\psi_{3}(t)aNy^{*}(t)\bigg{)}\bigg{)},\\[8.5359pt] \psi_{i}(t_{f})=0,\quad i=1,\ldots,5.\end{cases}

4 Numerical simulations

In order to solve the optimality system given in Section 3.3, we use a numerical scheme based on forward and backward finite difference approximations. Precisely, we implemented Algorithm 1.

Remark 1

In our implementation, we choose the initial functions (3), satisfying (4), as x(t)x0x(t)\equiv x_{0}, y(t)y0y(t)\equiv y_{0}, v(t)v0v(t)\equiv v_{0}, z(t)z0z(t)\equiv z_{0}, for all t[τ,0]t\in[-\tau,0] (see Step 1 of Algorithm 1).

Algorithm 1 Numerical algorithm for the optimal control problem (17)

Step 1:

for i=m,,0,i=-m,\ldots,0, do:

xi=x0,yi=y0,vi=v0,zi=z0,u1i=0,u2i=0x_{i}=x_{0},\quad y_{i}=y_{0},\quad v_{i}=v_{0},\quad z_{i}=z_{0},\quad u_{1}^{i}=0,\quad u_{2}^{i}=0

end for;

for i=n,,n+mi=n,\ldots,n+m, do:

ψ1i=0,ψ2i=0,ψ3i=0,ψ4i=0\psi_{1}^{i}=0,\quad\psi_{2}^{i}=0,\quad\psi_{3}^{i}=0,\quad\psi_{4}^{i}=0

end for;

Step 2:

for i=0i=0, …, n1n-1, do:

xi+1=xi+h[λdxiβ(1u1i)xivi],yi+1=yi+h[β(1u1i)ximvimayipyizi],vi+1=vi+h[aN(1u2i)yiμvi],zi+1=zi+h[cxiyizihzi],ψ1ni1=ψ1nih[1+ψ1ni(d+(1u1i)βvi+1)ψ4ni(cyi+1zi+1)+χ[0,tfτ](tni)ψ2ni+m(u1i+m1)βvi+1],ψ2ni1=ψ2nih[ψ2ni(a+pzi+1)ψ2ni(aN(1u2i))ψ4ni(cxi+1zi+1],ψ3ni1=ψ3nih[ψ1ni(1u1i)βxi+1+ψ3niμ+χ[0,tfτ](tni)ψ2ni+m(u1i+m1)xi+1],ψ4ni1=ψ4nih[1+pψ2niyi+1+ψ4ni(hcxi+1yi+1)],R1i+1=(β/A1)(ψ2ni1vim+1xim+1ψ1ni1vi+1xi+1),R2i+1=(1/A2)ψ3ni1aNyi+1,u1i+1=min(1,max(R1i+1,0)),u2i+1=min(1,max(R2i+1,0))\begin{split}x_{i+1}&=x_{i}+h[\lambda-dx_{i}-\beta(1-u_{1}^{i})x_{i}v_{i}],\\ y_{i+1}&=y_{i}+h[\beta(1-u_{1}^{i})x_{i-m}v_{i-m}-ay_{i}-py_{i}z_{i}],\\ v_{i+1}&=v_{i}+h[aN(1-u_{2}^{i})y_{i}-\mu v_{i}],\\ z_{i+1}&=z_{i}+h[cx_{i}y_{i}z_{i}-hz_{i}],\\ \psi_{1}^{n-i-1}&=\psi_{1}^{n-i}-h[1+\psi_{1}^{n-i}(d+(1-u_{1}^{i})\beta v_{i+1})-\psi_{4}^{n-i}(cy_{i+1}z_{i+1})\\ &\qquad+\chi_{[0,t_{f}-\tau]}(t_{n-i})\psi_{2}^{n-i+m}(u_{1}^{i+m}-1)\beta v_{i+1}],\\ \psi_{2}^{n-i-1}&=\psi_{2}^{n-i}-h[\psi_{2}^{n-i}(a+pz_{i+1})-\psi_{2}^{n-i}(aN(1-u_{2}^{i}))-\psi_{4}^{n-i}(cx_{i+1}z_{i+1}],\\ \psi_{3}^{n-i-1}&=\psi_{3}^{n-i}-h\big{[}\psi_{1}^{n-i}(1-u_{1}^{i})\beta x_{i+1}+\psi_{3}^{n-i}\mu\\ &\qquad+\chi_{[0,t_{f}-\tau]}(t_{n-i})\psi_{2}^{n-i+m}(u_{1}^{i+m}-1)x_{i+1}\big{]},\\ \psi_{4}^{n-i-1}&=\psi_{4}^{n-i}-h[1+p\psi_{2}^{n-i}y_{i+1}+\psi_{4}^{n-i}(h-cx_{i+1}y_{i+1})],\\ R_{1}^{i+1}&=(\beta/A_{1})(\psi_{2}^{n-i-1}v_{i-m+1}x_{i-m+1}-\psi_{1}^{n-i-1}v_{i+1}x_{i+1}),\\ R_{2}^{i+1}&=(1/A_{2})\psi_{3}^{n-i-1}aNy_{i+1},\\ u_{1}^{i+1}&=\min(1,\max(R_{1}^{i+1},0)),\\ u_{2}^{i+1}&=\min(1,\max(R_{2}^{i+1},0))\end{split}

end for;

Step 3:

for i=1,,ni=1,\ldots,n, write:

x(ti)=xi,y(ti)=yi,v(ti)=vi,z(ti)=zi,u1(ti)=u1i,u2(ti)=u2ix^{*}(t_{i})=x_{i},\quad y^{*}(t_{i})=y_{i},\quad v^{*}(t_{i})=v_{i},\quad z^{*}(t_{i})=z_{i},\quad u_{1}^{*}(t_{i})=u_{1}^{i},\quad u_{2}^{*}(t_{i})=u_{2}^{i}

end for.

In our simulations, the following parameters are used:

λ=1,d=0.1,β=0.00025,p=0.001,h=0.2,a=0.2,c=0.03,μ=3,A1=30,A2=40,τ=10.\begin{gathered}\lambda=1,\quad d=0.1,\quad\beta=0.00025,\quad p=0.001,\quad h=0.2,\\ a=0.2,\quad c=0.03,\quad\mu=3,\quad A_{1}=30,\quad A_{2}=40,\quad\tau=10.\end{gathered} (19)

Such values respect the HIV parameter ranges given in Table 1.

Table 1: Parameters, their symbols and meaning, and default values used in HIV literature
Parameters Meaning Value References
λ\lambda source rate of CD4+ T cells 111010 cells μl1\mu l^{-1} days-1 crs
dd decay rate of healthy cells 0.0070.0070.10.1 days-1 crs
β\beta rate at which CD4+ T cells become infected 0.000250.000250.50.5 μl\mu l virion-1 days-1 crs
aa death rate of infected CD4+ T cells, not by CTL 0.20.20.30.3 days-1 crs
μ\mu clearance rate of virus 2.062.063.813.81 days-1 per
NN number of virions produced by infected CD4+ T-cells 6.256.2523599.923599.9 virion-1 5a ; 32
pp clearance rate of infection 114.048×1044.048\times 10^{-4} ml virion days-1 5a ; 22
cc activation rate of CTL cells 0.00510.00513.9123.912 days-1 5a
hh death rate of CTL cells 0.0040.0048.0878.087 days-1 5a
τ\tau time delay 772121 days 14 ; 17

In Figure 1, we use the two following initial conditions:

x0=5,y0=1,v0=1,z0=2x_{0}=5,\quad y_{0}=1,\quad v_{0}=1,\quad z_{0}=2 (20)

and

x0=45,y0=2,v0=1,z0=4.x_{0}=45,\quad y_{0}=2,\quad v_{0}=1,\quad z_{0}=4. (21)

Moreover, besides parameters (19), we have chosen N=750N=750, which means that Nβλdμ=0.1125<0N\beta\lambda-d\mu=-0.1125<0. According to Theorem 2.2, the disease-free equilibrium Ef=(10,0,0,0)E_{f}=(10,0,0,0) is locally asymptotically stable. The plots of Figure 1 confirm this result of local stability for both initial conditions (20) and (21).

Refer to caption
(a) x(t)x(t)
Refer to caption
(b) y(t)y(t)
Refer to caption
(c) v(t)v(t)
Refer to caption
(d) z(t)z(t)
Figure 1: Behavior of infection for N=750N=750 and parameter values (19). The continuous curves correspond to initial conditions (20) and dashed curves to initial conditions (21).

In Figure 2, we have chosen N=1500N=1500, which means that λμcβaNh=7.50×102>0\lambda\mu c-\beta aNh=7.50\times 10^{-2}>0 and Nβ(λμcβhaN)(μ2cd)=11.245×104>0N\beta(\lambda\mu c-\beta haN)-(\mu^{2}cd)=11.245\times 10^{-4}>0. According to Theorem 2.4, the endemic equilibrium E2E_{2} is locally stable. Figure 2 confirms this result numerically: we clearly see the convergence to the equilibrium point E2=(8.33,0.8,80,8.333)E_{2}=(8.33,0.8,80,8.333). However, it is interesting to point out that, with control, a significant decrease of the infected cells, free viruses, and CTL cells, is observed (see Figure 2). The uninfected cells get maximized. It is worth to mention that with control treatment the infection dies very fast and the dynamics goes toward the disease-free equilibrium.

Refer to caption
(a) x(t)x(t)
Refer to caption
(b) y(t)y(t)
Refer to caption
(c) v(t)v(t)
Refer to caption
(d) z(t)z(t)
Figure 2: Behavior of infection during 500 days for N=1500N=1500, parameter values (19), and initial conditions (20): dotted line without control and without delay (τ=0\tau=0); dashed line without control but with delay τ=10\tau=10; continuous line for the delayed problem τ=10\tau=10 under optimal control.
Refer to caption
(a) u1(t)u_{1}^{*}(t)
Refer to caption
(b) u2(t)u_{2}^{*}(t)
Figure 3: The two extremal controls u1u_{1}^{*} and u2u_{2}^{*} for the delayed optimal control problem (17) with N=1500N=1500, parameter values (19), and initial conditions (20), obtained using Algorithm 1.

The behavior of the two treatments during time is given in Figure 3. We can see that the first control makes several switchings from zero to one and vice versa. We can understand from this that one can manage the first treatment to the patient periodically in full manner. In this figure, we can also see that the second control is almost equal to one but with sudden decreases, for some short periods of time, without vanishing.

5 Conclusion

In this work we have studied a delayed HIV viral infection model with CTL immune response. The considered model includes four differential equations describing the interaction between the uninfected cells, infected cells, HIV free viruses and CTL immune response. An intracellular time delay and two treatments are incorporated to the suggested model. First, existence, positivity and boundedness of solutions are established. Next, an optimization problem is formulated in order to search the better optimal control pair to maximize the number of uninfected cells, reduce the infected cells and minimize the viral load. Two control functions are incorporated in the model, which represent the efficiency of drug treatment in inhibiting viral production and preventing new infections. The existence of such optimal control pair is established and the optimality system is given and solved numerically, using a forward and backward difference approximation scheme. It was shown that the obtained optimal control pair increases considerably the number of CD4+ cells while reducing the number of infected. Moreover, it was also observed that, under optimal control, the viral load decreases significantly compared with the model without control, which will improve the life quality of the patient. It remains an open question how to prove stability of the endemic equilibrium E2E_{2} of model (2) for an arbitrary intracellular time delay τ>0\tau>0.

Acknowledgements.
This research is part of second author’s Ph.D., which is carried out at University of Hassan II Casablanca, Morocco. Torres was partially supported by project TOCCATA, reference PTDC/EEI-AUT/2933/2014, funded by Project 3599 – Promover a Produção Científica e Desenvolvimento Tecnológico e a Constituição de Redes Temáticas (3599-PPCDT) and FEDER funds through COMPETE 2020, Programa Operacional Competitividade e Internacionalização (POCI), and by Portuguese funds through Fundação para a Ciência e a Tecnologia (FCT) and CIDMA, within project UID/MAT/04106/2013. The authors are grateful to the referees for their valuable comments and helpful suggestions.

References

  • (1) Blattner, W., Gallo, R. C., Temin, H. M.: HIV causes AIDS, Science 241(4865), 515–516 (1988)
  • (2) Busch, M. P., Satten, G. A.: Time course of viremia and antibody seroconversion following human immunodeficiency virus exposure, Amer. J. Med. 102(5B), 117–126 (1997)
  • (3) Ciupe, M. S., Bivort, B. L., Bortz, D. M., Nelson, P. W.: Estimating kinetic parameters from HIV primary infection data through the eyes of three different mathematical models, Math. Biosci. 200(1), 1–27 (2006)
  • (4) Culshaw, R., Ruan, S., Spiteri, R. J.: Optimal HIV treatment by maximising immune response, J. Math. Biol. 48(5), 545–562 (2004)
  • (5) De Boer, R. J., Perelson, A. S.: Target cell limited and immune control models of HIV infection: a comparison, J. Theor. Biol. 190(3), 201–214 (1998)
  • (6) Denysiuk, R., Silva, C. J., Torres, D. F. M.: Multiobjective optimization to a TB-HIV/AIDS coinfection optimal control problem, Computational and Applied Mathematics, in press. DOI: 10.1007/s40314-017-0438-9 arXiv:1703.05458
  • (7) Fleming, W. H., Rishel, R. W.: Deterministic and stochastic optimal control, Springer, Berlin (1975)
  • (8) Göllmann, L., Kern, D., Maurer, H.: Optimal control problems with delays in state and control variables subject to mixed control-state constraints, Optimal Control Appl. Methods 30(4), 341–365 (2009)
  • (9) Hale, J. K., Verduyn Lunel, S. M.: Introduction to functional-differential equations, Applied Mathematical Sciences, 99, Springer, New York (1993)
  • (10) Kahn, J. O., Walker, B. D.: Acute human immunodeficiency virus type 1 infection, New Engl. J. Med. 339(1), 33–39 (1998)
  • (11) Kirschner, D.: Using mathematics to understand HIV immune dynamics, Notices Amer. Math. Soc. 43(2), 191–202 (1996)
  • (12) Lukes, D. L.: Differential equations, Mathematics in Science and Engineering, 162, Academic Press, London (1982)
  • (13) Nowak, M., May, R.: Mathematical biology of HIV infection: antigenic variation and diversity threshold, Math. Biosci. 106(1), 1–21 (1991)
  • (14) Pawelek, K. A., Liu, S., Pahlevani, F., Rong, L.: A model of HIV-1 infection with two time delays: mathematical analysis and comparison with patient data, Math. Biosci. 235(1), 98–109 (2012)
  • (15) Perelson, A. S., Nelson, P. W.: Mathematical analysis of HIV-1 dynamics in vivo, SIAM Rev. 41(1), 3–44 (1999)
  • (16) Perelson, A. S., Neumann, A. U., Markowitz, M., Leonard, J. M., Ho, D. D.: HIV-1 dynamics in vivo: virion clearance rate, infected cell life-span, and viral generation time, Science 271(5255), 1582–1586 (1996)
  • (17) Rocha, D., Silva, C. J., Torres, D. F. M.: Stability and optimal control of a delayed HIV model, Math. Methods Appl. Sci., in press. DOI: 10.1002/mma.4207 arXiv:1609.07654
  • (18) Silva, C. J., Torres, D. F. M.: Modeling TB-HIV syndemic and treatment, J. Appl. Math. 2014, Art. ID 248407, 14 pp (2014) arXiv:1406.0877
  • (19) Silva, C. J., Torres, D. F. M.: A TB-HIV/AIDS coinfection model and optimal control treatment, Discrete Contin. Dyn. Syst. 35(9), 4639–4663 (2015) arXiv:1501.03322
  • (20) Silva, C. J., Torres, D. F. M.: A SICA compartmental model in epidemiology with application to HIV/AIDS in Cape Verde, Ecological Complexity 30, 70–75 (2017) arXiv:1612.00732
  • (21) Silva, C. J., Torres, D. F. M.: Modeling and optimal control of HIV/AIDS prevention through PrEP, Discrete Contin. Dyn. Syst. Ser. S 11(1), 119–141 (2018) arXiv:1703.06446
  • (22) Stafford, M. A., Corey, L., Cao, Y., Daar, E. S., Ho, D. D., Perelson, A. S.: Modeling plasma virus concentration during primary HIV infection, J. Theor. Biol. 203(3), 285–301 (2000)
  • (23) Wang, Y., Zhou, Y., Brauer, F., Heffernan, J. M.: Viral dynamics model with CTL immune response incorporating antiretroviral therapy, J. Math. Biol. 67(4), 901–934 (2013)
  • (24) Weiss, R.: How does HIV cause AIDS?, Science 260(5112), 1273–1279 (1993)