22email: ricardo.baccas02@uwimona.edu.jm 33institutetext: Cónall Kelly 44institutetext: School of Mathematical Sciences, University College Cork, Ireland.
44email: conall.kelly@ucc.ie 55institutetext: Alexandra Rodkina 66institutetext: Department of Mathematics, University of the West Indies, Mona, Kingston 7, Jamaica.
66email: alexandra.rodkina@uwimona.edu.jm
On cubic difference equations with variable coefficients and fading stochastic perturbations
Abstract
We consider the stochastically perturbed cubic difference equation with variable coefficients
Here is a sequence of independent random variables, and and are sequences of nonnegative real numbers. We can stop the sequence after some random time so it becomes a constant sequence, where the common value is an -measurable random variable. We derive conditions on the sequences , and , which guarantee that exists almost surely (a.s.), and that the limit is equal to zero a.s. for any initial value .
1 Introduction
In this paper we analyse the global almost sure (a.s.) asymptotic behaviour of solutions of a cubic difference equation with variable coefficients and subject to stochastic perturbations
(1) |
Here is a sequence of independent identically distributed random variables, is a sequence of nonnegative reals, and is a sequence of nonnegative reals.
When is an independent sequence of standard Normal random variables, (1) can be interpreted as the Euler-Maruyama discretisation of the Itô-type stochastic differential equation
(2) |
where is a standard Wiener process, is some constant, is a continuous function. It was shown in CW that when solutions of stochastic differential equation (2) are globally a.s. asymptotically stable, i.e. , almost surely, for any initial value .
There is an extensive literature on the global a.s. asymptotic behaviour of solutions of nonlinear stochastic difference equations, and the most relevant publications for our purposes are: [1, 2, 3, 4, 5, 7, 14, 15]. However, if the timestep sequence in Eq. (1) is constant, so that , the global dynamics of (2) are not preserved and convergence of solutions to zero will only occur on a restricted subset of initial values. An early attempt to address local dynamics in an equation with bounded noise can be found in F ; general results for equations with fading, state independent noise may be found in ABR . In AKMR a complete description is given of these local dynamics (see also ABR and AMcR ). It was proved that the set of initial values can be partitioned into a “stability” region, within which solutions converge asymptotically to zero, an “instability” region, within which solutions rapidly grow without bound, and a region of unknown dynamics that is in some sense small. In the first two cases, the dynamic holds with probability at least for .
In the same article, it was shown that for any initial value , the behaviour of solution of the difference equation can be made consistent with the corresponding solution of the differential equation, with probability , by choosing the stepsize parameter sufficiently small. This observation motivates the approach taken in this article, wherein the stepsize parameter is allowed to decrease over a random interval in order to capture trajectories within the basin of attraction of the point at zero long enough to ensure asymptotic convergence.
Several recent publications are devoted to the use of adaptive timestepping in a explicit Euler-Maruyama discretization of nonlinear equations: for example AKR2010 ; KL2017 ; LM ; KRR . In KL2017 (see also Giles2017 ) it was shown that suitably designed adaptive timestepping strategies could be used to ensure strong convergence of order for a class of equations with non-globally Lipschitz drift, and globally Lipschitz diffusion. These strategies work by controlling the extent of the nonlinear drift response in discrete time and required that the timesteps depend on solution values. In KRR an extension of that idea allows an explicit Euler-Maruyama discretisation to reproduce dynamical properties of a class of nonlinear stochastic differential equations with a unique equilibrium solution and non-negative, non-globally Lipschitz drift and diffusion coefficients. The a.s. asymptotic stability and instability of the equilibrium at zero is closely reproduced, and positivity of solutions is preserved with arbitrarily high probability.
An element that these articles have in common is that the variable time-step depends upon the value of the solution. By contrast, in the present paper the sequence does not, and will be the same for any given initial value . However since the values of can become arbitrarily small, it is not necessarily the case that converges to zero: in fact if the stepsize sequence is summable we will show that the limit is necessarily nonzero a.s. So we freeze the sequence at an appropriate random moment , i.e. all step-sizes after are the same: for . The time at which this occurs depends on the initial value , and is chosen to ensure that converges to zero a.s., as required.
The structure of the article is as follows. Some necessary technical results are stated in Section 2. In Section 3 we construct a timestep sequence that ensures solutions of the unperturbed cubic difference equation converge to a finite limit, and show that the summability of determines whether or not that limit is zero. In Section 4 we examine the convergence of solutions under the influence of a deterministic perturbation, and in Section 5 we consider two kinds of stochastic perturbation; one with bounded noise, and one with Gaussian noise. Illustrative numerical examples are provided in Section 6.
2 Mathematical preliminaries
Everywhere in this paper, let be a complete probability space. A detailed discussion of probabilistic concepts and notation may be found, for example, in Shiryaev Shiryaev96 . We will use the following elementary inequality: for each and
(3) |
The following lemmas also present additional useful technical results:
Lemma 1
Let be a decreasing continuous function, then
Lemma 2
-
(i)
for ;
-
(ii)
For the following estimate holds
(4)
Lemma 3
Let for all . Then converges to non zero limit if and only if converges.
We adopt the convention if from here forwards. The next result can be found in (Shiryaev96, , Ch. 4.4, Ex. 1).
Lemma 4
Let be a sequence of independent distributed random variables. Then
(5) |
We will use the following notation throughout the article:
Definition 1
Denote, for ,
(6) |
Corollary 1
For all ,
(7) |
and
(8) |
Proof
3 The unperturbed deterministic cubic equation
Consider
(9) |
Everywhere in this paper we assume that is a non-increasing sequence of positive numbers. We derive an estimate on each and present a time-step sequence which provides convergence of the solution for any initial value .
3.1 Preliminary lemmata on solutions of Eq. (9)
Lemma 5
Let be a solution to equation (9). Assume that
there exists such that . | (10) |
Then,
-
(a)
the sequence is non-increasing and for each ;
-
(b)
the sequence converges to a finite limit.
Proof
(a) Since implies that we have
(11) |
Since is a non-increasing sequence, we have and
The remainder of the proof of (a) follows by induction. To prove (b) we note that the sequence is non-increasing and bounded below by , and therefore it converges to a finite limit.
Lemma 6
Let be a solution to equation (9). Assume that there exist such that
(12) |
Then there exists such that .
Proof
By Lemma 5, the sequence is non-increasing. Furthermore, Lemma 5 part (b) implies that, for some ,
(13) |
Proceed by contradiction and assume that for all . If either or , it follows that . So and . Since is not increasing and by (12) we have
So it is only possible that either
-
(i)
or
-
(ii)
.
For case (i), . Since , there exists and such that , for all , implying
(14) |
Passing to the limit of both sides of (14) as , we get . Since , case (i) leads to a contradiction.
For case (ii), we have
which implies that . Hence, case (ii) also leads to a contradiction. This completes the proof.
Lemma 7
Let be a solution to (9) with arbitrary initial condition . If
(15) |
then
-
(a)
terms of the sequence do not change sign;
-
(b)
the sequence converges to a finite limit.
Proof
Remark 1
Remark 2
In the case where for some , we have for all , ensuring that . In the case when for some , we have
which implies that . In this case but does not exist.
3.2 Timestep summability and the limit of solutions
In this section we show that if (15) holds, then solutions converge to a nonzero limit if the stepsize sequence is summable. If not, solutions converge asymptotically to zero.
Lemma 8
Proof
Since (15) holds for some , by Lemmata 5 and 7 we have, for all ,
(16) |
Then, for all ,
This implies
(17) |
By Lemma 5, part (a),
By Lemma 7, part (b), for some we have . Also, , since . So there exists such that for all . Without loss of generality we may therefore suppose that . Part (ii) of Lemma 2 applies, and so for all ,
(18) |
Let . By applying (18) to (17), and by (16), we have
Passing to the limit for in above inequality we get
Similarly, for , we have
In both cases , proving the statement of the Lemma.
3.3 Estimation of
In this section we establish a useful estimate for each when there exists such that
(21) |
Lemma 10
If (21) holds for some , then for all
(22) |
Proof
Lemma 11
Proof
Suppose that (15) fails to hold for any . Then , for all . For an arbitrary , we can apply Lemma 10, making the change of variables
to get
(24) |
Set
(25) |
Squaring both sides of (24) and multiplying throughout by , we obtain . Then
(26) |
Without loss of generality we can assume that , so and, continuing from (26),
(27) |
The expression in the square brackets is negative for any with sufficiently large if condition (23) holds. In this case for each we can find s.t.
Then which means that as well as . So condition (15) holds for . Obtained contradiction proves the result.
Lemma 12
Condition (23) holds if
-
(i)
;
-
(ii)
;
-
(iii)
;
-
(iv)
.
Proof
Case (i): we have . Case (ii): we have . Cases (iii) and (iv): we have etc. Note that the series
for defined by each of (i)-(iv). The lower limit of summation should be chosen according to in order to avoid zero denominators.
Remark 3
Applying Lemma 1 we conclude that for defined by each of (i)-(iv), the corresponding can be estimated as
-
(i)
;
-
(ii)
, so ;
-
(iii)
, so ;
-
(iv)
, so .
4 The perturbed deterministic cubic difference equation
Consider the perturbed difference equation
(28) |
where is a real-valued sequence. We begin by providing an estimate for solutions of (28) under condition (21).
Proof
4.1 Boundedness of for particular and
In this section we consider two special cases of and each of which guarantees the boundedness of the sequence . Both forms of were introduced in Lemma 12: the first corresponds to (ii)- (iv), the second corresponds to (i). Estimates of are chosen relative to the estimates for .
Case 1
Lemma 14
Proof
Substituting the values of from (33) and from (34) into (29) we get
Now we apply the inequalities from (7) and (8) and get
and
Applying all the above we arrive at
(35) |
So for each we can find such that, for ,
which implies . Assume now that is such that, for , we have
Then, for ,
(36) |
Without loss of generality we can assume that . We have
Also
so
(37) |
Based on that we get
Applying induction, assume that, for some ,
(38) |
and prove that relations in (38) hold for . In order to do so we first get the estimate of . For all , we have
Then, for ,
and
(39) |
Now,
proving the first part of (38) for each , and
proving the second part of (38) for each . This completes the proof of Part (i).
Case 2
Assume that, for some ,
(40) |
Lemma 15
4.2 Convergence of to a finite limit.
Lemma 16
Proof
When condition (40) holds it is possible that solutions of (28) converge to a nonzero limit. Example 1 below demonstrates that can be either zero or nonzero.
Example 1
We show that the limit of solutions of (28) can be positive, zero, or negative. For all three cases below, choose .
4.3 Modified process with a stopped timestep sequence
Based on Example 1 and Lemma 8 we cannot expect that, in general, the finite limit will be zero. In order to obtain a sequence that converges to zero we modify the timestep sequence further by stopping it (preventing terms from varying further) after steps:
(44) |
where is such that
(45) |
Note that under the conditions of Lemmas 14 and 15 we would have . Note that is not necessarily the first moment where (45) holds, and that (45) implies , but the converse does not necessarily hold.
Consider
(46) |
Lemma 17
Proof
Choose defined as in Lemmata 14 or 15 and set . To prove that
we follow the approach taken in the proofs of Lemma 14, Part (i), and Lemma 15, Part (i).
Let assume first that conditions (33)–(34) hold, so we use from Lemma 14. We have , , ,
and
This gives us
which, as above, leads to
Now we complete the proof by induction and arrive at
(47) |
which implies the boundedness of the sequence . Note that Lemma 16 also holds when, instead of we have a stopped sequence , since its proof uses only (47) and convergence of the series . So we conclude that . Passing to the limit in equation (46) we obtain the equality
which holds only for .
Remark 4
Convergence of the solutions of equation (46) with stopped time-step sequence may be slow, either if is very small, or if is large. Alternative strategies for stopping the sequence are as follows:
- (i)
- (ii)
Lemma 18
5 The stochastically perturbed cubic difference equation
In this section we consider a stochastic difference equation
(49) |
where is a sequence of independent identically distributed random variables. We discuss only two cases: and . Denoting
we can apply the results of Section 4 pathwise to solutions of (49) for almost all .
We also consider a stochastically perturbed equation with stopped timestep sequence
(50) |
where is defined by (44) with selected as equal to from Lemmas 14, 15 or as equal to from Remark 4. Note that since solutions of (49) are stochastic processes, and are a.s. finite -valued random variables, which we therefore denote by and , respectively.
5.1 Case 1: bounded noise ()
In this case, for all and all , we have
for all . So we may apply the results of Section 4 to each trajectory, arriving at
5.2 Case 2: unbounded noise ().
Theorem 5.2
6 Illustrative numerical examples
In this section we illustrate the asymptotic behaviour of solutions of the unperturbed equation (9) with summable and non-summable timestep sequences, as described in Lemmas 8 & 9, and the stochastically perturbed equation (49) with unbounded Gaussian noise as described in Theorem 5.2.
Figure 1, parts (a) and (b) provide three solutions of the unperturbed deterministic equation (9) corresponding to the initial values , with timestep sequence , so that . We observe that all three solutions appear to converge to different finite limits, as predicted by Lemma 8.
Parts (c) and (d) provide three solutions of (9) with the same initial values and with timestep sequence , so that . Note that we have selected values of that are sufficiently small for (15) to hold with this choice of , hence avoiding the possibility of blow-up. All three solutions appear to converge to a zero limit, as predicted by Lemma 9.
Figure 2, part (a) and (b) provide three solution trajectories of the stochastic equation (49) each corresponding to initial value given by with timestep sequence , satisfying (33) for , a sequence of i.i.d. random variables, and
(52) |
with satisfying (34) with . We observe that all three solutions approach different nonzero limits, as predicted by Theorem 5.2.
Parts (c) and (d) repeat the computation, but with the timestep sequence stopped so that its values become fixed when is satisfied for the first time. Solutions demonstrate behaviour consistent with asymptotic convergence to zero, also as predicted by Theorem 5.2.
Note that in Condition (34), but that in Figure 2 the effect of the stochastic perturbation decays too rapidly for differences between trajectories to be visible. Therefore in each part of Figure 3 we choose larger values of and generate fifteen trajectories of (49) with a sequence of i.i.d. random variables, timestep sequence stopped when is satisfied for the first time, , and each chosen to satisfy (52). Parts (a) and (b) show that, when , trajectories appear to converge to zero. However, Parts (c) and (d) show that, when and respectively, trajectories may converge to a random limit that is not necessarily zero a.s.
7 Acknowledgment
The third author is grateful to the organisers of the 23rd International Conference on Difference Equations and Applications, Timisoara, Romania, who supported her participation. Discussions at the conference were quite beneficial for this research.
References
- (1) J. A. D. Appleby, G. Berkolaiko and A. Rodkina, Non-exponential stability and decay rates in nonlinear stochastic difference equations with unbounded noise. Stochastics: An International Journal of Probability and Stochastic Processes, 81:2, (2009), 99–127.
- (2) J. A. D. Appleby, G. Berkolaiko and A. Rodkina, On Local Stability for a Nonlinear Difference Equation with a Non-Hyperbolic Equilibrium and Fading Stochastic Perturbations. Journal of Difference Equations and Applications, 14:9, 2008, 923–951.
- (3) Appleby, J. A. D., Kelly, C and Rodkina, A., On the Use of Adaptive Meshes to Counter Overshoot in Solutions of Discretised Nonlinear Stochastic Differential Equations, International Journal of Difference Equations, 5:2 (2010), pp. 129–148.
- (4) J. A. D. Appleby, C. Kelly, X. Mao, and A. Rodkina, On the local dynamics of polynomial difference equations with fading stochastic perturbations, Dyn. Contin. Discrete Impuls. Syst. Ser. A Math. Anal. 17:3, (2010), 401-430.
- (5) . A. D. Appleby, D. MacKey and A. Rodkina, Almost sure polynomial asymptotic stability of stochastic difference equations. Contemporary Mathematics. Fundamental Research. 17 (2006). 110–128.
- (6) T. Chan and D. Williams, An “excursion” approach to an annealing problem, Math. Proc. Camb. Philos. Soc. 105 (1989), pp. 169-176.
- (7) W. Fang and M. Giles. Adaptive Euler-Maruyama method for SDEs with non-globally Lipschitz drift: Part I, finite time interval. arXiv:1609.08101, September 2016.
- (8) S. Fraser, E. Celarier, and R. Kapral, Stochastic dynamics of the cubic map: a study of noise-induced transition phenomena, J. Stat. Phys., 33 (1983), 341–370.
- (9) Kelly, C, Lord, G., Adaptive timestepping strategies for nonlinear stochastic systems. IMA Journal of Numerical Analysis (2017), doi.org/10.1093/imanum/drx036
- (10) C. Kelly and A. Rodkina, Constrained stability and instability of polynomial difference equations with state-dependent noise, Discrete Contin. Dyn. Syst. A, 11:4 (2009), 1–21.
- (11) C. Kelly, A. Rodkina, E. Rapoo, Adaptive timestepping for pathwise stability and positivity of strongly discretised nonlinear stochastic differential equations, Journal of Computational and Applied Mathematics (2017), doi.org/10.1016/j.cam.2017.11.027.
- (12) Liu, W. and Mao, X., Almost sure stability of the Euler-Maruyama method with random variable stepsize for stochastic differential equations. Numer. Algorithms 74:2 (2017), 573–592.
- (13) Rodkina, A. On Nonoscillatory Regime for Stochastic Cubic Difference Equations with Fading Noise. In Proceedings of the 14th International Conference on Difference Equations and Applications. Istanbul. Turkey, ISBN 978-875-6437-80-3, (2009), 283-290.
- (14) A. N. Shiryaev, Probability (2nd edition), Springer, Berlin, 1996.