On the number of departures from the queue in a finite time interval
Abstract.
In this paper, we analyze the number of departures from an initially empty system in a finite time interval. We observe the system during an exponentially distributed period of time starting from the time origin. We then consider the absorbed Markov chain describing the number of arrivals and departures in the system until the observer leaves the system, triggering the absorption of the Markov chain. The generator of the absorbed Markov chain induces a selfadjoint operator in some Hilbert space. The use of spectral theory then allows us to compute the Laplace transform of several transient characteristics of the system (namely, the number of transitions of the Markov chain until absorption, the number of departures from the system, etc.). The analysis is extended to the finite capacity system for some finite integer .
Key words and phrases:
Sojourn time; Processor Sharing, etc.Key words and phrases:
system, transient characteristics, selfadjoint operators, continued fractions, Laplace transforms1. Introduction
The model is a fundamental queuing system, which has applications in many different domains such as computer science (see for instance [18] for the performance of hashing with lazy deletion), telecommunications networks (notably for modeling open loop statistical multiplexing of bulk data transfers [13]), etc. A key characteristic of the model is that the time evolution of the number of customers in the system can be described by a birth and death process, which can be analyzed by means of spectral theory [19]. Specifically, the generator of this Markov process is a tridiagonal matrix inducing a selfadjoint operator in an ad-hoc Hilbert space.
The analysis of the via spectral theory dates back to the 1950s in the seminal papers by Karlin and McGregor, see [16] for the system and some related models as well as [15] for the analysis of birth and death processes, notably giving an expression for transition probabilities by means of the associated orthogonal polynomial system and the spectral measure. The connection between birth and death processes and continued fractions has been investigated in many papers. Let us just mention that in [7], special attention is paid to the connection between birth and death processes and lattice path combinatorics; this connection in turn yields results on transient characteristics of birth and death processes (and the system in particular) by exploiting and generalizing results obtained by Flajolet in [6].
The system is described in standard textbooks on queuing theory [8, 17, 20]. Considering an system with arrival rate and mean service time equal to unity, it is known that the probability mass function of the number of customers in the system in the stationary regime is Poisson with mean . Specifically, if denotes the number of customers in the system in the stationary regime, then
In addition, if the system is initially empty, the number of customers in the system at time is [8]
(1) |
which is a Poisson law with mean . This result was established in [16] by solving the Markov forward equations by means of spectral theory. The spectral measure is Poisson with mean and the generator of the Markov process describing the number of customers in the system over time has eigenvectors, which can be expressed by means of Charlier polynomials [3] forming the polynomial orthogonal system associated with the model.
The duration of an excursion as well as the area of an excursion above a given threshold of the occupation process of an system have been studied in [10, 11]. The analysis reveals the key role played by associated Charlier polynomials, which satisfy the same recurrence relation as Charlier polynomials but starting from a certain index (namely the excursion threshold). The relationships between orthogonal polynomial systems and their associated orthogonality measure, spectral theory, continued fractions, etc. are clearly explained in [2, 5]. In this paper, we shall use these reference books for studying the number of departure from the system in a finite time interval.
While many transient characteristics of an system are perfectly known in the queuing literature, the number of departures from the system in a given time interval is more rarely considered in the technical literature. In this paper, we consider this random variable for an initially empty system. This latter assumption is motivated by the fact that if there are customers in the system at time , then the number of departures from the system at time among these customers is simply a Bernoulli random variable with mean , that is, for
The most challenging issue is to compute the number of departures when starting from an empty system as it involves the transient behavior of the system. (It is also worth noting that the random variables and are independent.)
Generally speaking, when we consider an initially empty queue with distribution for the service time (i.e., ) and with arrival rate , the number of departures from the queue at time is given by
(2) |
where
(3) |
showing that the random variable is Poisson with mean . As a matter of fact, since the arrival process is Poisson with intensity , the number of arrivals in the time interval is such that
In addition, because the arrival process is Poisson, each customer arrives at a uniformly distributed random time between 0 and . Assuming that a customer arrives at time , this customer leaves the system before time if its service time is less than , with probability . Hence, the probability that an arbitrary arriving customer leaves the system before is given by . Since there are no interactions between customers and conditioning on the number of arriving customers , the number of customers which arrive in and leave the system before is Bernoulli with mean . By deconditioning on , Equation (2) easily follows. In the specific case of the queue with unit mean service time, we have
and then the probability mass function of the number of departures in is given by
(4) |
the random variable is hence Poisson with mean .
In this paper, we show how this result can be recovered by using the spectral properties of the system. For this purpose, we adopt the same approach as in [12]. We introduce an observer, which observes the system for an exponentially distributed duration of time with mean and we study the Markov chain describing the number of customers in the system until the observer leaves the system. This leads us to study a discrete-time Markov chain, which describes the number of arrivals and departures in the system and which is absorbed when the observer leaves. This allows us to derive the Laplace transforms of several transient characteristics, in particular that of for some integer .
This paper is organized as follows: In Section 2, we describe the model and introduce the absorbed Markov chain of interest. In Section 3, we study the spectral properties of the transition matrix of the absorbed Markov chain. The Laplace transforms of the probability mass functions of the transient characteristics are derived in Section 4. We apply the same analysis framework to the finite capacity system in Section 5. Some concluding remarks are presented in Section 6.
2. Model description and preliminary results
2.1. Notation
We consider an queue with arrival rate and unit service rate; the system is empty at time . We denote by the number of customers in the queue at time . We further introduce an observer, which observes the queue during an exponentially distributed period of time with mean for some .
We consider the system composed of the queue and the observer and we introduce the discrete-time process describing the number of customers in the queue (the observer is not included); is the number of customers in the queue at the th event corresponding either to a customer arrival, or a service completion or the departure of the observer from the system. When the observer leaves the system, the process is absorbed in some state, denoted by . The index is thus the number of departures or arrivals before the observer leaves the system or equivalently before the process gets absorbed. Because the queue is supposed to be initially empty, we have .
The state space of the discrete-time Markov chain is with transition matrix given by
The non-zero coefficients of the matrix are given by (the state being absorbing) and for
The sub-matrix of obtained by deleting the first row and the first column of matrix is a tridiagonal matrix with coefficients for . (We keep the indices ranging from 0 to infinity instead from 1; this is motivated by recurrence relations appearing in the following.). The only ones which are non-zero are given for by
with the convention . This matrix is sub-stochastic, and gives the transition probabilities of the Markov chain before absorption.
2.2. Preliminary results
Let be the column vector with all entries equal to 0 except the th one equal to 1. Then, for , we have
where is the row vector equal to the transpose of the column vector . The probability that the observer leaves the system at stage while there are customers, is equal to
Let denote the number of customers in the queue when the observer leaves the system and be the time at which the observer leaves the system. We have for and
(5) |
The marginal distributions are given by for
(6) |
where is the identity matrix with zero coefficients except the diagonal ones equal to 1, and for
Let and respectively denote the number of arrivals and departures in the queue, while the observer is in the system. We have the following conservation equations:
(7) |
so that
(8) |
The variable describes the number of arrivals at the queue during an exponential duration with mean . It is clear that
(9) |
since the number of arrivals in a time interval of length has a Poisson probability mass function with mean , i.e.,
Note that
(10) |
The random variable is the number of customers in the queue when the observer leaves the system and we have
(11) |
where is the number of customers in the queue at time .
In the following, we shall give a representation of by means of Charlier polynomials [3]. It is worth noting that since (from Equation (1)), we have
(12) |
While the random variables and as well as and are known, their correlation structure (namely, their joint probability mass functions) is less investigated in the literature. For the random variables and , we shall use the fact that
(13) |
It is also worth noting that by using Equations (7), (10) and (12)
(14) |
and then
(15) |
To compute the probability mass function of the random variable , we use the orthogonality structure associated with the queue, already known to Karlin and McGregor [16]. In particular, the resolvent of the infinite matrix as well as the powers of matrix play a central role in the computations of the probability mass functions of random variables and .
3. Spectral properties of matrix
To compute the resolvent , we prove that the infinite matrix induces an operator, which is self-adjoint in an appropriate Hilbert space. We then determine the spectrum of this operator and use the spectral identity [19]. To determine the spectrum of the operator , we use for the Charlier polynomials satisfying the following recursion: , and for
(16) |
It is worth noting that they satisfy the following symmetry relation: for integers and
(17) |
Note that for instance and .
We define the Charlier polynomials of the second kind , by the same recursion (16) but with the initial conditions: and . Note that . It is known in the technical literature [2] that
(18) |
where is the Kummer function [1] defined by
where the Pochammer symbol , and with integral representation
for , denoting the Eurler’s Gamma function.
The polynomials and are the successive denominators and numerators of the continued fraction [2]
The Charlier polynomials are orthogonal with respect to the Poisson measure on with mean , that is, the discrete measure with atoms at points and with mass
at point . By using [14, Theorem 12.11b] on Stieltjes fractions, we have the relation
(19) |
Finally, the exponential generating function of the Charlier polynomials is given by
(20) |
3.1. Self-adjointness properties
By considering the Hilbert space
where
(21) |
we show that the matrix defines a selfadjoint operator when the Hilbert space is equipped with the scalar product
and the norm
The Hilbert space is introduced because the parameters satisfy the reversibility property with the coefficients of the matrix
(22) |
making the matrix symmetric.
The infinite matrix induces in an operator that we also denote by . By using the same arguments as in [9], we can easily prove the following lemma, where we use the norm of the operator defined by
by definition, the operator is bounded if .
Lemma 1.
The operator is symmetric and bounded in , hence self-adjoint.
Proof.
The symmetry of is straightforward by using Equation (22).
For , we have
By Schwarz inequality
We clearly have
Moreover,
Hence,
This implies that . ∎
3.2. Spectrum
The spectrum of the operator is defined by
Since , we know that . The spectrum is the support of the spectral measure of the operator .
Proposition 1.
The spectral measure of the operator is purely discrete with atoms at points defined for by
(23) |
the mass at point is
(24) |
Proof.
Let us consider some vector , a priori not necessarily in , such that for some real number . By setting without loss of generality and , we have for
(25) |
This recurrence formula defines an orthogonal polynomial system (OPS), which has been studied by Karlin and McGregor in [16] for . The orthogonality is checked by using Favard condition [2]. Indeed, the above polynomials satisfy a recurrence relation of the type
with
for so that Favard condition for is satisfied.
It is easily checked by using Equation (16) that the polynomials are related to Charlier polynomials as follows: for ,
(26) |
To determine the orthogonality measure of the polynomials , which also defines the spectrum and the spectral measure of the operator , we follow the general method given in [2, 5].
The polynomials are the successive denominators of the continued fraction
This continued fraction is introduced because the domain where this function is not defined is precisely the support of the spectral/orthogonality measure, which is then determined by using Perron-Stieltjes inversion formula (see [2] for details).
To obtain an explicit expression for the continued fraction , we introduce the polynomials of the second kind associated with the polynomials and satisfying the same recurrence relation (25) but with the initial conditions and . It is easily checked that these polynomials are related to the Charlier polynomials of the second kind as
(For polynomials of the second kind, indices usually start from 0 and not -1.)
By using Equation (18), we have
It is obvious that is a removable singularity and . The actual poles are the points
for . The rational fraction
has a pole at point for . For , we have
The residue at pole of the function
is . It follows that the residue of the function at pole is
We deduce that the orthogonality measure associated with the polynomials , which is also the spectral measure of the operator , is purely discrete with atoms at points for and with mass at . The vectors , are eigenvectors of the operator . ∎
From the above proposition, the spectral measure is given by
(27) |
where is the Dirac mass at point . The polynomials satisfy the orthogonality relations [2]
(28) |
where is defined by Equation (21). The continued fraction is such that
and by using the arguments in [2] it is possible to obtain the following relation for not in the support of the measure :
(29) |
Finally, it is worth noting that the exponential generating function of the polynomials is given by
(30) |
where we have used the definition of given by Equation (20).
4. Transient characteristics of the queue
In this section, we use the spectral properties of the operator to compute the probability mass functions of the transient characteristics , , and . In a first step, we consider the random variable , which is related to the number of customers in the queue at time .
Proposition 2.
Under the assumption that the system is empty at the time origin, the probability mass function of the random variable equal to the number of customers in the system upon departure of the observer is given by
(31) |
which can be rewritten as
(32) |
where is the Poisson measure on with mean .
Proof.
Corollary 1 ([16]).
Under the assumption that the system is empty at the time origin, the probability mass function of the random variable equal to the number of customers in the system at time is given by Equation (1).
Proof.
We now consider the random variable , whose probability generating function seems to be unknown in the technical literature.
Proposition 3.
The generating function of the random variable , which is the number of arrivals or departures in an initially empty system during an exponential period of time with mean , is given by
(33) |
Proof.
Let be the number of arrivals and departures in the system up to time . By definition, we have
We then have the following result.
Corollary 2.
The generating function of the number of arrivals and departures in the system up to time is given by
(34) |
It is easily checked that the first moment of is given by
and the second moment by
By taking Laplace transforms, we obtain
(35) |
and
For the distribution of , we use the same technique and we obtain the following result.
Proposition 4.
The generating function of the random variable , equal to the number of departures from the initially empty system in an exponentially distributed time frame with mean , is given by
(36) | |||||
(37) |
Proof.
It is worth noting that taking in Equation (36) reads
which is precisely Euler’s formula [4]
for and .
As a consequence of Proposition (4), we can state the following result.
Proposition 5.
The random variable is Poisson with mean .
Proof.
By using the integral representation of Kummer function [1], we have
and via the variable change , we have
and then since
we have by Laplace inversion
which is the generating function of Poisson random variable with mean . ∎
We thus have proved that we can recover the result for the random variable obtained by probabilistic arguments via spectral theory. Note that the generating function of seems to be unknown in the queuing literature. In the next section, we investigate how the results apply for an queue where is some positive integer.
5. Transient characteristics of the queue
In the case of an queue, we consider as in the previous sections an observer joining an initially empty queue and staying in the system for an exponentially distributed random time with mean with .
5.1. Notation
Let us introduce the discrete-time process describing the number of customers in the queue without taking into account the observer; is the number of customers in the queue at the th event corresponding either to a customer arrival, or a service completion or the departure of the observer from the system. When the observer leaves the system, the process is absorbed at state .
The state space of the discrete-time Markov chain is with transition matrix given by
The non-zero coefficients of the matrix are given by (the state being absorbing) and for
along with
The sub-matrix obtained by deleting the first row and the first column of matrix is a tridiagonal matrix with non-zero coefficients given for
together with
with the convention . (We let the indices of the coefficients of matrix range from 0 to as it is more convenient for recurrence relations appearing in the analysis.) The matrix is sub-stochastic and describes the transition probabilities of the Markov chain before absorption.
5.2. Spectral properties
Let be the vector space such that the components of a vector are zero for indices larger than . The matrix is not selfadjoint but can nevertheless be diagonalized. An eigenvalue of is such that there exists a vector satisfying the recursion
for (with the convention ) and
(38) |
Without loss of generality, we can set and then satisfies the same recursion as for . The limiting condition (38) implies the point is an eigenvalue only if
For , the moment functional associated with the measure is positive-definite on the set of atoms since the mass at each atom is positive. From the theory of orthogonal polynomials [5, Theorem 5.2], the zeros of , are real, simple and located in the interior of . In addtion, the roots of and are interleaved. We then easily deduce via geometric arguments that the equation has real and simple solutions, denoted by for .
Let for denote the column vector whose th entry is equal to for . The vectors for form an orthogonal basis of the space . Moreover, let for denote the column vector whose th entry is equal to for .
By using the orthogonality of the vectors for , we have on the one hand
On the other hand, we have for any constant and fixed not in the set of the roots
where (resp. ) is the vector with entries (resp. ) for . By choosing
we have
We then deduce that
and hence,
Let us introduce the discrete measure , which has an atom at point with mass for . We have
By computing , we obtain
(39) |
To conclude this section, let us consider the matrix defined by
The matrix is the infinitesimal generator of the Markov process describing the number of customers in the system. This matrix induces a selfadjoint operator in the Hilbert space defined by
(see [16] for details) and can be diagonalized by using the same technique as above. The eigenvalues satisfy the equation
which has non-positive solutions, denoted by for . Note that 0 is an eigenvalue associated with eigenvector with all components equal to 1. Introducing the measure with atoms at point with mass
for , we have
Finally, we have the relation for
(40) |
5.3. Transient characteristics
As in Section 4, we consider the number of customers in the system when the observer leaves the system.
Proposition 6.
The probability mass function of the random variable is given by
(41) |
Proof.
By Laplace inversion, we have by letting denote the number of customers in the queue at time
which is the Karlin-McGregor result for the birth and death issued from state 0 (see [15] for details).
For the variable equal to the number of customers entering the system or leaving the system, we have the following result.
Proposition 7.
The generating function of the random variable is given by
(42) |
where
(43) |
Proof.
By using Equation (42), the generating function of the random variable counting the number of customers entering or leaving the queue is given by
Finally, let be the number of the departures from the queue before the observer leaves the system. The generating function of this random variable is given by the following result.
Proposition 8.
6. Conclusion
We have analyzed in this paper some transient characteristics of an initially empty system over a finite time interval via spectral theory, notably the number of departures from the queue. The probability mass function of these random variables can be obtained by using probabilistic arguments. Nevertheless, the use of spectral theory is more systematic in the sense that the same framework can be applied to other models, which may be not amenable via probabilistic analysis. We have illustrated this point by considering the finite capacity system. Other models such as the analyzed in [16] can be analyzed via spectral theory.
References
- [1] M. Abramowitz and I. Stegun. Handbook of Mathematical Functions. Dover Publications, 1965.
- [2] R. Askey and M. Ismail. Recurrence relations, continued fractions and orthogonal polynomials, volume 49 No 300. Memoirs of the American Mathematical Society, 1984.
- [3] Harry Bateman and Arthur Erdélyi. Higher transcendental functions. California Institute of technology. Bateman Manuscript project. McGraw-Hill, New York, NY, 1955.
- [4] C.E. Billigheimer, G. Polya, and G. Szegö. Problems and Theorems in Analysis II: Theory of Functions. Zeros. Polynomials. Determinants. Number Theory. Geometry. Classics in Mathematics. Springer Berlin Heidelberg, 1997.
- [5] T.S. Chihara. An Introduction to Orthogonal Polynomials. Dover Books on Mathematics. Dover Publications, 2011.
- [6] P. Flajolet. Combinatorial aspects of continued fractions. Discrete Mathematics, 32(2):125–161, 1980.
- [7] Philippe Flajolet and Fabrice Guillemin. The formal theory of birth-and-death processes, lattice path combinatorics and continued fractions. Advances in Applied Probability, 32(3):750–778, 2000.
- [8] Donald Gross and Carl M. Harris. Fundamentals of Queueing Theory (2nd Ed.). John Wiley & Sons, Inc., New York, NY, USA, 1985.
- [9] F. Guillemin and J. Boyer. Analysis of the M/M/1 queue with processor sharing via spectral analysis. Queueing Systems, 39:377 – 397, 2001.
- [10] Fabrice Guillemin and Didier Pinchon. Continued Fraction Analysis of the Duration of an Excursion in an System. Journal of Applied Probability, 35(1):165–183, 1998.
- [11] Fabrice Guillemin and Didier Pinchon. On a random variable associated with excursions in an System. Queueing Systems, 32(4), 1999.
- [12] Fabrice Guillemin and Veronica Quintuna Rodriguez. On the sojourn of an arbitrary customer in an processor sharing queue. Stochastic Models, 36(3):378–400, 2020.
- [13] Fabrice Guillemin and Alain Simonian. Transient characteristics of an system. Advances in Applied Probability, 27(3):862–888, 1995.
- [14] P. Henrici. Applied and computational complex analysis, volume II. John Wiley and Sons, 1991.
- [15] S. Karlin and J. Mc Gregor. The differential equation of birth and death processes, and the Stieltjes moment problem. Advances in Applied Probability, 85:489–546, 1957.
- [16] Samuel Karlin and James McGregor. Many server queueing processes with poisson input and exponential service times. Pacific J. Math., 8(1):87–118, 1958.
- [17] L. Kleinrock. Queueing Systems, volume 1. Wiley, New York, 1976.
- [18] John A. Morrison, Larry A. Shepp, and Christopher J. Van Wyk. A queueing analysis of hashing with lazy deletion. SIAM Journal on Computing, 16(6):1155–1164, 1987.
- [19] M. Reed and B. Simon. Methods of modern physics: Fourier analysis, selfadjointness, volume II. Elsevier (Singapore), 2003.
- [20] Sheldon M. Ross. Introduction to Probability Models. Academic Press, San Diego, CA, USA, sixth edition, 1997.