The Single Server Queue and the Storage Model: Large Deviations and Fixed Points
Moez DRAIEF Statistical Laboratory, Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB3 0WB UK Tel: +44 1223337945 E-mail: M.Draief@cam.ac.uk
Abstract
We consider the coupling of a single server queue and a storage model defined as a Queue/Store model in [6, 7] . We establish that if the input variables both arrivals to the queue and to the store satisfy large deviations principles and are linked through an exponential tilting than the output variables (departures from each system) satisfy large deviations principles with the same rate function. This generalizes to the context of large deviations the extension of Burke's Theorem derived in [6, 7] .
Résumé
Nous établissons un résultat de point fixe dans le cadre des grandes déviations pour le modèle File d'attente/Modèle de Stockage introduit dans [6, 7] . Plus précisément si les variables d'entrée du système vérifient des principes de grandes déviations avec des fonctions de taux liées par une relation d'inclinaison exponentielle alors il en est de même pour les variables de sortie dont les fonctions de taux sont les mêmes que celles des variables d'entrée.
Keywords: Single server queue, storage model, large deviations, Burke's theorem.
1 Introduction
A celebrated theorem of Burke's [1] asserts that when a Poisson process
with mean inter-arrival time
is input to a single server queue whose service times
are i.i.d. exponentials (./M/1/
following the Kendall nomenclature) with mean
, the equilibrium departure process
from the queue is also a mean
Poisson process.
In this sense the mean
Poisson process is a fixed point for the ./M/1/
operator. In [6, 7] , we generalized to the couple of departures and the sequence of times spent at the very back of the queue
, that can also be seen as the sequence departures from a storage model, where
is the amount of
Supplied at slot
, and
is the amount of
Asked for at the same slot. More precisely, we show that under the conditions of Burke's theorem the couple of output variables from the Queue/Store model
has the same law as the couple of input variables
.
In this paper, we consider the fixed point question at large deviations scaling. A similar result have been presented by Ganesh et al. in [11] for discrete-time queues. Assuming that the input variables satisfy a large deviation principle, we show that if their laws are linked through an exponential tilting that than the large deviation principle is preserved by the Queue/Store system, i.e. the output variables satisfy large deviations principles with the same rate functions as the input variables.
The paper is organized as follows: section 2 is devoted to giving some background on large deviations that will be useful for our analysis. The Queue/Store model is presented in section 3 . Section 4 focuses on the workload process. We define the concept of effective bandwidth in section 5 . At last, in section 6 , we derive a large deviations principle for the output variables of the Queue/Store model (§ 6.1 ) and we give the condition on the rate functions of the input variables (§ 6.2 ) which are preserved by the Queue/Store operator.
2 Large deviations
We are not going to give a survey on large deviations, we are just aiming to make the work self contained, for more details on large deviations we refer to Dembo and Zeitouni's reference book [5] .
Let
be a sequence of i.i.d. random variables and define
by
If
, than
satisfies the strong law of large numbers, i.e.,
We also focus on the fluctuation of a random variable around its mean. Suppose
then the central limit theorem gives the fluctuations of the scale of
, of
around
. More precisely the sequence
converges in law to the normal law with mean zero and variance the one of
. Large deviations theory deals with the fluctuations of the scale of
.
Definition 2.1.
Let
be a Hausdorff space. A function
is a rate function if
is lower semi-continuous, i.e. the sets
are closed, for all
. In addition, if these sets are compact than
is a good rate function.
Definition 2.2.
A sequence
in
satisfies a large deviations principle with the rate function
, if for all Borel set
of
,
| |
| |
where
denotes the interior of
and
its closure.
Throughout the rest of this section, we are interested in real-valued random variables.
Definition 2.3.
The cumulant generating function of a real-valued random variable
is given by
which can be infinite.
Using Hölder inequality and Fatou lemma we check that
is convex, lower semi-continuous and for all
in the effective domain of
(i.e.
), we have
Definition 2.4.
The Legendre transform of
is defined by
|
(1)
|
The function
is positive, convex, and lower semi-continuous. If
is finite at the origin then
Moreover, we check easily that
| |
|
(2)
|
We recall the statement of Cramér theorem for real-valued random variables.
Theorem 2.5.
Let
be an i.i.d. sequence of real-valued random variables and let
be its cumulant generating function which we suppose finite at the origin, then the sequence of random variables
, where
, satisfies a large deviations principle with rate function
defined in ( 1 ):
for all closet set
of
,
|
(3)
|
and for all open set
of
|
(4)
|
The inequalities ( 3 ) and ( 4 ) are known as the upper bound and the lower bound of the large deviations principle. For the different extensions of Cramér theorem we refer to [5] . We can have a large deviations principle for a couple of independent random variables.
Theorem 2.6.
Let
and
be two sequences in
and
two Hausdorff spaces satisfying large deviations principles on
and
, with rate functions
and
. Suppose that they are independent, then the sequence
satisfies a large deviations principle on
with rate function
In this paper, we will establish large deviations principles relying on indirect methods. Once we have a large deviations principle for one sequence of random variables, we can effortlessly obtain large deviations principles for a whole class of random sequences, namely those obtained via continuous transformations. We present the contraction principle, the tool that enables this.
Theorem 2.7.
If
satisfies a large deviations principle on
with rate function
, and if
is a continuous function. Then the sequence
defined by
satisfies a large deviations principle on
with rate function
Sometimes
is ”almost continuous”, i.e. the sequence
is close to a sequence
, where
is continuous.
Definition-Proposition 2.8.
Let
and
be two sequences of
with metric
. They are said exponentially equivalent, if for all
,
In this case, if
satisfies a large deviation principle then
satisfies a large deviations principle, and
.
Theorem 2.9.
If
satisfies a large deviations principle on
with rate function
, and if
and
are exponentially equivalent, with
continuous, then
satisfies a large deviations principle on
with rate function
3 The Model
Let
be a point process and assume that
and
. We define the
-valued sequence of r.v's
by
. Let
be another
-valued sequence of r.v's. The sequences
and
are the input variables of the model.
Define the sequence of r.v.'s
by
|
(5)
|
A priori the
's are valued in
. Assume from now on that
and
are such that the
's are almost surely finite. Set
and
. Define an additional sequence of r.v.'s
, valued in
, by
|
(6)
|
The sequences
and
are the output variables of the model. In view of the future analysis, it is convenient to define the following auxiliary variables. Let
be the sequence of r.v.'s valued in
and defined by
|
(7)
|
These r.v.'s satisfy the recursive equations:
|
(8)
|
Using the variables
, we can give alternative definitions of
and
:
|
(9)
|
|
(10)
|
We now interpret the variables defined above in two different contexts: a queueing model and a storage model.
3.1 The single-server queue
A bi-infinite string of customers is served at a queueing facility with a single server. Each customer is characterized by an instant of arrival in the queue and a service demand. Customers are served upon arrival in the queue and in their order of arrival. Since there is a single server, a customer may have to wait in a buffer before the beginning of its service. Using Kendall's nomenclature, our model is a
FIFO queue. The customers are numbered by
according to their order of arrival in the queue (customer 1 being the first one to arrive strictly after instant 0). Let
be the instant of Arrival of customer
and
its Service time.
Then the variables defined in ( 5 )-( 8 ) have the following interpretations:
-
∙
is the instant of departure of customer
from the queue, after completion of its service;
is the sequence of inter-departure times;
-
∙
is the waiting time of customer
in the buffer between its arrival and the beginning of its service;
-
∙
is the time spent by customer
at the very back of the queue.
The variables
are less classical in queueing theory although they have already been considered by Gallager and Prabhakar [9] . They should be viewed as being dual to the services
.
3.2 The storage model
Some product
is supplied, sold and stocked in a store in the following way. Events occur at integer-valued epochs, called slots. At each slot, an amount of
is supplied and an amount of
is asked for by potential buyers. The rule is to meet all the demand, if possible. The demand of a given slot which is not met is lost. The supply of a given slot which is not sold is not lost and is stocked for future consideration.
Let
be the amount of
Supplied at slot
, and let
be the amount of
Asked for at the same slot. The variables in ( 5 )-( 8 ) can be interpreted in this context:
-
∙
is the level of the stock at the end of slot
. It evolves according to ( 8 );
-
∙
is the demand met at slot
, see equation ( 10 ); it is the amount of
departing at slot
;
The variables
do not have a natural interpretation in this model.
It is important to remark that while the equations driving the single server queue and the storage model are exactly the same, it is not the same variables that make sense in the two models. The important variables are the ones corresponding to the departures from the system.
The departures are coded in the variables
for the single server queue and in the variables
for the storage model. For a more evolved discussion on these two models we refer to [7] .
3.3 Rare events
We recall that
the waiting time of customer
before it starts its service (respectively the level of the stock at the end of slot
) is given by
|
(11)
|
We assume that the sequences
and
are stationary and ergodic. Under the stability condition
, we can use the above expression of
to give its asymptotic behaviour using the large deviations properties of the input variables
and
. We start with an example.
Example
Suppose that the customers arrive in a deterministic fashion, i.e.
, and that the sequence
is i.i.d. with
The process
is a discrete time Birth-and-Death with stationary distribution
We get
where
.
This approximation remains true under general conditions on the input variables, with an expression of
that depends on the rate functions associated to the sequences
and
. Indeed it has been proved [2, 8, 13] that the stationary version of
satisfies the following property
|
(12)
|
We will rewrite ( 12 ) in the following way
First we give a heuristic prove of this result which will be proved rigorously in section 4 . We assume the sequences
and
i.i.d. mutually independent with
finite near the origin. Let
for all
, and
for all
then
, with
. Using Cramér theorem (Theorem 2.5 ), the sequences
and
satisfy large deviations principles on
with rate function
and
the Legendre transforms of
and
. Thus the sequence
satisfies a large deviations principle with rate function
, which is the Legendre transform of
, i.e.
. Moreover,
| |
| |
Since
, we check that
|
(13)
|
We conclude using the principle of the largest term, i.e.
where
and we get ( 12 ). The principle of the largest term translates the fact that rare events occurs in the most likely way. Indeed the dominant term in ( 13 ) which gives the explosion of the waiting times in the queueing system or the overflow of the stock in the storage model happen following the most probable scenario.
4 Large deviations for the workload process
First, we give the assumptions under which the approximation ( 12 ) is fulfilled. For more general assumptions we refer to the paper by Ganesh et al. [12] .
Assumptions:
-
The sequences
and
are i.i.d., mutually independent. Their cumulant generating functions given by
differentiable near the origin.
-
The stability condition
is satisfied.
Under
and
, we have
Proposition 4.1.
The sequence
satisfies a large deviations principle with good rate function
, i.e.
, with
|
(14)
|
-
Proof.
First we prove ( 14 ). Recall that
,
, and
By the independence assumption we have
Applying the contraction principle we check that
Let
then
| |
| |
| |
The last equivalence is due to
(stability condition) et and the equation ( 2 ). We proved that
Lower bound: For
, we have
. Notice that for
,
, we have
Since
, we get
| |
| |
for all
. Then we conclude that
| |
| |
Upper bound: Recall that
. By the stability condition, we have
Moreover,
is differentiable near
with
. Thus there is a constant
such that
and
. Applying Chernoff 's bound, we
, we get
This leads to
For
, we check that
Letting
goes to infinity,
Then
Since
, there is
et
such that
Then
To summarize the above proof, we have
Therefore, for
such
, we have
We conclude using ( 14 ).
This result can be interpreted naively in terms of the following approximation
This is nothing more then a consequence of the fact that rare events occur in the most likely way. Moreover using this approximation one can predict the frequency at which the waiting time (or the level of stock) overflows a given threshold. Indeed if ( 12 ) is fulfilled, then we represent the graph (in logarithmic squale) of the frequency of exceeding a level
. The above approximation (Proposition 4.1 ) inspired numerous applications (described by Courcoubetis et al. [3] ) of large deviations to the analysis of the statistics of networks of queues.
5 Effective bandwidth
The bandwidth of a traffic flow has become a classical feature in communication networks literature. We are interested in the notion of effective bandwidth introduced by Kelly in [15] , which gives an analytical way of describing the properties of a stochastic flow by means of rare events occurring in the network it passes through.
In practice the queues and stores we are interested in have finite capacities, i.e. the queue (respectively the store) rejects customers (respectively stock) each time the waiting time (respectively the amont of stock) overpasses a given threshold. In the queueing context, we assume
given and we seek the (deterministic) minimal value
of inter-arrival times such that the probability of the waiting times exceeding the threshold is less than
fixed. For the storage model, we assume
given and we seek the maximal value
of product arriving at the store at each slot of time such that the store rejects it with a probability less then
. More precisely, we want to identify the arrivals to both models such that
for
and
given.
Queue
Let
, i.e.
. If
is i.i.d., then by Proposition 4.1 ,
with
The minimal inter-arrival time for the inequality ( 15 ) to be fulfilled is given by
such that
Let
. Then
and
We will call the effective bandwidth for the queue. For more details we refer to Kelly's review [14] .
Store
Let
. Then,
and
To have ( 15 ) satisfied, we should allow not more than
amount of stock to arrive to the store at each slot with
The quantity
is the effective bandwidth of the store, with
We generalize this notion to non deterministic arrivals by introducing the functions
and
given by
representing the effective bandwidths of the queue and the store.
6 Principal of large deviations for the output variables
In section 4 , we prove a large deviations principle for the workload process using classical techniques to get large deviations principles. These techniques are hard to apply to prove large deviations principles for the output variables. Instead we are going to make use of the contraction principle. Following the outline of the proof of the existence of fixed points for discrete-time queues in [11] we use theoretical results on large deviations for continuous-time processes.
First we get back to the workload process to illustrate this method. For
, we define
It is obvious that
.
To apply the contraction principle it is crucial to define an adapted topology under which the workload process is obtained through a continuous mapping of the input variables. Therefore we define the polygonal approximation in
of a given sequence
by
Let
and
the polygonal approximations in
of the sequences
and
.
Notice that for
,
| |
| |
A function
is absolutely continuous on
if
If
is absolutely continuous, then its derivative
exists almost everywhere and we can write
For
, we define
(respectively
) the set of continuous functions (respectively absolutely continuous)
with
and
equipped with the norm
|
(16)
|
We now focus on large deviations on processes in continuous time in
.
Definition 6.1.
A sequence of processes
, where
satisfies a functional large deviations principle with linear geodesy, with instantaneous rate function
, if
-
the function
is a rate function, with
,
-
the sequence
satisfies a large deviations principle
with rate function
Dembo and Zajic explored extensions [4] of large deviations principles to processes in continuous time under the topology of uniform convergence. However, this topology is not appropriate in the context of queueing systems. We introduce a finer topology corresponding to the norm ( 16 ). The following large deviations principle is due to Ganesh and O'Connell [10] . Notice that if
an i.i.d. sequence with mean
, that for
,
, where
is the polygonal approximation in
of the sequence
with
Theorem 6.2.
[
10]
Let
be a sequence of real-valued random variables and
its cumulant generating function, which we suppose differentiable near the origin. the sequence of polygonal approximations
of
, where
, satisfies a functional large deviations principle with linear geodesics on
with the norm ( 16 ), with mean
and instantaneous rate function
, i.e.
Under
, the processes
and
satisfy functional large deviations principles with linear geodesics and instantaneous rate functions
and
defined by
with
, the Legendre transform of
. We define
and
in the same way.
We check (see [12] ) that
defined by
is continuous on
for the topology induced by the norm ( 16 ). Indeed
is not continuous under the toplogy of uniform convergence on compact sets (example 5.2 [12] ).
Applying the contraction principle, we check that
satisfies a large deviations principle on
with rate function
| |
| |
where
. Combining this with Proposition 4.1 , we have
Corollary 6.3.
The solution of the following optimization problem
is given by
where
is defined in ( 14 ).
In the following paragraph we make use of the same techniques to give large deviations principles for the output variables
|
(17)
|
We define
and
by
Let
and
be their polygonal approximations in
. Under
,
and by Loynes scheme [16] , wee check that
6.1 Optimization problem
To make the proof as clear as possible, we introduce a new variable
which stands, in a queueing context, for the time between instants of beginning of services of customers
and
. Let
defined by
and
its polygonal approximation in
then
. Under
, we have
Lemma 6.4.
for
fixed, the sequences
and
are exponentially equivalent.
-
Proof.
Let
,
| |
| |
| |
Since
and thanks to assumption
(
for
close to
), we are done.
Thus if one of the sequences
and
satisfies a large deviation principle then the other too and and they have the same rate function. Since the expression of
(in terms of the input variables) is easier than the one of
, we concentrate on
and
. In fact,
Lemma 6.5.
The sequences
and
satisfy
| |
| |
-
Proof.
We check the result for
, the proof goes along the same arguments for
. Since
is a linear interpolation of
, we will prove the result for
. First, we check that
However, we have
then
Theorem 6.6.
Under assumptions
and
, the sequence
satisfies a large deviations principle on
with rate function
|
(18)
|
where
with
and
.
-
Proof.
By Loynes [16] and lemma 6.5 , we check that
=
with
where
and
, we have
| |
| |
|
(19)
|
Applying the contraction principle, the sequence
satisfies a large deviations principle with rate function
This variational is hard to solve in a general setting, we restrict ourselves to
. By the law of large numbers,
converges to the mean values of the output variables, whereas large deviations principle give the fluctuations around these values. The sequence
satisfies principle with rate function
|
(20)
|
We introduce the variables
and
given by
| |
| |
We rewrite ( 19 ) as follows
To solve this variational problem we condition on the value of
to be equal to
. By the stability condition
, we check that
is finite. Then
is the solution of the following optimization problem
| |
| |
where
and
.
Using the auxiliary variable
allows the decomposition of the initial optimization problem into two minimization problems on
and
coupled through
. More precisely, we suppose the variables
,
and
given, if we fix
equal
, then
and
are fixed. For
, the only constraint on
and
is
. Consequently, the first minimization consists of
The second minimization consists of
| |
| |
knowing
. In both cases the minimization is for
.
For the first problem, let
with
,
. By lemma 6.3 , this optimization gives the rate function associated with
given in 4.1 and the minimum is
where
.
Hence, to determine
it remains to
|
(21)
|
for
subject to
-
Suppose
, then
, i.e.
The optimisation problem ( 21 ) is fulfilled by linear functions
and
and we have
-
If
reaches its maximum for
then
| |
| |
We define
,
and
,
Using the convexity of
and
and Jensen's inequality, we have
Since
où
et
, it remains to minimize
subject to
Let
and
, we check that
,
and
et
defined in Theorem 6.6 .
Let us give an interpretation of this result in a queueing context. Indeed the most likely ways to get departures with mean
and an average time spent at the back of queue equals to
, and an average waiting time
is whether
-
∙
all customers belong to the same busy period (the system is never empty). Thus the mean of the departures is equal to the mean of the services and the average time spent at the very back of the queue is equal to the mean of the arrivals,
-
∙
or let
the variables where
reaches its minimum. Then the customer
finds the system empty, and the optimal path splits into two periods. Customer
waits
time before starting its service. During the first period the average of arrivals and services are
and
and it consists of
customers. During the second period the mean of services is
and the arrivals occurs with mean
.
The equation ( 18 ) determines the rate functions of the output variables in terms of those of the input variables. A natural question is when these functions are equal. More precisely, when do we have
? We start with an example which translates the result stated in [7] in terms of large deviations.
Example: the M/M/1 queue
Suppose that
and
are i.i.d. mutually independent and for
,
For
,
Since
, we check that
. Moreover we have
Resolving the above optimization problem, we have
| |
| |
6.2 Existence of fixed points
Suppose
and
i.i.d., mutually independent with mean
and
.
They satisfy large deviations principles with rate functions
and
differentiable on
. Let
such that
|
(22)
|
We can rewrite this relation in the following which will be useful for future analysis
|
(23)
|
Before stating the fixed point result for the Queue/Store operator for the rate functions, we give an interpretation of the relations ( 22 ) and ( 23 ) in terms of exponential tilting of measures.
Definition 6.7.
Let
, we say that a measure
is the
-exponentially-tilted measure of a given measure
if for all
,
|
(24)
|
where
denotes the Radon-Nikodym derivative of
with respect to
.
Proposition 6.8.
Suppose
and
satisfies relation ( 22 ) or ( 23 ), with marginals
and
. Then
is the
-exponentially-tilted function of
.
-
Proof.
Recall that
. We check that
| |
| |
|
(25)
|
Taking exponentials in both sides, we have
Lemma 6.9.
Let
and
satisfying assumptions
and
, then the tilt coefficient
is given by
-
Proof.
Let
in ( 25 ), we have
Since
, we obtain
. Thanks to ( 14 ), we have
The function
is convex with
. Moreover, by assumption
,
i.e.
is equal to zero twice on
, at
and
, than
Theorem 6.10.
Let
and the sequences
and
the input variables of the model with
the
-tilted measure of
(or
the
-tilted measure of
). Then the sequence
satisfies a large deviations principle on
with rate function
|
(26)
|
Moreover, we have
-
Proof.
By Theorem 6.6 , the sequence
satisfies a large deviations principle on
with rate function
We start by the first term of this optimization problem, i.e.
We have
, and thanks to ( 23 ),
| |
| |
For the second term, let
,
-
If
, from the convexity property, we have
| |
| |
-
If
, then
Notice that
Since
is convex and
, we have
Thus,
Since
and
are convex and
, we have
We conclude that
.
In words the above theorem states that if the input variables satisfy large deviations principles with rate functions
and
with
the
-tilted measure of
, then the output variables satisfy large deviations principles with the same rate functions. References
-
P.J. Burke. The output of a queueing system. Operations Research, 4:699–704, 1956.
-
C.S. Chang. Stability, queue length and delay of deterministic and stochastic queueing networks. IEEE Transactions on Automatic Control, 39:913–931, 1994.
-
C. Courcoubetis, G. Kesidis, A Ridder, J Walrand, and R. Weber. Admission control and routing in ATM networks using inference from measured buffer occupancy. IEEE Transations on Communications, 43:1778–1784, 1995.
-
A. Dembo and T. Zajic. Large deviations : from empirical mean and measure to partial processes. Stochastic Processes and their Applications, 57:197–224, 1995.
-
A. Dembo and O. Zeitouni. Large Deviations Techniques and Applications. Jones and Barlett, Boston, 1993.
-
M. Draief, J. Mairesse, and N. O'Connell. Joint Burke's theorem and RSK representation for a queue and a store. In C. Banderier and C. Krattenthaler, editors, Discrete Random Walks, DRW'03, volume AC, pages 69–82, Institut Henri Poincaré, Paris, 2003.
-
M. Draief, J. Mairesse, and N. O'Connell. Queues, Stores, and Tableaux. submitted, 2004.
-
N. Duffield and N. O'Connell. Large deviations and overflow probabilities for the general single server queue, with applications. Mathematical Proceedings of the Cambridge Philosophical Society, 118(1), 1995.
-
R. Gallager and B. Prabhakar. Entropy and the timing capacity of discrete queues. IEEE Transactions on Information Theory, 49(2):357–370, 2003.
-
A. Ganesh and N. O'Connell. A large deviation principle with queueing applications. Stochastics and Stochastic Reports, 73(1-2):25–35, 2002.
-
A. Ganesh, N. O'Connell, and B. Prabhakar. Invariant rate functions for discrete-time queues. Annals of Applied Probability, 13(2):446–474, 2003.
-
A. Ganesh, N. O'Connell, and D. Wischik. Big Queues. Lecture Notes in Mathematics. Springer-Verlag, Berlin, 2004.
-
P. Glynn and W. Whitt. Logarithmic asymptotics for steady-state tail probabilities in a single-server queue. Journal of Applied Probability, 31A:131–156, 1994.
-
F Kelly. Notes on effective bandwidth. In F. Kelly and I Ziedens, editors, Stochastic Networks, pages 141–168. Oxford University Press, 1996.
-
F.P. Kelly. Effective bandwidths at multi-class queues. Queueing Systems Theory and Application, 9:5–15, 1991.
-
R. Loynes. The stability of a queue with non-independent interarrival and service times. Mathematical Proceedings of the Cambridge Philosophical Society, 58:497–520, 1962.