December 25, 2004.
1991 Mathematics Subject Classification. 60F10, 60J27.
Examples of moderate deviation principle for diffusion processes
A. Guillin
R. Liptser
CEREMADE, Universite Paris Dauphine and TSI, Ecole nationale des Telecommunications E-mail address : guillin@ceremade.dauphine.fr Electrical Engineering Systems, Tel Aviv University, 69978 Ramat Aviv, Tel Aviv, Israel E-mail address : liptser@eng.tau.ac.il
-
Abstract.
Taking into account some likeness of moderate deviations (MD) and central limit theorems (CLT), we develop an approach, which made a good showing in CLT, for MD analysis of a family
for an ergodic diffusion process
under
and appropriate
. We mean a decomposition with “corrector”:
and show that, as in the CLT analysis, the corrector is negligible but in the MD scale, and the main contribution in the MD brings the family “
” Starting from Bayer and Freidlin, [2] , and finishing by Wu's papers [29] -[33] , in the MD study Laplace's transform dominates. In the paper, we replace the Laplace technique by one, admitting to give the conditions, providing the MD, in terms of “drift-diffusion” parameters and
. However, a verification of these conditions heavily depends on a specificity of a diffusion model. That is why the paper is named “Examples ...”.
1 Introduction
In this paper, we study the moderate deviation principle (in short: MDP) for a family
,
:
where
is an ergodic diffusion process (
,
) (with the unique invariant measure
, obeying the density
relative to Lebesgue measure over
.
The function
is assumed to be integrable relative to
and has zero barycenter
|
(1.1)
|
We restrict ourselves by consideration of the strong (unique) solution of Itô's equation
|
(1.2)
|
generated by a standard vector-valued Wiener process
and subject to a fixed initial point,
. We also include into the consideration a linear version of 1.2 (here
are matrices):
|
(1.3)
|
being popular in engineering.
In a nonlinear case, we use Veretennikov Khasminskii's condition (see, [14] and [28] ): for some positive numbers
,
and
, (here
denotes the inner product)
and assume that the diffusion matrix
is nonsingular and bounded.
In a linear case, proper assumptions are given in terms of the pair
:
1) eigenvalues of
have negative real parts; 2)
satisfies Kalman's controllability condition from [12] , i.e. a singularity of
is permissible.
For the MDP analysis, we apply well known method employed for the central limit theorem (in short CLT) proof of a family
(see, e.g. Papanicolaou, Stroock and Varadhan [20] , Ethier and Kurtz [7] , Bhattacharya [3] , Pardoux and Veretennikov [21] , [22] and citations therein, see also Ch. 9, §3 in [16] ) based on a decomposition with corrector:
where
is the transition probability kernel of
, and
is a continuous martingale with the variation process
. In the above mentioned papers, the corrector is negligible in a sense
and the main contribution to a limit distribution brings
. It is well known (see, e.g. Ch. 5 in [16] ) the following implication: with nonnegative definite matrix
where
Summarizing these remarks, we may claim that the CLT holds provided that
and
exist and for any
| |
| |
We develop the same method for MDP analysis. Replacing
by
, we keep the CLT framework with the same
,
and
, i.e.,
and claim that (Theorem 2.1 ) the MDP holds, with the rate of speed
provided that
and
exist and for any
|
(1.4)
|
A choice of
is imposed by
. As in the CLT proof, the corrector negligibility is required but exponentially fast with the rate of speed
. The main contribution in the MDP brings the family
.
Most probably, Dembo, [5] , was one of the first who introduced a condition of 1.4 (second) type. We found in Puhalskii, [25] (Theorem 2.3) and [24] , [26] that, in our setting with nonsingular (!) matrix
, 1.4 provides MDP for the family
with the rate of speed
and the rate function
We prove in Theorem 2.1 that the same statement remains valid for a singular
too with the rate function
where
is the Moore-Penrose pseudoinverse matrix (see, Albert, [1] ).
It would be noted that seeming simplicity of 1.4 is delusive with the exception of the eigenvalue gap case (in short EG, see Gong and Wu, [8] ) for
(a corresponding scenario can be found in [4] ). Unfortunately, the EG fails for diffusion processes. For instance, under
associated with Ornstein-Uhlenbeck's process
having
-Gaussian invariant measure
, if EG were valid, then for bounded centered
However, direct computations show that for
and sufficiently large
, we have
where
is a positive function,
over
and
with
. The condition of this type: for any bounded and measurable
describes the geometric ergodicity (see, Down, Meyn and Tweedie, [6] and citations therein). The geometric ergodicity is a helpful tool for the verification of
and
existence and even for the first part of 1.4 verification, although, a crude choice of
, say
, may to render this verification impossible (CLT analysis is not so sensitive to a choice of
). The second part of 1.4 verification is very sensitive to properties of
, owing to
, so that, the geometric ergodicity framework is not a “foreground” tool. Following Pardoux and Veretennikov, [21] , we combine a property of
with a polynomial ergodicity
,
with
-depending
admitting an effective verification of 1.4 . In this connection, we mention here some result (see, Theorem A.1 ), in Appendix, interesting by itself, which is helpful in 1.4 verification. Let
be a diffusion process with the generator
and
is Lyapunov's function belonging to the range of definition of
. Then,
is a continuous martingale and denote by
its variation process. Assume:
Then, for any
and sufficiently large number
| |
| |
Our method of the MDP analysis differs from Wu [29] - [33] where the Laplace transform technique dominates, or Guillin [9] , [10] based on discrete time approximation and Markov chains. In our approach, we deal with the above-mentioned Puhalskii's results obtained with the help of, so called, stochastic exponential as an alternative to Laplace's transform technique (see, e.g. [4] for more detailed explanation in the discrete time case).
The paper is organized as follows. In Section 2 , all notations are given and Theorem 2.1 , generalized Puhalskii's for singular
, is formulated and proved.
In Section 3 , all results and examples are presented focusing on the existence and properties of the corrector and martingale variation process. The proofs are gathered in Section 4 . A simple example showing how the MDP may help in a statistical inference (for more information on statistical applications see, Inglot and Kallenberg, [11] ) is given in Section 5 . The technical tools are gathered in Appendix A .
2 Preliminaries
We fix the following notations and assumptions which are in force through the paper. The random process
is defined on some stochastic basis
satisfying the usual conditions.
-
,
, and
are Euclidean's and
norms respectively in
and the inner product.
is transposition symbol.
-
-
,
are generic constants.
-
is the transition probability kernel of
.
-
denotes the expectation relative to
.
-
is the invariant measure.
-
is the generator of
.
is the filtration, with the general conditions, generated by
.
-
is the variation process of a continuous martingale
-
is the gradient of
(row vector).
-
is Euclidean's metric in
.
-
.
denotes the identical matrix of an appropriate size.
“
”, “
” denote also the standard inequalities for nonnegative definite matrices.
As was mentioned in Introduction, the existence of
|
(2.1)
|
|
(2.2)
|
is required. We emphasize that
is the martingale relative to
.
The theorem below is a “master-key” for MDP analysis.
Theorem 2.1.
For any
and any
, assume (i)
(ii)
Then, the family
obeys the MDP in
with the rate of speed
and the rate function
|
(2.3)
|
where
is the Moore-Penrose pseudoinverse matrix (see, Albert, [
1]
).
-
Proof.
From the definition of
, it follows that
(i) provides the negligibility of
in
-MDP scale.
(ii) provides
-MDP, , under positive definite matrix, with the rate function
for the family
(due to result similar to Puhalskii, [25] (Theorem 2.3) and [26] ).
If
is nonnegative definite only, the above result is no longer valid. This remark necessitates to turn to the general approach in large deviation analysis adapted to our setting. The family
is said to obey the large deviation principle (in our terminology: MDP) with the rate of speed
and some (good) rate function
, provided that this family is
-exponentially tight in
:
|
(2.4)
|
and obeys
-local large deviation principle with the rate function
: for any
|
(2.5)
|
A direct verification of 2.4 and 2.5 would be difficult. So, it is reasonable to verify 2.4 by applying the following regularization procedure. We introduce a new family
with
where
is a positive number and
is a standard Wiener process independent of
. The random process
is continuous martingale with
where
. For the family
, (ii) reads as:
where
. Since
is the nonsingular matrix, the family
obeys
-MDP, where
.
Now, we apply the basic Puhalskii theorem from [23] which, being adapted to our case, states that the family
is
-exponentially tight, in
:
|
(2.6)
|
and obeys
-local deviation principle:
|
(2.7)
|
Obviously, 2.6 and 2.7 imply 2.4 and 2.5 provided that
|
(2.8)
|
and
|
(2.9)
|
2.8 holds true, since the family
obeys the
-MDP with the rate function
, so that,
2.9 is verified with an utilization of the pseudoinverse matrix properties. Let
be an orthogonal matrix transforming
to the diagonal form:
Due to
for
we have (recall that
, see [1] )
| |
| |
| |
| |
| |
| |
For
,
. □
3 Main results
3.1 Nonlinear model, I
solves 1.2 subject to
.
is locally Lipschitz continuous; for some
and
there exists
, depending on
, such that
is Lipschitz continuous; for some
From Pardoux and Veretennikov [21] , it follows that, under
and
, the diffusion process
is ergodic with the unique invariant measure
possessing a density
relative to
. Moreover, for
and any
is measurable function,
; for
, sufficiently small
and any
,
Remark 1.
Under
,
and
, from Pardoux and Veretennikov, [
21]
Theorem 2, it follows that
, given in 2.2 , is bounded and solves the Poisson equation
in the class of functions with Sobolev's partial second derivatives locally integrable in any power and a polynomial growth. With all this going on,
|
(3.1)
|
and, by embedding theorems [
15]
, all entries of
are continuous functions. So, the Krylov generalization of Itô's formula (see [
13]
) is applicable to
:
|
(3.2)
|
Theorem 3.1.
Under
,
and
, the family
obeys the MDP in
with the rate of speed
and the rate function given in 2.3 with
defined in 2.1 .
3.2 Nonlinear model, II
Though Theorem 3.1 serves a wide class of bounded and unbounded functions
, it is far from to be universal especially for
.
So, we fix the next set of stronger assumptions.
and
are Lipschitz continuous; for any
there exists a positive number
such that
for some
.
is Lipschitz continuous function.
Theorem 3.2.
Under
,
and
, the statement of Theorem 3.1 remains valid.
3.3 Linear model
The diffusion process
solves 1.3 ,
,
and
is a standard vector-valued Wiener process of the corresponding size.
For this setting,
or
, and
are too restrictive. We replace them by the following assumptions.
Eigenvalues of
have negative real parts.
is nonsingular matrix.
Suppose either 1)
possesses continuous and bounded partial derivatives, 2)
is bounded,
.
Theorem 3.3.
Under
,
and
, the family
obeys the MDP in
with rate of speed
and the rate function given in 2.3 with
defined in 2.1 .
The next result deals with quadratic function
. Under
and
, the invariant measure
is zero mean Gaussian with nonsingular covariance matrix
solving the Lyapunov equation
|
(3.3)
|
We introduce also a positive definite matrix
and a matrix
solving the Lyapunov equation
Theorem 3.4.
Assume
and
and
Then, the family
obeys the MDP in
with rate of speed
and the rate function given in 2.3 with
3.4 More examples
In this section, we give examples which are not explicitly compatible with Theorems 3.1 - 3.4 .
Example 3.1.
Let
,
and
|
(3.4)
|
Though
holds with
, Theorem 3.1 is not applicable since by
only
with property
,
is admissible.
Nevertheless, the MDP holds and is trivially verified. Indeed, 3.4 is nothing but 3.2 with
. Hence,
and
.
Consequently, (ii) from Theorem 2.1 automatically holds.
(i) is reduced to
and is verified with the help of Theorem A.1 with
. Actually, by Itô's formula we find that
where
. Hence,
Example 3.2.
Let
and
where
is Lipschitz continuous and symmetric,
function (obviously
). Under
, providing
,
is an ergodic diffusion process with the symmetric invariant density,
. So, any bounded
, with
, possesses 1.1 . We choose
However, neither Theorem 3.3 nor Theorem 3.1 are compatible with the setting owing to
does not satisfy neither
nor
. Nevertheless, we show that the standard MDP holds. A computational trick proposes to use a decomposition
for
since
satisfies
and
satisfies
. Then,
and
are well defined and both are bounded; at the same time
and
are also well defined and
is bounded, i.e.
.
Taking
we get bounded
and
satisfying the linear growth condition. Moreover, due to
we have
providing
with bounded
.
Now, (i) and (ii) from Theorem 2.1 are verified in a standard way with the help of Theorems A.1 , A.2 .
Example 3.3.
(Linear version of Langevin model.) A nonlinear Langevin's model, including our linear one, is studied in Wu, [
33]
. The result from [
33]
seems not to be accomplished. At least, we could not adapt assumptions from there to verify the MDP for the following setting.
Let
with (
) and
|
(3.5)
|
where
and matrices
,
and
are positive definite. We verify the MDP with the help of Theorem 3.3 .
It is expedient to write 3.5 to the form 1.3 with matrices (in a block form)
In accordance with Theorem 3.3 , we have to verify only two conditions:
1) eigenvalues of
have negative real parts, 2) the matrix
(see
) is nonsingular.
1) fulfils since free of noise 3.5 :
| |
is asymptotically stable. Traditionally for the Langevin equation, this result is easily verified with the help of Lyapunov's function
and is omitted here.
2) holds since
is nonsingular. Indeed,
that is, with a vector
we have
| |
| |
By virtue of the well known inequality
|
(3.6)
|
we get
Consequently, under
, we have
Even though
, and so
, we also have
.
Thus, under
, the MDP holds.
Example 3.4.
(MDP for a smooth component of diffusion process.) Let
be the first component of a diffusion process
with entries
,
:
|
(3.7)
|
where
and
are positive numbers and
is a Wiener process.
As in the previous example, we rewrite 3.7 to the form of 1.3 with
where
,
,
and, analogously,
,
,
,
.
We verify the MDP with the help of Theorem 3.3 . In order to guarantee
, suffice it to assume that roots of the polynomial
have negative real parts owing to the noise free version of 3.7 is nothing but the differential equation
Notice that
is fulfilled too since
is a nonsingular matrix. Actually,
and so, we have
| |
Taking
where
is a number and
is a vector of the size
, for
, and then
, we have
. Even though
, the use of 3.6
provides
In order to establish the MDP for the family
we redefine the function
as:
and assume
satisfies
. Then, the family
obeys the MDP with the rate of speed
and the rate function
of the standard form 2.3 .
Now, the desired MDP holds by Varadhan's contraction principle, [
27]
, with the same rate of speed and the rate function
Example 3.5.
Let
be Gaussian diffusion with
and
. This function satisfies 1.1 and, at the same time, is not compatible with Theorems 3.1 - 3.4 . So, we suppose to embed this setting to a new one with a vector function
with entries:
which is MDP verifiable. Applying arguments from the proof of the Theorem 3.3 , one can show the existence of
with bounded
such that
| |
| |
Now, we establish similar property of
. By the Krylov-Itô formula (see [
13]
), we find that
Consequently,
and
.
Now, we may verify (i), (ii) from Theorem 2.1 .
(i): Since
is bounded,
satisfies the linear growth condition.
Thus,
Hence, (i) is reduced to
The latter holds owing to
possesses an exponential moment:
uniformly in
over
and sufficiently small
and, therefore, the Chernoff inequality is effective. Write
| |
| |
Notice that
, so that, the (i) verification is the same as for
.
(ii): The martingale
is vector-valued process with two entries
and
. Hence, its variation process is a matrix
so that, the entries of
are defined in the following way:
| |
| |
| |
Thus, (ii) is reduced to
|
(3.8)
|
where
is continuous function satisfying 1.1 and either 1)
, 2)
.
In 1), we apply
borrowed from 4.1 , and verify versions of 3.8 with
and
separately.
-version holds owing to by Theorem 3.1 (
)
obeys
-MDP with a nondegenerate rate function and
.
-version holds owing to
and for sufficiently large
,
verified with the help of Theorem A.1 for
.
In 2), by Theorem 3.4 ,
obeys
-MDP with a nondegenerate rate function. So, it remains to recall that
.
Thus,
-MDP for new family holds true with the rate function
,
, defined in 2.3 . Hence, the original family possesses the MDP with the quadratic rate function
4 Proof of Theorems from Section 3
4.1 The proof of Theorem 3.1
Denote by
the martingale from 3.2 having
.
We shall verify (i) and (ii) from Theorem 2.1 .
(i) holds since, by Remark 1 ,
is bounded.
(ii) is verified in a few steps.
Step 1:
identification. We show that
This fact is well known and is given here for a reader convenience only. Notice that, by 2.2 ,
where
the stationary version of
, that is, the version solving 1.2 subject to
the random vector, independent of
, with the distribution provided by the invariant measure
. Hence, suffice it to show that
|
(4.1)
|
We verify 4.1 with the help of Itô's formula
by taking the expectation.
Step 2. Preliminaries.Set
and let
denotes any entry of
. For (ii) to be valid suffice it to show that
|
(4.2)
|
Recall
. By 3.1 ,
We consider separately two cases provided by a special choice of
(see,
):
is bounded;
,
Step 3.
For sufficiently large number
, set
where
is bounded continuous function such that
is continuous function with
. In contrast to
, the function
decreases fast to zero with
, so that, a negative constant
can be chosen such that
In accordance with this property,
solves the Poisson equation
and is bounded jointly with
(see, Remark 1 ). Hence,
with the martingale
having
The negligibility of
in
-MDP scale is provided by the boundedness of
. The same type negligibility of
is provided by the boundedness of
, due to Theorem A.2 .
Consequently, a version of 4.2 with
holds true.
Set
. Since
is bounded,
Consequently a version of 4.2 with
is reduced to
and is verified with the help of Theorem A.2 for
owing to
are fulfilled under
and
(a verification of these facts is accomplished with the help of Itô's formula).
Step 4.
We apply again the decomposition
. With chosen
,
is decreasing fast to zero, with
, and is bounded by
. So, the version of 4.2 with
is verified as in the case “
”.
Notice that
where
Hence, the version of 4.2 with
is reduced to
To this end, we apply Theorem A.1 .
First, taking into account that
,
and
, by the Itô formula we find that
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
Thus, we have
, where
| |
| |
| |
| |
| |
| |
| |
| |
and
that is,
Thus, the assumptions of Theorem A.1 are fulfilled and, thereby, for sufficiently large
, we have
and, it is left to notice that
for
. □
4.2 The proof of Theorem 3.2
By
,
| |
| |
| |
that is, there exists
such that
Hence,
. However since, by
,
is admissible, Theorem 2 from Pardoux and Veretennikov, [21] , is no longer applicable.
At the same time, Theorem 1 from [21] states that
from 2.2 solves the Poisson equation
and satisfies the following properties: for some
,
Nevertheless, regardless of that,
provides
|
(4.3)
|
Actually, let
denotes the solution of 1.2 subject to
. Since for any
and
, we have
, by
, we have (
is the Lipschitz constant for
)
| |
| |
where
With the help of Itô's formula, we find that
| |
| |
| |
Hence,
is differentiable relative to
and
Then, by
, we have
i.e.,
The latter implies the Lipschitz continuity of
and, in turn, 4.3 .
We proceed the proof with the verification of (i) and (ii) from Theorem 2.1 .
(i): Due to 4.3 , suffice it show that
what is verified with the help of Theorem A.1 for
. With the help of Itô's formula, one can find that
and next that
.
(ii): It is verified similarly to 4.2 for
.
□
4.3 The proof of Theorem 3.3
Under
,
, the Pardoux-Veretennikov concept is no longer valid. Nevertheless,
and
provide the ergodicity of
with the unique zero mean Gaussian invariant measure characterized by a nonsingular covariance matrix
solving Lyapunov's equation, see 3.3 .
We prove the theorem in a few steps. Step 1. Invariant and transition densities.For
, the diffusion process
is Gaussian with the expectation
and the covariance matrix
solving the differential equation
|
(4.4)
|
subject to
. It is well known, and is readily verified that, under
and
, we have
over
and
If in addition
, then, for
in a vicinity of zero,
|
(4.5)
|
Since
, the invariant density
and the density of
relative to
are defined as:
Step 2.
existence.We prove that
from 2.2 is well defined over
by showing
|
(4.6)
|
Assume
. Let
,
denote the stationary version of
and
with
respectively. By 1.1 and the Lipschitz property of
(with the Lipschitz constant
), it holds
where, by 1.2 ,
i.e.,
Hence and by
, there exists a positive constant
such that
The random vector
is Gaussian, so that,
Thus,
and 4.6 holds true.
Assume
. We may adapt the results of Meyn and Tweedie, [19] (see also Mattingly and Stuart, [17] and Mattingly Stuart and Higham, [18] ) for getting 4.6 .
However, taking into account the explicit formulae for
and
, the direct proof of 4.6 is given.
For a definiteness, let
. We apply an obvious inequality
A changing of variables:
and the identity
| |
| |
provide
| |
| |
| |
| |
Due to
,
converges to zero in
exponentially fast in a sense that
for some generic
. Moreover,
, owing to
solves the differential equation
subject to
(see, 3.3 and 4.4 ) . The above-mentioned convergence implies also
Thus, there exists an appropriate positive continuous function
over
such that for
,
and, in turn, 4.6 holds true, owing to
Step 3.
existence.Assume
and notice that
|
(4.7)
|
Since
by virtue of of 4.7 we have
In particular,
is bounded.
Assume
. Now, we prove that
|
(4.8)
|
The use of
provides
| |
| |
Consequently, taking into account the boundedness of
and 4.5 , by Cauchy-Schwarz's inequality we get (with a generic positive constant
):
Then, 4.8 holds and
is bounded. Step 4.
existence.Since an applicability of Itô's (Krylov-Itô's) formula to
is questionable, we show that
, with
is the continuous martingale,
|
(4.9)
|
and
over
; the latter is provided by the boundedness of
.
The use of a homogeneity in
of the Markov process
enables to claim that
admits the following presentation a.s.,
Then for any
, we have
| |
| |
and the martingale property,
a.s., becomes obvious.
Now, we establish 4.9 with the help of well known fact: for any
,
coincides with the limit, in probability, in
of
where
is a condensing sequence of time values. We recall only that
and
Step 5. (i) verification.Due to the linear growth condition of
, suffice it to show that
|
(4.10)
|
for
with an appropriate positive definite matrix
. In view of
, it is convenient to choose
solving the Lyapunov equation
The function
belongs to the range of definition for
with
| |
| |
while
is the martingale (relative to
) with
Now, 4.10 is provided by Corollary 1 to Theorem A.1 .
Step 6. (ii) verification.Since
is bounded and continuous, (ii) holds true if
| |
for any bounded and continuous
with
.
Assume for a moment that
satisfy
from Theorem 3.3 . Then, the function
is well defined and
is the semimartingale:
where
is the continuous martingale with
and
is bounded and continuous.
Hence, suffice it to verify 4.11 with
replaced by
and
separately.
First of all notice that the version of 4.11 with
is valid due to Theorem A.2 owing to
, where
in
over
. Further, because of
is bounded and, then,
satisfies the linear growth condition, the version of 4.11 with
is reduced to 4.10 .
If
does not satisfy
, we apply the decomposition
borrowed from the proof of Theorem 3.1 ,
. Then, the version of 4.11 with
is reduced to: for sufficiently large
,
and is verified with the help of Theorem A.1 for
.
The verification of 4.11 with
differs from the corresponding part of proof for Theorem 3.1 ,
. Let
, involved in the definition of
, and
be chosen.
Since
is compactly supported, there exists a polynomial
such that
| |
| |
Because of
satisfies 1.1 and
, the validity of 4.11 with
is obvious. So, it is left to recall only that
. □
4.4 The proof of Theorem 3.4
Obviously,
satisfies 1.1 .
We shall verify (i), (ii) from Theorem 2.1 . By virtue of 2.2 , the quadratic form of
is inherited by
. We examine the following
with a positive definite matrix
and positive number
. By Itô's formula we find that
The realization of this project requires for
to be a solution of Lyapunov's equation
what, in particular, provides
where
is the covariance of the invariant measure. With chosen
, set
and notice that
(i) is reduced to
which holds since for positive and sufficiently small
the moment generating function
is bounded over
and, then, Chernoff 's inequality provides
(ii) is valid if
|
(4.11)
|
Let us denote
and
We repeat the previous arguments to find
with a positive definite matrix
and positive number
such that
is a continuous martingale with
where
is a positive definite matrix. Now, we may replace 4.11 by
| |
| |
(1) is verified similarly to (i). (2) is verified with the help of Theorem A.2 by showing
for sufficiently large
what is nothing but
|
(4.12)
|
A version of 4.12 with
replaced by any positive definite matrix
provides 4.12 too. For computational convenience, we take
solving Lyapunov's equation
The function
belongs to the range of definition of
with
and
so that,
Thus, the proof is completed by applying Theorem A.1 . □
5 Example of statistical application
Let
be a diffusion process:
subject to a fixed
. The parameter
is unknown and is evaluated with help of well known estimate
It is well known that the CLT holds for the family
with a limit:
zero mean Gaussian random variable with the variance
.
In this section, we show that
possesses an asymptotic (in
) in the MDP scale,
, that is, the family
obeys
-MDP with
. The use of some details from the proof of Theorem 3.4 enables to claim that
is negligible in
-MDP scale. Therefore, the family
shares the MDP with
Further, the announced MDP hold if (ii) from Theorem 2.1 is valid:
|
(5.1)
|
Obviously,
and the validity of 5.1 is verified with the help of arguments used in the proof of Theorem 3.4 .
In particular, this MDP and the contraction Varadhan's principle, for sufficiently large
provide
A Exponential negligibility of functionals and martingales
Let
be a diffusion process defined in 1.2 with
.
Assume
, with
, belongs to the range of definition of
. Introduce a martingale relative to
:
|
(A.1)
|
Theorem A.1.
Assume 1)
,
2)
,
.
Then, for any
and sufficiently large number
| |
| |
over
.
Corollary 1.
since
Remark 2.
The statements of Theorem A.1 remain valid if constants
, involved in 1) and 2) depend on
.
Theorem A.2.
Let
be a continuous martingale.
Then, for any
,
provided that, under sufficiently large number
depending on
,
The proof of Theorem A.1 . With
, and the (continuous) martingale
from A.1 , we introduce a positive random process
It is well known and easily verified with the help of Itô's formula that
is a positive local martingale. Moreover, by Problem 1.4.4, [16] , it is a supermartingale too. We shall use the supermartingale property:
over
. Denote by
The use of
provides
|
(A.2)
|
Notice that A.2 remains valid with
replaced by its lower bound on
. We proceed the proof by finding appropriate deterministic (!) lower bounds. Write
Thence, in view of 1) and 2), with
we get
| |
| |
Taking into account
, provided by
, and choosing
, we get
| |
| |
These lower bounds jointly with A.2 provide
□ The proof of Theorem A.2 . Notice that only
|
(A.3)
|
is required to be proved. Moreover, it suffices to prove only
|
(A.4)
|
owing to a version with
is verified similarly and both “
” provide A.3 .
For A.4 verification, we use the inequality from A.2 with
and
,
replaced by
,
respectively and
replaced by
and notice that
Then, owing to
, we get
□ References
-
Albert, A. (1972) Regression and the Moore-Penrose Pseudoinverse. Academic Press, New York and London.
-
Bayer, U., Freidlin, M.I. (1977) Theorems on large deviations and stability under random perturbations” DAN USSR. 235, 2, pp. 253-256.
-
Bhattacharya, R.N. (1992) On the functional central limit theorem and the law of the iterated logarithm for Markov processes, Z. Wharsch. verw. Geb. 60, pp. 185–201.
-
Delyon, B., Juditsky, A. and Liptser, R. (2005) Moderate deviation principle for ergodic Markov chain. Lipschitz summands Shiryev's Festschrift.
-
Dembo, A. (1996) Moderate deviations for martingales with bounded jumps,Elect. Comm. in Probab. 1, pp. 11-17.
-
Down, D., Meyn, S.P. and Tweedie, R.L. (1995) Exponential and uniform ergodicity of Markov processes. Ann. Probab. 23, no. 4, pp. 1671-1691.
-
Ethier, S.N., Kurtz, T.G. (1986), Markov processes. Characterization and convergence, Wiley Series in Probability and Mathematical Statistics, John Wiley & Sons, New York et al.
-
Gong, F. and Wu, L. (2000) Spectral gap of positive operators and applications, C. R. Acad. Sci., Ser. I, Math. 331(12), pp. 983-988.
-
Guillin, A. (2001) Moderate deviations of inhomogeneous functionals of Markov processes and application to averaging. Stoch. Proc. Appl. 92, pp. 287-313.
-
Guillin, A. (2003) Averaging of SDE with small diffusions: Moderate deviations. Ann. Prob., Vol. 31(1), pp. 413-443.
-
Inglot, T. and Kallenberg, C.M. (2000) Moderate Deviations of Minimum Contrast Estimators under Contamination. Preprint.
-
Kalman, R.E. (1960) Contribution in the theory of optimal control. Bol. Soc. Mat. Mex., 5, pp. 102-119.
-
Krylov, N.V. (1980) Controlled diffusion processes. Springer, (in Russian, Moscow, 1977).
-
Khasminskii, R.Z. (1980). Stochastic stability of differential equations. Sijthoff & Noordhoff.
-
Ladyzenskaja, O., Solonnikov, V., Ural'ceva, N. (1968) Linear and quasilinear equations of parabolic type. Translation Monographs, 23, AMS, Provvidence.
-
Liptser, R.Sh. and Shiryayev, A.N. (1989) Theory of Martingales. Kluwer Acad. Publ.
-
Mattingly, J. C. and Stuart, A. M., (2002) Geometric ergodicity of some hypo-elliptic diffusions for particle motions, Markov Process. Related Fields, vol. 8 no. 2 , pp. 199–214 (Inhomogeneous random systems (Cergy-Pontoise, 2001)
-
Mattingly, J. C., Stuart, A. M. and Higham, D. J. (2002) Ergodicity for SDEs and approximations: locally Lipschitz vector fields and degenerate noise, Stochastic Process. Appl., vol. 101 no., pp. 185–232.
-
Meyn, S.P.and Tweedie, R.L. (1993) Markov chains and stochastic stability. Springer-Verlag.
-
Papanicolaou, C.C., Stroock, D.W., Varahan, S.R.S. (1977) Martingale approach to some limit theorems. in: Conference on Statistical Mechanics, Dinamical Systems and Turbulence, M. Reed ed., Duke Univ. Math. Series, 3.
-
Pardoux, E., Veretennikov, A.Yu. (2001) On Poisson equation and diffusion approximation, 1. Ann. Prob. 29 (2001), n. 3, pp. 1061-1085.
-
Pardoux, E., Veretennikov, A.Yu. (2003) On Poisson equation and diffusion approximation, 2. Ann. Prob. 31 , n. 3, pp. 1166-1192.
-
Puhalskii, A.A. (1991) On functional principle of large deviations”. New trends in Probability and Statistics., Vilnius, Lithuania, VSP/Mokslas, pp. 198-218.
-
Puhalskii, A.A. (1994) The method of stochastic exponentials for large deviations. Stochast. Proc. Appl. 54, , pp. 45-70.
-
Puhalskii, A. (1999) Large deviations of semimartingales: a maxingale problem approach. II. Uniqueness for the maxingale problem. Applications. Stoch. Stoch. Rep., 68, pp. 65-143.
-
Puhalskii, A. (2001) Large Deviations and Idempotent Probability, Chapman & Hall/CRC Press.
-
Varadhan, S.R.S. (1984) Large Deviations and Applications. SIAM, Philadelphia.
-
Veretennikov, A.Yu. (1999), On polynomial mixing and convergence rate for stochastic difference and differential equations. Teoria veroyatnostej i ee primeneniya. 44, 2, pp. 312–327 (in Russian; English version: preprint 393 (1998), WIAS, Berlin).
-
Wu, L. (1995) Moderate deviations of dependent random variables related to CLT and LIL, Annals of Probability. 23, no. 1, pp. 420-445.
-
Wu, L. (2000) Uniformly integrable operators and large deviations for Markov processes, J. Funct. Anal., 172(2), pp. 301-376.
-
Wu, L. (2000) Some notes on large deviations of Markov processes, Acta Math. Sin., Engl. Ser., 16(3), pp. 369-394.
-
Wu, L. (2001) The principle of large deviations for empirical processes, J. Math., Wuhan Univ., 21(3), pp. 295-300.
-
Wu, L. (20001) Large and moderate deviations and exponential convergence for stochastic damping Hamiltonian systems. Stochastic Processes and their Applications. 91, pp. 205-238.
CEREMADE, Universite Paris Dauphine and TSI, Ecole nationale des Telecommunications E-mail address : guillin@ceremade.dauphine.fr Electrical Engineering Systems, Tel Aviv University, 69978 Ramat Aviv, Tel Aviv, Israel E-mail address : liptser@eng.tau.ac.il