Positive definite kernels and lattice paths
T. Constantinescu
Nermine El-Sissi
Department of Mathematics, University of Texas at Dallas, Richardson, TX 75083 E-mail address : tiberiu@utdallas.edu Department of Mathematics, University of Texas at Dallas, Richardson, TX 75083 E-mail address : nae021000@utdallas.edu
-
Abstract.
We discuss the structure of positive definite kernels in terms of operator models. In particular, we introduce two models, one of Hessenberg type and another one that we call near tridiagonal. These models produce parametrizations of the kernels and we describe the combinatorial nature of these parametrizations in terms of lattice paths of Dyck and Lukasiewicz type.
1 Introduction
In this paper we are interested in parametrizations and combinatorial descriptions of positive definite kernels on the set
of non-negative integers. Positive definite kernels are complex valued maps
with the property that for each
and each choice of elements
,
,
in
and complex numbers
,
,
, we have
|
(1.1)
|
A fundamental result of Kolmogorov, [5] provides a Hilbert space interpretation of positive definite kernels as Gram kernels, that is, there exists a Hilbert space
and elements
,
, such that
|
(1.2)
|
Two of the best known examples of positive definite kernels are those of Toeplitz type, for which
,
and those of Hankel type, for which
,
In both these cases the representation 1.2 can be improved by some more specialized descriptions that might be called operator models of the kernels. Thus, if
is Toeplitz (for simplicity we assume
and all the inequalities in 1.1 are strict) then there exists an isometric operator
, written in upper Hessenberg form, such that
|
(1.3)
|
where
. Likewise, if
is Hankel (with same simplifications as above) then there exists a symmetric operator
, written in tridiagonal form, such that
|
(1.4)
|
Our goal is to extend both models 1.3 and 1.4 to arbitrary positive definite kernels on
without Toeplitz or Hankel assumptions. These models will produce parametrizations of the kernels and we will give combinatorial descriptions of these parametrizations in terms of lattice paths.
2 Isometric Hessenberg models and Dyck paths
In this section we show that any positive definite kernel on
has a Hessenberg model and then we show how to relate this model to the set of Dyck paths. In order to simplify the notation we consider only positive definite kernels for which all the inequalities in 1.1 are strict, when we say that the kernel is stricly positive definite, and we also assume
for all
. Both these assumptions can be easily removed. In addition, all our considerations can be easily adapted to kernels
, where
denotes the set of linear bounded operators on the Hilbert space
.
We now introduce the elements necesary in the presentation of the results. For a complex number
with
we define its defect by
and its Julia matrix by
We note that the Julia matrix is unitary and this construction can be extended to certain families of complex numbers as follows. Let
be a family of complex numbers such that
for all
. For simplicity we will write
instead of
. We can now describe the Hessenberg model. First we define for
,
where
denotes the
identity matrix. Then we introduce the operators
on the Hilbert space
of square-summable sequences by the formula:
where
denotes the strong operator limit. It is easily seen that each
is an isometry with upper Hessenberg matrix with respect to the standard basis of
, that is, if
denotes the
entry of
, then
for
. It is also useful to consider the unitary matrices
defined recursively by
and for
,
We can prove now the existence of an isometric Hessenberg model for any strictly positive definite kernel on
.
Theorem 2.1.
If
is a strictly positive definite kernel on
with
for all
, then there exists a family
of isometric Hessenberg operators such that for
,
|
(2.1)
|
-
Proof.
This is just a reformulation of Theorem 2.3 in [2] (see also [3] , Chapter 1). Thus, by Theorem 1.3 in [2] , there exists a uniquely determined family
of complex numbers such that
for
. Then it is easily seen from the definitions that
□
When
is a Toeplitz kernel, then 2.1 reduces to 1.3 and the parameters
satisfy
for
,
. The numbers
,
, are called the Szegö parameters of
(other names, like Schur parameters, reflection coefficients, or Verblunski parameters are currently used in the literature), and they play a central role in the theory of orthogonal polynomials on the unit circle and its many applications, [8] and, for a recent account, [6] (which also contains a detailed discussion of the Hessenberg model in the Toeplitz case).
Next we explain the connection between Hessenberg models and Dyck paths. A Dyck path of length
is a path in the positive quadrant of the lattice
which starts at
, ends at
, and consists of rise steps
and fall steps
(see Figure 1). For more information on Dyck paths and their combinatorics, see [7] .
Figure 1
. A Dyck path of length
and height
Let
be the set of Dyck paths of length
and let
be the set of points
,
, with the property that there exists
with
. It is seen that
Also, we notice that if
and
, then there are only four types of behaviour of
about
: (I) a rise step followed by a fall step; (II) a fall step followed by a rise step; (III) two consecutive rise steps; (IV) two consecutive fall steps (see Figure 2).
Figure 2
. Behaviour of a Dyck path about a vertex
Consequently, for each pair
with
we define the function
,
Let
be a Dyck path in
with the property that
. The restriction of
from
to
is called a Dyck subpath starting at
in
. The set of all possible Dyck subpaths starting at
in
is denoted by
and there exists a bijection between
and
. This implies that the number of elements in
is given by the Catalan number
also,
. If
then there could be many Dyck paths whose restrictions at
coincide with
, however if
and
are two such Dyck paths then
for
. We will write
in order to denote this common value.
We now describe the structure of the strictly positive definite kernels on
.
Theorem 2.2.
The kernel
on
with
for all
is strictly positive definite if and only if there is a family
of complex numbers,
for all
, such that
|
(2.2)
|
-
Proof.
Half of this result was proved in [1] , but we give some details here for completeness. Assume that
is strictly positive definite. By Theorem 1.3 and Theorem 2.3 in [2] there exists a uniquely determined family
of complex numbers such that
, the
entry of the matrix
. It is convenient to visualize this relation by means of a so-called transmission line, as showed in Figure 3 for
and
.
Figure 3
. Transmission line for
Thus, if
is the input at
then at
we read off the expression of
in terms of the parameters
,
,
,
,
,
and their defects,
| |
| |
Likewise, if the input at
is
, then the output at
is now the expression of
,
(for more details see [3] ). Each path in the transmission line contributes an additive term in
. Going from a path in the transmission line to a Dyck path is easy, each box associated with a Julia matrix corresponds to a point in
, see Figure 4. It is also clear that each additive term in
is given by
for some
. This gives 2.2 .
Conversely, given a family
of complex numbers with
for all
, we define
By the first part of the proof, this gives
, and it remains to show that
is a strictly positive definite kernel on
. By Theorem 2.1,
for
. This relation implies that
is a positive definite kernel. Also, by Proposition 1.7 in [2] ,
so that
is a strictly positive definite kernel on
. □
Figure 4
. From a path in a transmission line to a Dyck path
Remarks
It is quite simple to remove the two restrictions on
considered in Theorem 2.2 . First, formula 2.2 still provides a one-to-one correspondence between the set of positive definite kernels on
with
for all
and the set
of families
of complex numbers with the properties:
for all
; if
for some pair
, then
for
and
for
.
If we remove the assumption that
for all
, then the diagonal elements
of the kernel
could be considered as parameters and there is a one-to-one correspondence between the positive definite kernels on
and the set
of pairs
, where
for all
and
is an element of
with the additional property that if
for some
, then
and
for
and
. Formula 2.2 has to be replaced in this case with:
|
(2.3)
|
In case
is a Toeplitz kernel we noticed already that
for
,
and we denoted
,
. We conclude that
for
,
and formula 2.2 reduces to
|
(2.4)
|
We can compare this result with a classical formula of Verblunsky, according to which there exists a polynomial
with integer coeffcients so that
(see [6] , in particular, pg. 60-61, for a comprehensive discussion of this formula).
We see that the term
corresponds to the path
made of
consecutive rise steps followed by
consecutive fall steps. Consequently, we deduce from 2.4 that
an explicit formula that explains some of the features of
.
3 Near tridiagonal models
In this section we show that positive definite kernels do not have tridiagonal models. Instead we introduce a near tridiagonal model and then we show how this model is related to the set of Lukasiewicz paths. Again, in order to simplify the notation we consider only strictly positive definite kernels
and we assume
. We denote by
the vector space generated by the standard basis of
and we call tridiagonal model of
a family
of tridiagonal operators (not necessarely bounded),
such that
and
|
(3.1)
|
Also, in analogy with the Hankel case, we ask
,
. Since each
is tridiagonal,
so 3.1 makes sense. However we have the following result.
Theorem 3.1.
There are strictly positive definite kernels with no tridiagonal model.
-
Proof.
We consider a strictly positive definite kernel
with
(it is easy to construct such a kernel using, for instance, Theorem 2.2 ). Let
be a tridiagonal model of
, then we deduce that
which implies
| |
| |
a contradiction showing that
has no tridiagonal model. □
We are now trying to find a model as close as possible of being tridiagonal, which should reduce to 1.4 in case the kernel
is Hankel. Thus, we consider operators (not necessarely bounded) with matrix still of Hessenberg form
|
(3.2)
|
with respect to the standard basis of
, and with the additional conditions:
|
(3.3)
|
We see that
for each
. We call such a family
a near tridiagonal model of the kernel
provided that
|
(3.4)
|
Theorem 3.2.
Any strictly positive definite kernel has a near tridiagonal model.
-
Proof.
Let
be a kernel and
. Then
is strictly positive definite if and only if
,
(as already mentioned we can assume without loss of generality that
). Let
be the upper triangular Cholesky factor of
, therefore
and
. The uniqueness of the Cholesky factor implies that
and
for
, so we can drop the label
in
. We now construct the near tridiagonal model of
. Thus we prove by induction on
that there exist numbers
,
,
,
,
, such that 3.3 holds and
|
(3.5)
|
where
and
denotes the column with
zero entries.
For
we define
so that
. Assume the statement is true up to
. We determine the numbers
,
, and
,
, such that
By the induction hypothesis
so that we must have
|
(3.6)
|
where
,
,
are numbers uniquely determined by
,
, and
,
. Since
, 3.6 uniquely determine the numbers
,
,
,
and
such that 3.5 holds for
.
Now we can use all the numbers
,
,
in order to define
by 3.2 and then 3.5 shows that
is a near tridiagonal model of
. □
We notice that the label
of the numbers
,
,
is superfluous due to the conditions 3.3 . We used it in order to have a uniform definition of
in 3.2 but we will drop it from now on. The proof of Theorem 3.2 gives a one-to-one correspondence between the set of strictly positive definite kernels on
with
and the set
of families of numbers
. We will call these numbers the Jacobi parameters of
. In addition, we can easily characterize the strictly positive definite Hankel kernels by the additional conditions on the Jacobi parameters:
|
(3.7)
|
In this case the near tridiagonal model reduces to 1.4 .
The next task is to establish an explicit formula for the Cholesky factors
in terms of the Jacobi parameters. First, we obtain a recursive relation for
.
Lemma 3.3.
For
,
where
-
Proof.
We have
and then
Assume the statement is true up to
. Then
By the induction hypothesis,
and we notice that
so that
□
The matrices
have a very simple recursive multiplicative structure. Actually it is convenient to make the dependence of
on the Jacobi parameters more explicit and introduce
for
and
. In particular,
. We show that the building blocks of
(consequently, of
) are the
matrices
and the
matrices
Lemma 3.4.
For
and
,
where
-
Proof.
The proof is a straightforward calculation and can be omitted. □
Once again it is convenient to visualize all those matrix multiplications by means of a transmission line picture similar to the one in Figure 3. Thus, Figure 5 illustrates how to calculate
by using Lemma 3.3 and Lemma 3.4 . In particular, if
is the imput at
then at
we read the expression of
in terms of the Jacobi parameters,
Figure 5 suggests a connection with weighted Lukasiewicz paths. A Lukasiewicz path of length
is a path in the positive quadrant of the lattice
which starts at
, ends at
, and consists of rise unit steps, horizontal unit steps, and fall steps of arbitrary depth. Let
denote the set of Lukasiewicz paths of length
.
Figure 5
. Transmission line representation for
We also consider
the set of paths of length
in the positive quadrant, starting at
and consisting of the same type of steps as above, but ending at
. We introduce a weigth on the elements of
as follows. Let
consists of steps
,
,
. Then
and
Figure 6
. Passing from paths of length
to paths of lentgh
Theorem 3.5.
The Cholesky factor
is given by the formula
|
(3.8)
|
-
Proof.
We can prove the statement by induction on
. For
, 3.8 is seen from Figure 5. The general induction step is provided by Lemma 3.3 . Thus,
| |
| |
| |
and these relations are precisely those obtained by passing from weighted paths of length
to weighted paths of length
, as showed in Figure 6. □
Remarks
For a Hankel kernel
, Theorem 3.5 reduces to well-known results in the combinatorial theory for orthogonal polynomials (on the real line), [4] , [9] . Indeed, by 3.7 there are no fall steps of depth other than one. In this case, the summation in 3.8 is only over Motzkin paths, which is the classical formula in [4] , [9] . It might be interesting to note that the correpsonding formula for orthogonal polynomials on the unit circle, 2.4 , involves summation over labelled configurations in
rather than over weighted paths.
There are other significant differences between the two parametrizations discussed in this paper. For instance, the parameters
have the following inheritance property: the parameters of the kernel
are precisely
.
The Jacobi parameters do not have such a property. Another difference involves computations of determinants. Thus, we have already notice the formula (we assume
):
and from Lemma 3.3 we deduce
which does not involve all the Jacobi parameters (up tu
). So the first determinant formula is much tighter in its parameters.
Theorem 3.5 gives, in particular, that
|
(3.9)
|
Since the Jacobi parameters do not have the inheritance property mentioned above, we cannot have formulae of this type for any
. Instead we have the following construction.
For
fixed we consider admissible steps in the psitive quadrant of the following types: between the vertical lines
and
only of Lukasiewicz type are allowed and between the vertical lines
and
only reflections with respect to the line
of Lukasiewicz steps are allowed (and they are weighted with the complex conjugate of the weight of the reflected Lukasiewicz step, see Figure 7).
Denote by
the set of paths in the positive quadrant of
made of admissible steps, starting at
and ending at
,
. In particular,
. The weights are defined correspondingly. With these elements, we deduce from Theorem 3.5 that
|
(3.10)
|
We notice that the proof of Theorem 2.2 gives a formula for the Cholesky factor
in terms of Dyck type paths analogous to formula 3.8 .
References
-
T. Banks, T. Constantinescu, and N. El-Sissi, Tensor algebras and displacement structure. IV. Invariant kernels, math.FA/0410491, to appear in Linear Alg. Appl.
-
T. Constantinescu, Schur analysis of positive block-matrices, in I. Schur Methods in Operator Theory and Signal Processing (I. Gohberg, Ed.), Birkhäuser, Basel, 1986, pp. 191-206.
-
T. Constantinescu, Schur Parameters, Factorization and Dilation Problems, Birkhäuser, Basel, 1996.
-
P. Flajolet, Combinatorial aspects of continued fractions, Discrete Math., 32(1980), 125-161.
-
A. N. Kolmogorov, Sur l'interpolation et l'extrapolation des suites stationaire, C. R. Acad. Sci. (Paris), 208(1939), 2043-2045.
-
B. Simon, Orthogonal Polynomials on the Unit Circle, Colloquium Publications, 54, Amer. Math. Soc., Providence, Rhode Island, 2004.
-
R. P. Stanley, Enumerative Combinatorics, Vol. 2, Cambridge Univ. Press, Cambridge, 1999.
-
G. Szegö, Orthogonal Polynomials, Colloquium Publications, 23, Amer. Math. Soc., Providence, Rhode Island, 1939.
-
G. Viennot, A combinatorial theory for general orthogonal polynomials with extensions and applications, in: Orthogonal polynomials and applications (Bar-le-Duc, 1984), 139-157, Lecture Notes in Math., 1171, Springer, Berlin, 1985.
Department of Mathematics, University of Texas at Dallas, Richardson, TX 75083 E-mail address : tiberiu@utdallas.edu Department of Mathematics, University of Texas at Dallas, Richardson, TX 75083 E-mail address : nae021000@utdallas.edu