Research supported by the Swedish Science Research Council (VR) .
<ph f="cmbx">Spherical transform and Jacobi polynomials on root systems of type BC</ph>

Genkai Zhang

Department of Mathematics, Chalmers University of Technology and Goteborg University, S-412 96 Goteborg, Sweden E-mail address : genkai@math.chalmers.se

Introduction

The Gaussian functions and the Hermite polynomials play an important role, in Fourier transform on Euclidean spaces; the Hermite polynomials diagonalize the harmonic oscillator and the corresponding Hermite type function diagonalize the Fourier transform, which make the Plancherel theory more transparent. The generalization of the Plancherel theory to any non-compact symmetric symmetric spaces has been studied intensively and in general there are still no general theory generalizing corresponding the results of Hermite polynomials and their Fourier transform, above all, no concrete orthogonal systems of functions with explicit spherical transforms are constructed. In the present paper we will establish such a theory for root system of type BC. Now associated with any root system in R r   there are two kinds of remarkable orthogonal polynomials, namely the Heckman-Opdam orthogonal polynomials giving the spectral decomposition of algebra of the Weyl group invariant polynomials of the Cherednik operators acting on certain L 2   -space on the compact space T r   , and the Macdonald-Koornwinder polynomials orthogonal with respect to certain weight functions on R r   defined as a product of Gamma functions. Part of the product is in fact the Harish-Chandra Plancherel measure for the spectral decomposition of the algebra of the Weyl group invariant polynomials of the Cherednik operators on the non-compact space R r   . In the present paper we will introduce certain canonical weight function f 2 ν ( x )   for root system of type BC, and we compute its spherical transform f 2 ν ~ ( λ )   . The product of f 2 ν ~ ( λ ) 2   with the the Harish-Chandra measure | c ( λ ) | 2   gives precisely weight functions in the Macdonald-Koornwinder orthogonality relation; we prove further, roughly speaking, that the Jacobi polynomials on the compact space, after some change of variables, and multiplied by the function f 2 ν   gives orthogonal system of the L 2   -space on the non-compact space, and that their spherical transform are of the form f 2 ν ~ ( λ ) p ( λ )   where p ( λ )   are the Macdonald-Koornwinder polynomials.
Thus the function f 2 ν   plays the role of the Gaussian functions in the Fourier analysis where as the Jacobi and Macdonald-Koornwinder polynomials plays the role of the Hermite polynomials and their Fourier transforms (up to a multiple of the Gaussian). In rank one case this has been proved earlier by Koornwinder [5.
We remark that we are studying here only the spherical transform of Weyl group invariant functions, yet we use the tools of the Cherednik operators acting on general no-invariant functions which makes the computation much easier. Some of our results can easily be generated to that setup.
Our results are motivated by the study of Berezin transform on bounded symmetric domains G / K   ([13and [14). Berezin transform appears naturally in the study of branching rule of holomorphic representations and some results here have been proved in the symmetric space case. The Berezin transform is convolution operator with the kernel h ( z , z ) ν   where h ( z , w ) ν   is the reproducing kernel for a weighted Bergman space. In the symmetric space case our function f 2 ν   is just the kernel h ( z , z ) ν   written in terms of geodesic coordinates. The Berezin transform is invariant under G   and is bounded on the L 2   -space on G / K   and is thus a function of a system of generators of invariant differential operators on G / K   , also called the symbol of the Berezin transform. The symbol is thus the spherical transform of the function h ( z , z ) ν   . It is realized in [12the orthogonality relation for the continuous dual Hahn 3 F 2   are Clebsch-Gordan coefficients for the tensor product of holomorphic and anti-holomorphic representations and that the orthogonality measure is actually the product of the Harish-Chandra measure | c ( λ ) | 2   with the spectral symbol of Berezin transform, which has been computed earlier by Unterberger and Upmeier [8. The Macdonald-Koornwinder polynomials are the multi-variable generalization of the Wilson's 4 F 3   hypergeometric orthogonal polynomials, and the orthogonal relation for the above 3 F 2   orthogonal polynomials can be viewed as the degenerate case of the 4 F 3   -orthogonality relation [9. In this sense the orthogonality relation of the Macdonald-Koornwinder polynomials can be viewed as the most general case, our result in this paper concludes that the relation can be obtained from the more well-understood orthogonality of the Jacobi type polynomials and the Plancherel formula, by introducing the weight function.
The paper is organized as follows. In Section 1 we recall the Plancherel formula for Opdam-Cherednik transform. In Section 2 we find certain Bernstein-Sato type formula for the so-called canonical function f δ   . Its spherical transform is computed in Section 3. Finally we compute the spherical transform of certain Jacobi-type polynomials in Sections 4 and 5.
It is our belief that most results in this paper can be generalized to general root systems, that will provide a theory of Hermite-type functions on non-compact space and thus bring together the orthogonal polynomials on compact torus and spherical transform on non-compact space.
I would like to thank Professors Jacques Faraut, Toshiyuki Kobayashi, Erik Opdam and Harald Upmeier for some helpful discussions.

1 Spherical transform and Plancherel formula

Let a = R r   be an Euclidean space with inner product ( , )   and let R a *   be a root system of type BC. A prototype of such root systems is the restricted root system of a bounded symmetric domain. We use some familiar notation, in order to be consistent with the notation in the context of bounded symmetric domain and also in the context of Plancherel formula for general root system [7. We fix an orthonormal basis { ξ j } 1 r   of a   and a dual basis { ɛ j }   of a *   , i.e., ɛ j ( ξ k ) = δ j k   , so that the root system is of the form R = { 2 ɛ j ; j = 1 , , r } { 4 ɛ j ; j = 1 , , r } { 2 ( ɛ j ± ɛ k ) ; j k = 1 , , r }   , with respective multiplicities ( k 1 , k 2 , k 3 )   satisfying 2 ( k 1 , k 2 , k 3 ) = ( 2 b , ι , a ) .   We assume that ι , a , b > 0   . We order the roots so that ɛ 1 > ɛ 2 > > ɛ r > 0   .
The Weyl group is then W = S r × Z 2 r   consisting of signed permutation o { ξ j }   . Let ρ = 1 2 α R + k α α   be the half sum of positive roots. Then ρ = j = 1 r ρ j ɛ j = j = 1 r ( ι + b + ( r j ) a ) ɛ j .   We recall briefly in this section the Plancherel formula for the spherical transform associated to the root system R   developed by Heckman and Opdam ([4, [3and [7).
Let d μ   be the measure d μ ( t ) = d μ k ( t ) = α R + | 2 sinh ( 1 2 α ( t ) | 2 k α d t   on a   , and let L 2 ( a ) = L 2 ( a , d μ )   and L 2 ( a ) W   be the corresponding L 2   space and its subspace of W   -invariant functions.
Let
D j = j a i < j 1 1 e 2 ( t i t j ) ( 1 s i j ) + a j < k 1 1 e 2 ( t j t k ) ( 1 s j k ) + a i j 1 1 e 2 ( t j + t k ) ( 1 σ j k ) + 2 ι 1 1 e 4 t j ( 1 σ j ) + 2 b 1 1 e 2 t j ( 1 σ j ) ρ ( ξ j )
be the Cherednik operators acting on functions f ( t )   on a C   , where we identify a function f ( t )   on a C   with f ( t 1 , , t r )   , for t = t 1 ξ 1 + + t r ξ r   . Here s i j , σ i j , σ i   are the elements in the Weyl group, s i j = ( i j )   being the permutation of ξ i   and ξ j   , σ i j   the signed permutation, σ i j ( ξ i ) = ξ j , σ i j ( ξ j ) = ξ i   , σ i   the reflection σ i ( ξ i ) = ξ i   , and all mapping ξ k ξ k   for k i , j   . For later purpose we will also rewrite it as
D j = j a i < j e t i t j e t i t j e ( t i t j ) ( 1 s i j ) + a j < k e t j t k e t j t k e ( t j t k ) ( 1 s j k ) + + a i j e t j + t k e t j + t k e ( t j + t k ) ( 1 σ j k ) + 2 ι e 2 t j e 2 t j e 2 t j ( 1 σ j ) + 2 b e t j e t j e t j ( 1 σ j ) ρ j .
The operators { D j }   are then commuting, and the decomposition of L 2 ( a )   with respect to the eigenfunctions of { D j }   is given by Opdam [7in terms of the so-called Cherednik-Opdam, formulated in terms of decomposing representations of a Hecke algebra. We will mostly be concerned with the decomposition of L 2 ( a ) W   under W   -invariant polynomials of D j , j = 1 , , r   , which is given by spherical transform in terms of the Heckman-Opdam theory of hypergeometric functions ([4and [3); we shall however use the operators D j   (in place of their symmetric polynomials) to compute the spherical transform of symmetric functions.
For λ ( a * ) C   let φ λ   be as in [7the spherical function. In particular
p ( D 1 , , D r ) φ λ = p ( λ ( ξ 1 ) , , λ ( ξ r ) ) φ λ , (1.1)
for any W   -invariant polynomial p   . The spherical transform of a function f L 2 ( a ) W   is f ~ ( λ ) = a f ( t ) φ λ ( t ) d μ ( t ) .   The corresponding Plancherel measure is given by d μ ~ ( λ ) = ( 2 π ) r c 0 2 c ( λ ) c ( λ ) d λ ,   where c ( λ ) = r j = 1 Γ ( λ j + b ) Γ ( 2 λ j ) Γ ( λ j + b + ι 2 ) Γ ( 2 λ j + 2 b ) r 1 j < k r Γ ( λ j ± λ k ) Γ ( λ j ± λ k + a 2 )   and c 0 = c ( ρ ) = r j = 1 Γ ( ρ j + b + 1 ) Γ ( 2 ρ j + 1 ) Γ ( ρ j + b + ι 2 + 1 ) Γ ( 2 ρ j + b + 1 ) r 1 j < k r Γ ( ρ j ± ρ k + 1 ) Γ ( ρ j ± ρ k + a 2 + 1 ) .   Namely, we have
a | f ( t ) | 2 d μ ( t ) = i a * | f ~ ( λ ) | 2 d μ ~ ( λ ) . (1.2)

2 Bernstein-Sato type formula for the function f δ  

We define the weight function f δ   on a   by f δ ( t ) = r j = 1 cosh δ t j .   Motivated by the Berezin transform ([8, [10, [13) we call f δ   the canonical function. In the case of bounded symmetric domains f δ   is the integral kernel of the Berezin transform considered as a convolution operator defining the so-called canonical representations, and is the analogue of the Gaussian functions in the Euclidean space, see loc. cit..
In this section we prove the following Bernstein-Sato type formula:
Theorem 2.1. There is a W   -invariant polynomials of the Cherednik operators D j   mapping the canonical function f δ   to f δ 2   ; more precisely, we have
r j = 1 ( D j 2 ( δ + ρ ( ξ 1 ) ) 2 ) f δ = r j = 1 ( δ + a ( j 1 ) ) ( 1 δ ι a ( r j ) ) f δ 2 (2.1)
The proof of it will be divided into two technical lemmas.
Lemma 2.2. The following formula holds j l = 1 ( D l + δ + ρ ( ξ 1 ) ) f δ ( t ) = j l = 1 ( δ + a ( l 1 ) ) f δ ( t ) j l = 1 ( 1 + tanh t l )  
  • Proof. We prove the lemma by induction on j   . First we have, since f δ   is Weyl group invariant, D 1 f δ = δ tanh t 1 f δ ρ ( ξ 1 ) f δ ,   where we use d d t cosh t = tanh t cosh t   . Rewriting, ( D 1 + δ + ρ ( ξ 1 ) ) f δ = δ ( 1 + tanh t 1 ) f δ ,   which is the claim for j = 1   . Assume that the equality is true for l = 1 j 1 ( D l + ( δ + ρ ( ξ 1 ) ) )   .
    We consider it for j   in place of j 1   . We need to compute the operator D j + δ + ρ ( ξ 1 )   on the function f δ l = 1 j 1 ( 1 + tanh t l )   . This function is invariant under the permutations of the first j 1   coordinates and the signed permutations of the last r j   coordinates.
    Thus
    D j f δ l j 1 ( 1 + tanh t l ) = δ tanh t j f δ l j 1 ( 1 + tanh t l ) a f δ i < j e t i t j e t i t j e ( t i t j ) ( tanh t i tanh t j ) l j 1 , l i ( 1 + tanh t l ) + a f δ i < j e t i + t j e t i + t j e ( t i + t j ) ( tanh t i + tanh t j ) l j 1 , l i ( 1 + tanh t l ) ρ ( ξ j ) f δ l j 1 ( 1 + tanh t l ) .
    Using the formulas tanh x ± tanh y = sinh ( x ± y ) cosh x cosh y   and e x = ( 1 + tanh x ) cosh x   we see that the sum of the i   th terms in the two summations is, apart form the factor a f δ l j 1 , l i ( 1 + tanh t l )   ,
    e t i + t j e t i + t j e ( t i + t j ) ( tanh t i + tanh t j ) e t i t j e t i t j e ( t i t j ) ( tanh t i tanh t j ) = 2 ( 1 + tanh t i ) tanh t j ,
    and thus
    D j f δ l j 1 ( 1 + tanh t l ) = ( ( δ + a ( j 1 ) ) tanh t j ρ ( ξ j ) ) f δ l j 1 ( 1 + tanh t l ) .
    It follows then that
    ( D j + δ + ρ ( ξ 1 ) ) f δ l j 1 ( 1 + tanh t l ) = ( δ + a ( j 1 ) ) f δ l j ( 1 + tanh t l ) + ( ρ ( ξ 1 ) ρ ( ξ j ) a ( j 1 ) ) f δ l j 1 ( 1 + tanh t l ) .
    But ρ ( ξ j ) = ι + b + a ( r j )   so the second term vanishes and this completes the proof.
Lemma 2.3. The following formula holds
l j ( D l ( δ + ρ ( ξ 1 ) ) ) f δ 1 e t 1 + + t r = l j ( 1 δ ι a ( r l ) ) f δ 1 e t 1 + + t r l j ( 1 tanh t l )
Accepting temporarily the Lemma, we prove Theorem  2.1 . We write the LHS as r l = 1 ( D l ( δ + ρ ( ξ 1 ) ) ) r l = 1 ( D l + ( δ + ρ ( ξ 1 ) ) ) f δ   Taking j = r   in Lemma  2.2 we see that l = 1 r ( D l + ( δ + ρ ( ξ 1 ) ) ) f δ   is, disregarding the constant, given by, f δ r l = 1 ( 1 + tanh t j ) = f δ 1 e t 1 + + t r .   Theorem  2.1 then follows from Lemma  2.3 for j = 1   , by using the identity f δ 1 e t 1 + + t r r j = 1 ( 1 tanh t j ) = f δ 2 .   It remains to proof the Lemma.
  • Proof. We first compute D r   and use induction backward. We have
    D r f δ 1 e t 1 + + t r = f δ 1 l r e t l + ( δ 1 ) f δ 1 tanh t r l r e t l + a f δ 1 i < r e t i + t r e t i + t r e ( t i + t r ) ( e t i + t r e ( t i + t r ) ) l r , l i , r e t l + + 2 ι f δ 1 e 2 t r e 2 t r e 2 t r ( e t r e t r ) l r 1 e t l + + 2 b f δ 1 e t r e t r e t r ( e t r e t r ) l r 1 e t l ρ ( ξ r ) f δ 1 l r e t l .
    The third term can be simplified as a ( r 1 ) f δ 1 l r e t l ,   and the next two terms are ι tanh t r f δ 1 l r e t l + ( ι + 2 b ) f δ 1 l r e t l .   So that the previous formula is then
    ( δ 1 + ι ) tanh t r f δ 1 l r e t l + ( 1 + ι + 2 b + a ( r 1 ) ρ ( ξ r ) ) f δ 1 l r e t l = ( δ 1 + ι ) tanh t r f δ 1 l r e t l + ( 1 + b + ρ ( ξ 1 ) ρ ( ξ r ) ) f δ 1 l r e t l
    and consequently
    ( D r ( ρ 1 + δ ( ξ 1 ) ) ) f δ 1 e t 1 + + t r = ( δ 1 + ι ) tanh t r f δ 1 l r e t l + ( 1 + b δ ρ ( ξ r ) ) f δ 1 l r e t l = ( δ 1 + ι ) ( tanh t r 1 ) f δ 1 l r e t l ,
    since 1 + b δ ρ ( ξ r ) = ( δ 1 + ι )   . This is the Lemma for j = r   .
    Assume the lemma is true for the action of l j + 1 ( D l ( δ + ρ ( ξ 1 ) ) )   . We compute ( D j ( δ + ρ ( ξ 1 ) ) ) f δ 1 l j + 1 ( 1 tanh t l ) l r e t l   and find it is ( 1 tanh t j ) ( a ( r j ) + ι + δ 1 ) f δ 1 l j ( 1 tanh t l ) l r e t l   by a straightforward yet tedious computation.
Remark 2.4. Consider the double Hecke algebra generated by the Cherednik operators and the group ring C [ W ]   and by C [ P ]   of polynomials e ɛ j   as multiplication operators on C [ P ]   . Some refinements of the above computation then gives certain commutation relations of the Cherednik operators with e ɛ 1 + + ɛ r   , which might be of independent interests. This Theorem (or its equivalent version under the spherical transform, see the proof of Theorem 3.2) can possibly be obtained also by using intertwining relations of the Cherednik-Opdam transform with the double Hecke algebras proved by Cherednik [1, it would involves nevertheless many intriguing computations.

3 Spherical transform of the function f δ  

In this section we shall use Bernstein-Sato type formula for the function f 2 ν   to derive a recursive formula for its spherical transform f 2 ν ~ ( λ )   (for sufficiently large ν   ).
By using a limit formula we then derive a product and, consequently, a Gamma function formula for f ~ 2 ν ( λ )   .
Denote Γ a ( σ ) = r j = 1 Γ ( σ a 2 ( j 1 ) ) ,   which in the symmetric domain case is the Gindikin Gamma function; it will be used to simplify certain product formulas.
We compute first some normalization constant, which corresponds to the spherical transform of f 2 ν   at λ = ρ   .
Lemma 3.1. Let ν > ι + b + a ( r 1 )   . The integral N ν = a f 2 ν ( t ) d μ ( t )   is given by
N ν = 2 r ( 2 ι + 2 b + a ( r 1 ) r ! Γ a ( ι + 1 + 2 b + a ( r 1 ) 2 ) × Γ a ( ν ( a 2 ( r 1 ) + ι + b ) ) Γ a ( ν + 1 ι 2 ) 1 i < j r Γ ( a 2 ( j i + 1 ) Γ ( k 3 2 ( j i ) .
  • Proof. This follows from the Opdam proof of the Macdonald's conjecture. By symmetry we need only to integrate over all s = ( s 1 , , s r )   with s j 0   . Making the change of variables z j = tanh 2 t j   , we find first that
    N ν = 2 ( 2 ι + 2 b + a ( r 1 ) ) r [ 0 , 1 ] r | i < j ( z i z j ) a | r i = 1 z i ι + 2 b 1 2 r i = 1 ( 1 z i ) ν ( 1 + ι + b + a ( r 1 ) ) d z 1 d z r
    which is evaluated by the beta integral (see [6,Ex.7,Sect.10,Chapt.VII) that
    [ 0 , 1 ] r | i < j ( t i t j ) a | r i = 1 t i α a 2 ( r 1 ) 1 r i = 1 ( 1 t i ) β a 2 ( r 1 ) 1 d t 1 d t r = r ! 1 i < j r Γ ( a 2 ( j i + 1 ) Γ ( a 2 ( j i ) Γ k ( α ) Γ k ( β ) Γ k ( α + β ) .
In particular it follows that N ν + 1 N ν = r j = 1 ν ( a 2 ( r 1 ) + ι + b ) a 2 ( j 1 ) ν + 1 ι 2 a 2 ( j 1 ) .   Changing j 1   to r j   and using ρ ( ξ 1 ) = ι + b + a ( r 1 )   , we can rewrite it as the following
N ν + 1 N ν = r j = 1 ν 1 2 ρ ( ξ 1 ) 1 2 ( ι + b + a ( j 1 ) ) ν + 1 ι 2 a 2 ( j 1 ) . (3.1)
Theorem 3.2. Let ν > ι + b + a ( r 1 )   . The spherical transform of f 2 ν   is given by f 2 ν ~ ( λ ) = N ν r j = 1 Γ ( ν 1 2 ρ ( ξ 1 ) ± 1 2 λ ( ξ j ) ) Γ ( ν 1 2 ρ ( ξ 1 ) ± 1 2 ( ι + b + a ( j 1 ) ) ) , λ i a * .  
The following result is elementary and we omit its proof; it is proved in [11in the case when the root system corresponds to a bounded symmetric domain.
Lemma 3.3. Let φ   be a bounded and continuous function on a   . Then lim ν 1 N ν a f 2 ν ( t ) φ ( t ) d μ ( t ) = φ ( 0 )  
We prove now Theorem 3.2.
  • Proof. We write β ν ( λ ) = f 2 ν ~ ( λ ) N ν   and compute it in terms of β ν + 1 ( λ )   . We note first that it is well-defined for λ i a *   . Indeed the spherical function φ λ ( t )   is a bounded function [7, and the function f 2 ν   is in L 1 ( a * , d μ )   by Lemma 3.1. We perform the spherical transform on the identity ( 2.1 ) with δ = 2 ν   . Using ( 1.1 ) we have, r j = 1 ( λ ( ξ j ) 2 ( 2 ν + ρ ( ξ 1 ) ) 2 ) β ν ( λ ) = r j = 1 ( 2 ν + a ( j 1 ) ) ( 1 + 2 ν ι a ( r j ) ) β ν + 1 ( λ ) ,   and
    β ν ( λ ) = r j = 1 ( 2 ν + a ( j 1 ) ) ( 1 + 2 ν ι a ( r j ) ) ( λ ( ξ j ) 2 ( 2 ν + ρ ( ξ 1 ) ) 2 ) β ν + 1 ( λ ) = r j = 1 ( ν a 2 ( j 1 ) ) ( ν + 1 ι 2 a 2 ( r j ) ) ( ( ν 1 2 ρ ( ξ 1 ) + 1 2 λ ( ξ j ) ) ( ( ν 1 2 ρ ( ξ 1 ) + 1 2 λ ( ξ j ) ) β ν + 1 ( λ )
    We write further the denominator as
    r j = 1 ( ν a 2 ( j 1 ) ) ( ν + 1 ι 2 a 2 ( r j ) ) = r j = 1 ( ν 1 2 ρ ( ξ 1 ) + 1 2 ( ι + b + a ( j 1 ) ) ( ν + 1 ι 2 a 2 ( j 1 ) ) .
    Thus β ν ( λ ) = N ν + 1 N ν r j = 1 ( ν 1 2 ρ ( ξ 1 ) + 1 2 ( ι + b + a ( j 1 ) ) ) ( ν + 1 ι 2 a 2 ( j 1 ) ) ( ν 1 2 ρ ( ξ 1 ) + 1 2 λ ( ξ j ) ) ( ν 1 2 ρ ( ξ 1 ) 1 2 λ ( ξ j ) ) β ν + 1 ( λ ) .   Using ( 3.1 ) this becomes
    β ν ( λ ) = β ν + 1 ( λ ) r j = 1 ( ν + 1 2 ρ ( ξ 1 ) + 1 2 ( ι + b + a ( j 1 ) ) ) ( ν + 1 2 ρ ( ξ 1 ) 1 2 ( ι + b + a ( j 1 ) ) ) ( ν 1 2 ρ ( ξ 1 ) + 1 2 λ ( ξ j ) ) ( ν 1 2 ρ ( ξ 1 ) 1 2 λ ( ξ j ) ) = β ν + 1 ( λ ) r j = 1 ( 1 + 1 2 ( ι + b + a ( j 1 ) ) ν 1 2 ρ ( ξ 1 ) ) ( 1 1 2 ( ι + b + a ( j 1 ) ) ν 1 2 ρ ( ξ 1 ) ) × ( 1 + 1 2 λ ( ξ j ) ν 1 2 ρ ( ξ 1 ) ) 1 ( 1 1 2 λ ( ξ j ) ν 1 2 ρ ( ξ 1 ) ) 1 .
    Iterating we find
    β ν ( λ ) = β ν + k ( λ ) k l = 1 r j = 1 ( 1 + 1 2 ( ι + b + a ( j 1 ) ) ν + l 1 1 2 ρ ( ξ 1 ) ) ( 1 1 2 ( ι + b + a ( j 1 ) ) ν + l 1 1 2 ρ ( ξ 1 ) ) × ( 1 + 1 2 λ ( ξ j ) ν + l 1 1 2 ρ ( ξ 1 ) ) 1 ( 1 1 2 λ ( ξ j ) ν + l 1 1 2 ρ ( ξ 1 ) ) 1
    However 1 N ν + k b ν + k ( λ ) 1   as k   by Lemma 3.3 since the function φ λ ( t )   is a continuous bounded function for λ i a *   . We get thus
    β ν ( λ ) = l = 1 r j = 1 ( 1 + 1 2 ( ι + b + a ( j 1 ) ) ν + l 1 1 2 ρ ( ξ 1 ) ) ( 1 1 2 ( ι + b + a ( j 1 ) ) ν + l 1 1 2 ρ ( ξ 1 ) ) × ( 1 + 1 2 λ ( ξ j ) ν + l 1 1 2 ρ ( ξ 1 ) ) 1 ( 1 1 2 λ ( ξ j ) ν + l 1 1 2 ρ ( ξ 1 ) ) 1 .
    Our result follows rewriting the infinite product in terms of the Gamma function, using Γ ( A ) Γ ( B ) Γ ( A + C ) Γ ( B C ) = s = 0 ( 1 + C A + s ) ( 1 C B + s ) ;   see [2,p.5.
Remark 3.4. The function f 2 ν ~ ( λ )   for ν   as above has exponential decay and is a bounded function for λ i a *   , and holomorphic in a strip around i a *   . We can then define the Berezin transform on L 2 ( a , d μ ) W   by the inverse spherical transform, namely B ν F ( t ) = f 2 ν ~ ( λ ) F ~ ( λ ) φ λ ( t ) | c ( λ ) | 2 d λ .   B ν   is then a bounded and positive operator and it has an integral kernel B ( t , s )   . In particular B ( t , 0 ) = f 2 ν ( t )   . It follows then from the selfadjoint property of B   that B ( x , y ) = f 2 ν ( t ) f 2 ν ( s ) L ( t , s )   . It would be interesting to find a series expansion for the kernel L ( t , s )   in terms of the Jack symmetric polynomials (in the variables ( tanh 2 t 1 , , tanh 2 t r )   ). In the case of bounded symmetric domain, this is indeed possible, some degenerate cases of the expansion has been studied in [14.

4 Spherical transform of a class of functions

We shall compute the spherical transform of a class of functions of the form f 2 ν ( t ) p ( x 1 2 , , x r 2 ) , x j = tanh t j , j = 1 , , r ,   where p ( x 1 2 , , x r 2 )   is a symmetric polynomial in ( x 1 , , x r )   . We will prove that they are of the form f 2 ν ~ ( λ ) q ( λ )   where q   is a symmetric polynomial in ( λ 1 2 , , λ r 2 )   .
Eventually we will specify p   to be Jacobi-type polynomials in the next section.
We denote D j   the conjugation of D j   by the canonical function f δ   , D j = D j ( δ ) = f δ D j f δ , j = 1 , , r .   The operator D j ( δ )   under the change of variables x j = tanh t j   has the form
D j = δ x j + ( 1 x j 2 ) j a 2 i < j 1 + x i x j x i x j x i x j ( 1 s i j ) + a 2 j < k 1 + x j x k x i x j x j x k ( 1 s j k ) + a 2 k j 1 + x j + x k + x i x j x j + x k ( 1 σ j k ) + ι ( 1 + 1 2 ( x j + 1 x j ) ) ( 1 σ j ) + b ( 1 + 1 x j ) ( 1 σ j ) ρ j
We fix now the Bruhat ordering of the symmetric group S r   of r   elements with generators ( 1 , 2 ) , ( 2 , 3 ) , . . . , ( r 1 , r )   . The corresponding partial ordering on the set N r   of all r   -tuples of non-negative integers is then defined by the following: For any η   let η *   be the unique partition in the S r   -orbit of η   , and w η   the unique element in S r   with shortest length such that η = w η η *   . Then we define η μ   if η * μ *   , and if w η w ξ   when η * = μ *   .
The following lemma can be proved by direct computation, it is similar to the known results that the actions of the operators D j   on C [ P ]   are upper triangular.
Lemma 4.1. The action of the operators D j   on the monomials x η = x 1 η 1 x r η r   , η N r   , preserves the order in the sense that D j x η = a η j , η x η j + ζ < η j a ζ , η x ξ ,   where η j = η + ( 0 , , 0 , 1 , 0 , , 0 )   and where the leading coefficient is a η j , η = δ + a # { i < j : η i > η j } + ι 2 ( 1 ( 1 ) η j ) .  
Using the above lemma we can compute D 1 2 η 1 D r 2 η r 1   successively and get
D 1 2 η 1 D r 2 η r 1 = d η x 2 η + lower terms . (4.1)
where
d η = r j = 0 η j 1 k = 0 ( δ + ( r j ) 2 k ) ( δ + ( r j ) a + ι 1 2 k ) (4.2)
and where the “lower terms” here stands for a linear combination of x 1 μ 1 x r μ r   with μ 2 η   . Denoting m η   the symmetric power sum
m η ( y 1 , , y r ) = ζ S r η y 1 ζ 1 y r ζ r (4.3)
and taking summation of ( 4.1 ) over all permutations ζ S r η   of η   , we have,
Lemma 4.2. The operators m η ( D 1 2 , , D r 2 )   acting on the constant monomial 1   gives m η ( D 1 2 , D r 2 ) 1 = d η m η ( x 1 2 , x r 2 ) + lower terms ,   where the “lower terms” here stands for a linear combination of symmetric power sums m η   of x 1 2 , , x r 2   with η η   .
Proposition 4.3. Let ν > ι + b + a ( r 1 )   and let η : η 1 η 2 η r 0   be a partition. The spherical transforms of a function f 2 ν ( t ) m η ( tanh 2 t 1 , , tanh 2 t r )   is given by f 2 ν ~ ( λ ) l η ( λ ) ,   and l η ( λ )   is W   -invariant polynomial of λ   with leading term d η 1 m η ( λ ( ξ 1 ) 2 , , λ ( ξ r ) 2 )   .
  • Proof. We apply Lemma 4.2 for δ = 2 ν   . Observe that d η 0   for any partition η   . It follows that for each partition η   , m η ( x 1 2 , , x r 2 ) = d 2 η 1 m η ( D 1 2 , D r 2 ) 1 + η η c η , η m η ( D 1 2 , D r 2 ) 1 .   In other words f 2 ν m η ( x 1 2 , , x r 2 ) = d 2 η 1 m η ( D 1 2 , , D r 2 ) f 2 ν + η η c η , η m η ( D 1 2 , , D r 2 ) f 2 ν .   For each ζ   , the spherical transform of m ζ ( D 1 2 , , D r 2 ) f 2 ν   is given by, in view of ( 1.1 ), m ζ ( λ ( ξ 1 ) 2 , , λ ( ξ r ) 2 ) f 2 ν ~ ( λ ) .   Our result then follows from the previous formula.

5 Jacobi type functions and Macdonald-Koornwinder polynomials

We recall briefly the Heckman-Opdam theory on Jacobi polynomials. We will then construct certain functions of Jacobi type and prove that their spherical transforms are Macdonald-Koornwinder type polynomials.
Let ν > ι + b + a ( r 1 )   . Consider now the same root system R = { 2 ɛ j ; j = 1 , , r } { 4 ɛ j ; j = 1 , , r } { 2 ɛ j ± ɛ k ; j k = 1 , , r }   with the same ordering and with respective multiplicities k ( ν ) = ( k 1 ( ν ) , k 2 ( ν ) , k 3 ( ν ) )   , such that 2 k 2 ( ν ) = 2 ( 2 ν ( 1 + ι + b + a ( r 1 ) ) ) + 1 , 2 ( k 1 ( ν ) + k 2 ( ν ) ) = ι + 2 b , 2 k 3 ( ν ) = a .   (Note that one of the multiplicities, k 1 ( ν )   , is negative, however they still satisfy the condition k α + k α 2 0   , α R   , see [7.) The corresponding dual coroot lattice is 1 2 ( Z ɛ 1 + + Z ɛ r ) = ( 1 2 Z ) r   and weight lattice is P = 2 ( Z ɛ 1 + + Z ɛ r ) = ( 2 Z ) r   . The set of dominant weights is P + = { 2 ( η 1 ɛ 1 + + η r ɛ r ) ; η = ( η 1 , , η r ) N r , η 1 η r 0 } ,   and for simplicity we will index the elements in P +   by the partitions η N r   .
The polynomial algebra C [ P ]   of integral weights is then the polynomial algebra generated by e ± 2 ɛ j , j = 1 , , r   . Consider the inner product in the space C [ P ]   ,
( f , g ) k ( ν ) = [ 0 , π ] r f ( s ) g ( s ) ¯ | δ k ( ν ) ( s ) | d s , (5.1)
where δ k ( ν ) ( s ) = α R | 2 sin 1 2 α ( s ) ) | 2 k α ( ν )   .
We recall first the Heckman-Opdam theory of Jacobi polynomials, see [4, [3, [7. The partial ordering on the weight lattice P   defined in terms by the ordering of the roots will be denoted (with some abuse of notation) also by   .
Lemma 5.1. For each η = ( η 1 , , η r ) N r   , η 1 η r 0   , there exists a unique polynomial P ν , η   on T   such that P ν , η = p η W + η < η c η , η p η W   and ( P ν , η , p η W ) k ( ν ) = 0 ,   where p η W = w W w ( e 2 ( η 1 ɛ 1 + + η r ɛ r ) )   is the Weyl group orbit sum of the power function. The polynomials { P ν , η } η   forms an orthogonal basis for L 2 ( T , | δ k ( ν ) ( s ) | d s ) W   .
The inner product P ν , η , P ν , η k ( ν )   is explicitly computed in [4and [7.
The Jacobi polynomials on T   are symmetric with respect to the Weyl group W   , thus they are symmetric polynomials of the functions e 2 i s j + e 2 i s j 2 = cos 2 s j   , which can be further identified as symmetric polynomials of ( x 1 2 , , x r 2 )   , with
x j : = sin s j [ 1 , 1 ] , s = s 1 ξ 1 + + s r ξ r T = i R r / ( i π Z ) r . (5.2)
With some abuse of notations we denote it also by P ν , η ( x 1 , . . . , x r )   . We rewrite the characterization of P ν , η   in terms of the variables ( x 1 , . . . , x r )   .
The Jacobi polynomial P ν , η ( x 1 , . . . , x r )   is then characterized as the unique polynomials so that P ν , η ( x 1 , . . . , x r ) = 2 2 η 1 + + 2 η r m η ( x 1 2 , . . . , x r 2 ) + ζ < η c η , ζ m ζ ( x 1 2 , . . . , x r 2 )   and that ( P ν , η , m ζ ) k ( ν ) = 0 , ζ < η   where ( f , g ) k ( ν )   is the inner product ( 5.1 ) after the change of variables ( 5.2 ),
( f , g ) k ( ν ) = 2 ( 2 ι + 2 b + a ( r 1 ) ) r [ 1 , 1 ] r f ( x ) g ( x ) ¯ × i < j | x i 2 x j 2 | a j | x i 2 b + ι | j ( 1 x i 2 ) 2 ν ( 1 + ι + b + a ( r 1 ) d x 1 d x r . (5.3)
We now define the Jacobi type function on a   , H ν , η ( t ) : = f 2 ν ( t ) P ν , η ( tanh t 1 , , tanh t r )  
Lemma 5.2. The functions { H ν , η ( t ) } η   form an orthogonal basis for the space L 2 ( a ) W   and H ν , η , H ν , η L 2 ( a ) = P ν , η , P ν , η k ( ν )  
  • Proof. Changing of variables t a x ( 1 , 1 ) r   , x j : = tanh t j   in the definition of inner product in L 2 ( a )   , we get the above formula. The remainding claim follows from (the symmetric version of ) Weierstrass approximation theorem.
Theorem 5.3. The spherical transforms of the Jacobi type function H ν , η ( t )   on a   are given by f 2 ν ~ ( λ ) q η ( λ ) ,   where q η ( λ )   are constant multiples of the Macdonald-Koornwinder polynomials, and they satisfy the orthogonality relation a * f 2 ν ~ ( λ ) 2 q η ( λ ) q η ( λ ) | c ( λ ) | 2 d λ = H ν , η , H ν , η L 2 ( a ) = P ν , η , P ν , η k ( ν ) = δ η , η P ν , η , P ν , η k ( ν ) .  
  • Proof. That the spherical transform is of the given form follows from Proposition 4.3, the orthogonality relation is by the Plancherel formula ( 1.2 ), and that q η ( λ )   are the Macdonald-Koornwinder polynomials is by the uniqueness of the latter [9.
References

  1. I. Cherednik, Inverse Harish-Chandra transform and difference operators, Internat. Math. Res. Notices (1997), no. 15, 733–750. MR MR1470375 (99d:22018)
  2. A. Erdelyi et al, Higher transdental functions, vol. 1, McGraw-Hill, New York Toronto London, 1953.
  3. G. J. Heckman, Root systems and hypergeometric functions. II, Compositio Math. 64 (1987), no. 3, 353–373.
  4. G. J. Heckman and E. M. Opdam, Root systems and hypergeometric functions. I, Compositio Math. 64 (1987), no. 3, 329–352.
  5. T. H. Koornwinder, Special orthogonal polynomial systems mapped onto each other by the Fourier-Jacobi transform, Orthogonal polynomials and applications (Bar-le-Duc, 1984), Lecture Notes in Math., vol. 1171, Springer, Berlin, 1985, pp. 174–183. MR MR838982 (87g:33007)
  6. I. G. Macdonald, Symmetric functions and Hall polynomials, second ed., Clarendon Press, Oxford, 1995.
  7. E. Opdam, Harmonic analysis for certain representations of graded Hecke algebras, Acta Math. 175 (1995), no. 1, 75–121.
  8. A. Unterberger and H. Upmeier, The Berezin transform and invariant differential operators, Comm. Math. Phys. 164 (1994), 563–597.
  9. J. F. van Diejen, Properties of some families of hypergeometric orthogonal polynomials in several variables, Trans. Amer. Math. Soc. 351 (1999), no. 1, 233–270. MR MR1433128 (99c:33020)
  10. G. van Dijk and M. Pevzner, Berezin kernels and tube domains, J. Funct. Anal. 181 (2001), 189–208.
  11. G. Zhang, Berezin transform on compact hermitian symmetric spaces, Manuscripta Math. 97 (1998), no. 3, 371–388.
  12. , Invariant differential operators on hermitian symmetric spaces and their eigenvalues, Israel J. Math. 119 (2000), 157–185.
  13. , Berezin transform on real bounded symmetric domains, Trans. Amer. Math. Soc. 353 (2001), 3769–3787.
  14. , Branching coefficients of holomorphic representations and Segal-Bargmann transform, J. Funct. Anal. 195 (2002), 306–349.

Department of Mathematics, Chalmers University of Technology and Goteborg University, S-412 96 Goteborg, Sweden E-mail address : genkai@math.chalmers.se