An Extension of LaSalle's Invariance Principle for Switched Systems

J. L. Mancilla-Aguilar Department of Mathematics, Faculty of Engineering, University of Buenos Aires. jmancil@fi.uba.ar Work partially supported by UBA I039. and R.A. García Department of Physics & Mathematics of the Instituto Tecnológico de Buenos Aires; and the Faculty of Engineering of the University of Buenos Aires. ragarcia@itba.edu.ar Work partially supported by UBA I039.

November 27, 2006

Abstract
This paper addresses invariance principles for a certain class of switched nonlinear systems. We provide an extension of LaSalle's Invariance Principle for these systems and state asymptotic stability criteria.
We also present some related results that deal with the compactness of the trajectories of these switched systems and that are interesting by their own.

1 Introduction

In recent years, switched systems have deserved a great deal of attention from the Systems Engineering and Computer Sciences communities. In particular, the stability properties of the common equilibrium solutions have been intensively investigated, see e.g. [3] , [9] and [10] , respectively, and the references therein. Although switched systems whose component subsystems are autonomous (the class of switched systems that we will consider here) are in essence nonautonumous systems, and as such were investigated by different authors, (see [7] and references therein), their stability properties can also be studied by means of multiple Lyapunov functions, [1] , [2] , [5] , [6] , [13] (this approach is very attractive since it enables us to study their uniform, in the sense of the switching signals considered, stability properties). In this context, several Lyapunov-like results and different invariance principles have been recently proposed. Among the invariance results, in [5] LaSalle's invariance principle is extended to switched linear systems under rather general switching; a LaSalle-like invariance principle for switched nonlinear systems under more restrictive switching than that of [5] is proposed in [1] and by using the small-time norm-observability hypothesis, theorems for switched nonlinear systems in the same line as those in [5] are proved in [6] . A version of LaSalle's invariance principle for deterministic hybrid automata with a finite number of discrete states is presented in [12] .
In this paper, we extend LaSalle's invariance principle to switched nonlinear systems under mild restrictions in the class of switchings, since we consider switching signals with a positive average dwell-time (see the definition below). This extended principle enables us to obtain (uniform) asymptotic stability criteria for this class of systems.
The results that we present here enable us not only to extend partially some of those in [6] and improve those in [1] , but get a better comprehension of the structure of invariant sets and of the compactness properties of trajectories of this class of switched systems.
The paper is organized as follows. In section 2 we establish the notation, and present the basic definitions and main results of the paper. In section 3 we exhibit some examples that show the application of our results to systems to which those mentioned above cannot be applied or are of little help. We study the invariance for switched systems and prove our Invariance Principle in section 4.
Section 5 is devoted to the proof of one of the main results. In section 6 we present the conclusions and finally in the Appendix we present some results about compactness of the trajectories of the switched systems under study. These results, that are used in some proofs along the paper, are also important by their own.

2 Basic definitions and main results

Throughout, R   , R +   , N   and N 0   denote the sets of real, nonnegative real, natural and nonnegative integer numbers, respectively. We use | ⋅ |   to denote the Euclidean norm on R n   . As usual, by a K   -function we mean a function α : R + → R +   that is strictly increasing and continuous, and satisfies α ( 0 ) = 0   , by a K ∞   -function one that is in addition unbounded, and we let K ℒ   be the class of functions R + × R + → R +   which are of class K ∞   on the first argument and decrease to zero on the second argument. Let C ( R n , R n )   denote the set of all the continuous maps from R n   to R n   .
Given a family P = { f γ ∈ C ( R n , R n ) : γ ∈ Γ }   , where Γ = { 1 , … , m }   , we consider the switched system described by
x ˙ = f ( x , σ ) (1)
where x   takes values in R n   , σ : R + → Γ   is a switching signal, i.e., σ   is piecewise constant and continuous from the right and f : R n × Γ → R n   is defined by f ( ξ , γ ) = f γ ( ξ )   . In what follows we consider that the set Γ   is equipped with the discrete metric; in consequence Γ   is a compact metric space and f   a continuous function.
We will denote by S   the set of all the switching signals. We recall that a piecewise smooth curve x : ℐ → R n   , with ℐ = [ 0 , T )   or [ 0 , T ]   with 0 < T ≤ + ∞   is a solution of ( 1 ) corresponding to σ ∈ S   if x ˙ ( t ) = f ( x ( t ) , σ ( t ) )   for all t ∈ ( t i , t i + 1 ) ∩ ℐ   , where t 0 = 0   and t 1 , t 2 , …   are the consecutive discontinuities (switching times) of σ   .
A pair ( x , σ )   is a trajectory of ( 1 ) if σ ∈ S   and x   is a solution of ( 1 ) corresponding to σ   . We say that a trajectory ( x , σ )   of ( 1 ) is maximal and denote its domain by ℐ ( x , σ ) = [ 0 , t ( x , σ ) )   , if x   is a maximal solution of ( 1 ) corresponding to σ   . We observe that, due to standard results on ordinary differential equations, either t ( x , σ ) = ∞   or t ( x , σ ) < ∞   and x   is unbounded. Let T   denote the set of all the maximal trajectories of ( 1 ).
Since in many applications, the admissible switching signals, and consequently the admissible trajectories of the switched system, are not completely arbitrary since they are subjected to constraints which may concern their functional nature or be dependent on the states x ( t )   of the system (see [9, 10] ), we will suppose that the class of admissible trajectories of ( 1 ) is a sub-family T ′   of the whole family of trajectories T   .
In order to take into account some kind of state-dependent constraints on the admissible trajectories, as done in [5] we introduce the following family of trajectories: Given a covering χ : = { χ γ : γ ∈ Γ }   of R n   , i.e., χ γ ⊆ R n   and R n = ∪ γ ∈ Γ χ γ   , we define T [ χ ]   as the set of all the trajectories ( x , σ ) ∈ T   which verify the condition: x ( t ) ∈ χ σ ( t )   for all t ∈ ℐ ( x , σ )   . We say that χ   is a closed covering if χ γ   is closed for every γ ∈ Γ   .
In what follows we assume that the following standing hypothesis holds
Assumption 1 There exists a closed covering χ   of R n   such that T ′ ⊆ T [ χ ]   . □  
Since we are mainly interested in the stability analysis of the zero solutions of system ( 1 ), we will also suppose the following hypothesis holds
Assumption 2 f ( 0 , γ ) = 0   for all γ ∈ Γ *   , where Γ * = { γ ∈ Γ : 0 ∈ χ γ }   ; □  
and adopt the following definitions of stability.
Definition 2.1 We say that a family T ′   of maximal trajectories of ( 1 ) is
  • 1. uniformly stable if there exists a function α ∈ K ∞   such that for every ( x , σ ) ∈ T ′   ,
    | x ( t ) | ≤ α ( | x ( t 0 ) | ) ∀ t ≥ t 0 , ∀ t 0 ≥ 0 .
  • 2. Globally asymptotically stable if it is uniformly stable and, in addition, for every trajectory ( x , σ ) ∈ T ′   , x ( t )   converges to 0   as t → ∞   .
  • 3. Globally uniformly asymptotically stable if there exists a function β ∈ K ℒ   such that for every ( x , σ ) ∈ T ′   ,
    | x ( t ) | ≤ β ( | x ( t 0 ) | , t − t 0 ) ∀ t ≥ 0 , ∀ t 0 ≥ 0 .
□  
Remark 2.1 With the same technique used to prove Proposition 2.5 of [11] , it can be shown that the definition of global uniform asymptotic stability given above is equivalent to the following (more classical) one:
A family T ′   of maximal trajectories of ( 1 ) is globally uniformly asymptotically stable if it is uniformly stable and
  • (a) for each R > 0   and each ɛ > 0   , there exists T ≥ 0   such that for all ( x , σ ) ∈ T ′   and all t 0 ≥ 0   | x ( t 0 ) | < R ⟹ | x ( t ) | < ɛ ∀ t ≥ t 0 + T .  
□   Several Lyapunov-like theorems which involve the use of multiple Lyapunov functions (see, among others, [2] , [3] ) allow us to establish the stability or asymptotic stability of a family of admissible trajectories. The following one which is based on results given in [2] , [13] (see also [5] ) is an example of such theorems. It is convenient to introduce here the following
Definition 2.2 A function V : R n × Γ → R   is a weak Lyapunov-like function for the family T ′   if it is continuously differentiable with respect to the first argument and verifies
  • 1. there exist α 1   and α 2   of class K ∞   so that α 1 ( | ξ | ) ≤ V ( ξ , γ ) ≤ α 2 ( | ξ | )   for all ( ξ , γ ) ∈ R n × Γ   such that ξ ∈ χ γ   ;
  • 2. ∂ V ∂ ξ ( ξ , γ ) f ( ξ , γ ) ≤ 0   , for all ( ξ , γ ) ∈ R n × Γ   such that ξ ∈ χ γ   ;
  • 3. for every trajectory ( x , σ ) ∈ T ′   and any pair t i < t j   of switching times such that σ ( t i ) = σ ( t j )   , V ( x ( t j ) , σ ( t j ) ) ≤ V ( x ( t i + 1 ) , σ ( t i ) )   .
□  
Theorem 2.1 Suppose there exists a weak Lyapunov-like function V   for T ′   . Then T ′   is uniformly stable.
If, in addition, V   verifies
  • 2 ′   . there exists a positive-definite function α 3   such that ∂ V ∂ ξ ( ξ , γ ) f ( ξ , γ ) ≤ − α 3 ( | ξ | )   , for all ( ξ , γ ) ∈ R n × Γ   such that ξ ∈ χ γ   ,
then T ′   is globally uniformly asymptotically stable. □  
As was pointed out above, this work is concerned with invariance principles for switched systems and, in particular, with extensions of LaSalle's invariance principle to this class of systems. In this regard we will show, under suitable hypotheses, that the existence of a weak Lyapunov-like function V   for T ′   , allows us to obtain conclusions about the asymptotic behavior of a bounded solution x   of ( 1 ) corresponding to some switching signal σ   so that ( x , σ ) ∈ T ′   , and, further, to obtain some asymptotic stability criteria. As was discussed in [5] and also in [1] , in order to obtain LaSalle-like asymptotic stability criteria by exploiting the knowledge of a weak Lyapunov-like function V   , some form of regularity in the switching signals regarding the distance between consecutive switching times is needed. In this paper we will consider switching signals which have a positive average dwell-time, more precisely,
Definition 2.3 We say that the switching signal σ   has an average dwell-time τ D > 0   and a chatter bound N 0 ∈ N   if the number of switching times of σ   in any open finite interval ( τ 1 , τ 2 ) ⊂ R +   is bounded by N 0 + ( τ 2 − τ 1 ) / τ D   .
□  
We denote by S a [ τ D , N 0 ]   the set of all the switching signals which have an average dwell-time τ D > 0   and a chatter bound N 0 ∈ N   and by T a [ τ D , N 0 ]   the subclass of all the trajectories of ( 1 ) corresponding to some σ ∈ S a [ τ D , N 0 ]   . Let S a = ∪ τ D > 0 , N 0 > 0 S a [ τ D , N 0 ]   and let T a   denote the subclass of all the trajectories of ( 1 ) corresponding to some σ ∈ S a   , i.e. T a = ∪ τ D > 0 , N 0 > 0 T a [ τ D , N 0 ]   .
We note that the set of switching signals σ   which have a dwell-time τ D > 0   , i.e., inf k ≥ 0 t k + 1 − t k ≥ τ D   , is a subset of S [ τ D , 1 ]   .
From now on we suppose that the following additional hypothesis holds.
Assumption 3 T ′ ⊆ T a   .
□  
In order to establish the main results of this paper, we need to introduce some more trajectory families.
Given a continuous function V : Ω × Γ → R   , with Ω   an open subset of R n   , we consider the following families of trajectories associated with V   .
T V   is the class of all the trajectories ( x , σ ) ∈ T   which verify the conditions:
  • 1. x ( t ) ∈ Ω   for all t ∈ ℐ ( x , σ )   ;
  • 2. for any pair of times t , t ′ ∈ ℐ ( x , σ )   such that t ≤ t ′   and σ ( t ) = σ ( t ′ )   , V ( x ( t ) , σ ( t ) ) ≥ V ( x ( t ′ ) , σ ( t ′ ) )   .
T V *   is the sub-family of T V   whose members ( x , σ )   verify the condition σ ( t ) = σ ( t ′ ) ⟹ V ( x ( t ) , σ ( t ) ) = V ( x ( t ′ ) , σ ( t ′ ) ) .  
Remark 2.2 If V   is a weak Lyapunov-like function for T ′   it readily follows that T ′ ⊆ T V   . □  
Finally, we introduce the following notion of weak-invariance for nonempty subsets of R n × Γ   .
Definition 2.4 Given a family T *   of maximal trajectories of ( 1 ), we say that a nonempty subset M ⊆ R n × Γ   is weakly-invariant with respect to T *   if for each ( ξ , γ ) ∈ M   there is a trajectory ( x , σ ) ∈ T *   such that x ( 0 ) = ξ   , σ ( 0 ) = γ   and ( x ( t ) , σ ( t ) ) ∈ M   for all t ∈ ℐ ( x , σ )   . □  
Now we are in position to state the following asymptotic stability criterion, which is one of our main results.
Theorem 2.2 Suppose that there exists a weak Lyapunov-like function V   for T ′   such that M = { 0 } × Γ *   is the maximal weakly-invariant set w.r.t. T V * ∩ T [ χ ] ∩ T a   .
Then T ′   is globally asymptotically stable. If, in addition, T ′ ⊆ T a [ τ D , N 0 ]   for some τ D > 0   and some N 0 ∈ N   then T ′   is globally uniformly asymptotically stable. □  
Remark 2.3 From the proof of Theorem  2.2 , which can be found in section 5, it follows that in the case when T ′ ⊆ T a [ τ D , N 0 ]   for some τ D > 0   and some N 0 ∈ N   , the thesis of the theorem still holds if one assumes the weaker hypothesis M = { 0 } × Γ *   is the maximal weakly-invariant set w.r.t.
T V * ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   . □  
The following result can be readily deduced from Theorem  2.2 .
Theorem 2.3 Suppose that there exists a weak Lyapunov-like function V   for T ′   .
Suppose, in addition, that there exists a family { W γ : R n → R , γ ∈ Γ }   of continuous and nonnegative definite functions such that
  • 1. ∂ V ∂ ξ ( ξ , γ ) f ( ξ , γ ) ≤ − W γ ( ξ )   , for all ( ξ , γ ) ∈ R n × Γ   such that ξ ∈ χ γ   ;
  • 2. for each γ ∈ Γ   , the system
    x ˙ = f γ ( x ) , y = W γ ( x ) , (2)
    is zero small-time distinguishable. (We recall that a systems ( 2 ) is zero small-time distinguishable, if for every δ > 0   , x ( 0 ) = 0   whenever W γ ( x ( t ) ) = 0   for all t ∈ [ 0 , δ )   ).
Then T ′   is globally asymptotically stable. If, in addition, T ′ ⊆ T a [ τ D , N 0 ]   for some τ D > 0   and some N 0 ∈ N   then T ′   is globally uniformly asymptotically stable. □  
Proof. Let M   be the maximal weakly-invariant set w.r.t. T V * ∩ T [ χ ] ∩ T a   . In order to prove the theorem, it suffices to show that M = { 0 } × Γ *   , since then the hypotheses of Theorem  2.2 will be fulfilled. Note first that { 0 } × Γ *   is weakly-invariant w.r.t. T V * ∩ T [ χ ] ∩ T a   due to Assumption 2 and the fact that, due to 1. in Definition  2.2 , V ( 0 , γ ) = 0 ∀ γ ∈ Γ *   .
Let then ( ξ , γ ) ∈ M   ; it follows that there exists a trajectory ( x , σ ) ∈ T V * ∩ T [ χ ] ∩ T a   such that ( x ( 0 ) , σ ( 0 ) ) = ( ξ , γ )   and ( x ( t ) , σ ( t ) ) ∈ M   for all t ≥ 0   . Let τ > 0   such that σ ( t ) = γ   for all t ∈ [ 0 , τ )   .
It follows from the definition of T V *   that ∂ V ∂ ξ ( x ( t ) , σ ( t ) ) f ( x ( t ) , σ ( t ) ) = 0   for all t ∈ [ 0 , τ )   and hence W γ ( x ( t ) ) = 0   for every t ∈ [ 0 , τ )   . From the zero small-time distinguishability assumption, we have that ξ = x ( 0 ) = 0   . Since ( x , σ ) ∈ T [ χ ]   , x ( 0 ) ∈ χ σ ( 0 )   and consequently γ ∈ Γ *   .
Remark 2.4 Theorem  2.3 is a partial generalization of Theorem 7 in [6] , since the zero small-time distinguishability hypothesis is weaker than the small-time norm-observability Assumption 2. in [6] and since we obtain uniform asymptotic stability in the case when T ′ ⊆ T a [ τ D , N 0 ]   for some τ D > 0   and some N 0 ∈ N 0   , but our hypothesis T ′ ⊆ T a   is slightly stronger than the hypothesis about the regularity of the switching signals considered in [6] (see Assumption 3. of that paper). □  
The proof of Theorem  2.2 is based on the following extension of the well known invariance principle for dynamical systems described by differential equations of LaSalle (see [8] ) to switched systems. This extension is other of the main results of this work.
Let π 1 : R n × Γ → R n   be the projection onto the first component.
Theorem 2.4 Let χ   be a closed covering of R n   and let V : Ω × Γ → R   , with Ω   an open subset of R n   , be continuous. Suppose that ( x , σ )   is a trajectory belonging to T V ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   such that for some compact subset B ⊂ Ω   , x ( t ) ∈ B   for all t ≥ 0   . Let M ⊆ R n × Γ   be the largest weakly-invariant set w.r.t. T V * ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   contained in Ω × Γ   .
Then, x ( t )   converges to π 1 ( M )   as t → ∞   . □  
Remark 2.5 In the case when we restrict the hypotheses of Theorem  2.4 to those of Theorems 1 and 2 in [1] , we obtain more precise results related to the size of the attracting sets involved. We shall prove our assertion for Theorem 1 in [1] only, since the proof for the other is similar. In what follows, and in order to prove our claim, we refer to the notation and definitions of that paper. Let x ( t )   be a dwell-time solution (in the sense of [1] ) with initial condition x ( 0 ) ∈ Ω l   , a dwell-time τ D > 0   and generated by a switching signal σ   in a switched system that admits a common weak Lyapunov function (in the sense above) V : Ω → R +   .
Let W : Ω l → R +   be the restriction to Ω l   of the function V   . It is easy to see that the trajectory ( x , σ )   belongs to T W ∩ T a [ τ D , 1 ]   , and that there exists a compact set B ⊂ Ω l   so that x ( t ) ∈ B   for all t ≥ 0   .
Therefore the trajectory ( x , σ )   verifies the hypotheses of Theorem  2.4 (with W   in place of V   and the trivial covering of R n   , χ γ = R n   for all γ ∈ Γ   ). Hence x ( t )   converges to π 1 ( M )   as t → ∞   , where M   is the largest weakly-invariant set w.r.t. T W * ∩ T a   contained in Ω l × Γ   .
On the other hand, Theorem 1 asserts that x ( t )   converges to M ′   , where M ′   is the union of all the compact, weakly-invariant sets (in the sense of [1] ) which are contained in Z ∩ Ω l   . We will prove that π 1 ( M ) ⊆ M ′   and therefore our assertion about the sizes of the attracting sets. Pick ξ ∈ π 1 ( M )   . Then there exist γ ∈ Γ   and a trajectory ( x * , σ * ) ∈ T W * ∩ T a   such that ( x * ( 0 ) , σ * ( 0 ) ) = ( ξ , γ )   and ( x * ( t ) , σ * ( t ) ) ∈ M   for all t ∈ ℐ ( x * , σ * )   . In consequence σ * ( t ) = γ   for all t ∈ [ 0 , δ ]   with 0 < δ < t 1   and t 1   the first switching time of σ *   . It follows from the definition of T W *   that ∂ V ∂ ξ ( x * ( t ) ) f ( x * ( t ) , γ ) = 0   and hence that x * ( t ) ∈ Z ∩ Ω l   for all t ∈ [ 0 , δ ]   . Next, x * ( [ 0 , δ ] )   is a compact weakly-invariant set contained in Z ∩ Ω l   and consequently ξ ∈ M ′   .
It must be remarked that the attracting set π 1 ( M )   corresponding to the weakly-invariant set considered in Theorem  2.4 , may be considerably smaller than the attracting sets given in Theorems 1 and 2 of [1] , as we exhibit in Example 2 below.
□  

3 Examples

Example 1. Consider the switched system in R 2   given by the family { f 1 , f 2 }   , with
f 1 ( ξ ) = ( − 2 ξ 1 − 2 ξ 2 2 ξ 1 ) , f 2 ( ξ ) = ( − ξ 2 ξ 1 ) .
Let T ′   be the set of all the maximal trajectories ( x , σ )   whose switching signals σ   are given by the feedback rule
σ ( t ) = { 1 if x 1 ( t ) < 0 2 if x 1 ( t ) ≥ 0 .
Observe that the origin is a stable focus for the first subsystem and a center for the other, and that the trajectories of both are running counterclockwise.
Since the time needed by any nontrivial trajectory of the subsystem x ˙ = f 1 ( x )   ( x ˙ = f 2 ( x )   ) to go from the positive (resp. negative) x 2   axis to the negative (resp. positive) one is constant, clearly T ′ ⊆ T a [ τ D , 1 ]   for some τ D > 0   . If we consider the closed covering of R 2 : χ 1 = { ξ : ξ 1 ≤ 0 } , χ 2 = { ξ : ξ 1 ≥ 0 }   , then T ′ ⊆ T [ χ ] ∩ T a [ τ D , 1 ]   .
The function V : R 2 × { 1 , 2 } → R   defined by V ( ξ , i ) = | ξ | 2   is clearly a weak Lyapunov-like function for T ′   . We claim that M = { 0 } × { 1 , 2 }   . In fact, let ( ξ , γ ) ∈ M   . Then there exists ( x , σ ) ∈ T V * ∩ T [ χ ] ∩ T a   such that x ( 0 ) = ξ   , σ ( 0 ) = γ   and ( x ( t ) , σ ( t ) ) ∈ M   for all t ≥ 0   . From the facts that x ( t )   cannot remain forever in the right half-plane, where V ( x ( t ) , σ ( t ) )   is constant, that V ( x ( t ) , σ ( t ) )   is strictly decreasing when x ( t )   is in the open left-half plane, and from the definition of T V *   , it follows readily that ( x ( t ) , σ ( t ) )   cannot belong to M   unless x ( t ) = 0   for all t ≥ 0   , and the claim follows. Hence, according to Theorem  2.2 , T ′   is globally uniformly asymptotically stable.
Example 2. Consider now the two systems in R 2   given by:
x ˙ = f 1 ( x ) = ( − x 1 − x 2 x 1 ) and x ˙ = f 2 ( x ) = − x 1 + | x | 4 .
Let W 1 ( ξ ) = ξ 1 2   , W 2 ( ξ ) = | ξ | 2 1 + | ξ | 4   and V ( ξ , i ) = | ξ | 2 / 2 , i = 1 , 2   . Then for every ξ ∈ R 2   , ∂ V ∂ ξ ( ξ , 1 ) f 1 ( ξ ) = − W 1 ( ξ )   and ∂ V ∂ ξ ( ξ , 2 ) f 2 ( ξ ) = − W 2 ( ξ )   . It is not hard to see that both pairs ( f 1 , W 1 )   and ( f 2 , W 2 )   have the zero small-time distinguishability property and that the second one is not small-time norm-observable.
As a matter of fact it is not large-time norm observable. In this case Theorem 7 in [6] cannot be applied, but according to Theorem  2.3 , any T ′ ⊆ T a [ τ D , N 0 ]   with fixed, but otherwise arbitrary, τ D > 0 , N 0 ∈ N 0   , is globally uniformly asymptotically stable.
It is worth noting that if one applied Theorem 1 of [1] , the attracting set so obtained would be the x 2   -axis (see example 4 of [1] ).

4 Invariance for switched systems

In this section we study the asymptotic behavior of bounded solutions x   of the switching system ( 1 ) corresponding to switching signals which have a positive average dwell-time, and in particular the invariance properties of their ω   -limit sets. We recall that a point ξ ∈ R n   belongs to Ω ( x )   , the ω   -limit set of x : R + → R n   , if there exists a strictly increasing sequence of times { s k }   with lim k → ∞ s k = ∞   and lim k → ∞ x ( s k ) = ξ   . The ω   -limit set Ω ( x )   is always closed and, when x   is bounded, it is non-empty, compact and lim t → ∞ d ( x ( t ) , Ω ( x ) ) = 0   . Moreover, Ω ( x )   is the smallest closed set which is approached by x   .
In order to proceed, we will associate to each bounded trajectory ( x , σ ) ∈ T a   a nonempty subset of R n × Γ   , which we denote Ω ♯ ( x , σ )   , and study its invariance properties.
Let us introduce some more notation and terminology. As stated above, associated with a switching signal σ   there are a strictly increasing sequence of real numbers (the sequence of switching times of σ   ) { t i } i = 0 N σ   , with N σ   finite or N σ = ∞   , t 0 = 0   and lim i → ∞ t i = ∞   when N σ = ∞   , and a sequence of points { γ i } i = 0 N σ ⊆ Γ   , with γ i ≠ γ i + 1   for all 0 ≤ i < N σ   , such that σ ( t ) = γ i   for all t i ≤ t < t i + 1   with 0 ≤ i < N σ   , and σ ( t ) = γ N σ   for all t ≥ t N σ   when N σ   is finite. In order to treat the cases N σ < ∞   and N σ = ∞   in an unified frame, we pick any γ * ∈ Γ   and define t i = ∞   and γ i = γ *   for all i > N σ   when N σ   is finite.
Given a switching signal σ ∈ S   we consider the sequence of maps τ i σ : R + ∪ { ∞ } → R + ∪ { ∞ }   , i ∈ N   , defined recursively by:
  • ∙ τ 1 σ ( t ) = t k   if t ∈ [ t k − 1 , t k )   and τ 1 σ ( ∞ ) = ∞   ;
  • ∙ τ i + 1 σ ( t ) = τ 1 σ ( τ i σ ( t ) )   for all t ∈ R + ∪ { ∞ }   and all i ≥ 2   .
We observe that for a given time t ≥ 0   , τ 1 σ ( t )   is the first switching time greater than t   , τ 2 σ ( t )   is the second switching time greater than t   , etc. We also define, for convenience, τ 0 σ ( t ) = t   for all t ≥ 0   .
Definition 4.1 Given a bounded trajectory ( x , σ ) ∈ T a   , a point ( ξ , γ ) ∈ R n × Γ   belongs to Ω ♯ ( x , σ )   if there exists a strictly increasing and unbounded sequence { s k } ⊂ R +   such that
  • 1. lim k → ∞ τ 1 σ ( s k ) − s k = r , 0 < r ≤ ∞   ;
  • 2. lim k → ∞ x ( s k ) = ξ   and lim k → ∞ σ ( s k ) = γ   . □  
We observe that in the case when N σ   is finite, Ω ♯ ( x , σ ) = Ω ( x ) × { γ N σ }   .
The following lemma shows the relation between Ω ( x )   and Ω ♯ ( x , σ )   .
Lemma 4.1 Let ( x , σ )   be a bounded trajectory belonging to T a   . Then Ω ( x ) = π 1 ( Ω ♯ ( x , σ ) )   .
Proof. We only prove the case when σ   has infinitely many switching times since the other case is trivial.
Suppose that σ ∈ S a [ τ D , N 0 ]   for some τ D > 0   and N 0 ∈ N   and that σ   has infinitely many switching times. We first note that the inclusion π 1 ( Ω ♯ ( x , σ ) ) ⊆ Ω ( x )   readily follows from the definition of Ω ♯ ( x , σ )   .
In order to prove that Ω ( x ) ⊆ π 1 ( Ω ♯ ( x , σ ) )   let ξ ∈ Ω ( x )   . Then there exists a strictly increasing an unbounded sequence of times { s k }   such that x ( s k ) → ξ   .
Let i ≥ 0   be the first integer such that limsup k → ∞ τ i + 1 σ ( s k ) − s k = r , w i t h 0 < r ≤ ∞ .   Such an integer exists and verifies i ≤ N 0   since, due to the definition of S a [ τ D , N 0 ]   , τ N 0 + 1 σ ( s k ) − s k ≥ τ D   for all k ≥ 1   . Let { s k j }   be a subsequence of { s k }   so that lim j → ∞ τ σ i + 1 ( s k j ) − s k j = r   . Then, i) lim j → ∞ τ l σ ( s k j ) − s k j = 0   for all 0 ≤ l ≤ i   . Consider the sequence { σ ( τ i σ ( s k j ) ) } j = 1 ∞   ; as Γ   is compact, there is a subsequence { σ ( τ i σ ( s k j l ) ) } l = 1 ∞   which converges to some γ ∈ Γ   .
We claim that ( ξ , γ ) ∈ Ω ♯ ( x , σ )   . In order to prove the claim, consider the unbounded sequence { s l ′ = τ i σ ( s k j l ) }   . From i) and the facts that lim j → ∞ τ i + 1 σ ( s k j ) − s k j = r   and τ 1 σ ( s l ′ ) = τ 1 σ ( τ i σ ( s k j l ) ) = τ i + 1 σ ( s k j l )   , we have that lim l → ∞ τ 1 σ ( s l ′ ) − s l ′ = r > 0   .
We note that by construction lim l → ∞ σ ( s l ′ ) = lim l → ∞ σ ( τ i σ ( s k j l ) ) = γ .   Finally, taking into account that:
  • ∙ lim l → ∞ s l ′ − s k j l = 0   ;
  • ∙ x   is uniformly continuous on R +   since x ˙   is essentially bounded ( x   is bounded, f   is continuous and Γ   is compact);
  • ∙ lim k → ∞ x ( s k ) = ξ   ;
it follows that lim l → ∞ x ( s l ′ ) = ξ   . Thus ( ξ , γ ) ∈ Ω ♯ ( x , σ )   and thereby ξ ∈ π 1 ( Ω ♯ ( x , σ ) )   . Then Ω ( x ) ⊆ π 1 ( Ω ♯ ( x , σ ) )   and the lemma follows.
The next result shows that, under suitable hypotheses, the set Ω ♯ ( x , σ )   corresponding to a trajectory in T V ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   is weakly-invariant w.r.t. T V * ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   .
Proposition 4.1 Let χ   be a closed covering of R n   and let V : Ω × Γ → R   be a continuous function. Suppose that ( x , σ )   is a trajectory belonging to T V ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   , τ D > 0 , N 0 ∈ N   , such that for some compact set B ⊂ Ω   , x ( t ) ∈ B   for all t ≥ 0   . Then Ω ♯ ( x , σ )   is weakly-invariant w.r.t.
T V * ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   . □  
Proof. Let ( ξ , γ ) ∈ Ω ♯ ( x , σ )   . Then there exists a strictly increasing and unbounded sequence { s k }   which verifies 1. and 2. of Definition  4.1 . Let σ k ( ⋅ ) = σ ( ⋅ + s k )   and x k ( ⋅ ) = x ( ⋅ + s k )   . As χ   , V   and the sequence { ( x k , σ k ) }   are as in the hypotheses of Lemma  A.2 in the Appendix, there exist a subsequence ( x k l , σ k l )   and a trajectory ( x * , σ * ) ∈ T V ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   such that { x k l }   converges uniformly to x *   on compact subsets of R +   and { σ k l }   converges to σ *   a.e. on R +   .
Due to Lemma  A.1 in the Appendix, we can also assume without loss of generality that { σ k l }   also verifies condition 2 of that lemma with σ *   in place of σ   .
The proof is completed provided we show that ( x * ( 0 ) , σ * ( 0 ) ) = ( ξ , γ )   , ( x * ( t ) , σ * ( t ) ) ∈ Ω ♯ ( x , σ )   for all t ≥ 0   and ( x * , σ * ) ∈ T V *   .
Let us prove first that ( x * ( 0 ) , σ * ( 0 ) ) = ( ξ , γ )   . From the fact that x k ( 0 ) = x ( s k )   , 2. of Definition  4.1 and the convergence of { x k l }   to x *   , we have that x * ( 0 ) = ξ   .
According to 2. of Lemma  A.1 , there exists a sequence { r l } ⊂ R +   such that lim l → ∞ r l = 0   , lim l → ∞ τ σ k l 1 ( r l ) − r l > 0   and lim l → ∞ σ k l ( r l ) = σ * ( 0 )   . From item 1. of Definition  4.1 and the fact that τ σ k 1 ( 0 ) = τ σ 1 ( s k ) − s k   for all k ∈ N   , it follows that lim l → ∞ τ σ k l 1 ( 0 ) > 0   . Then r l < τ σ k l 1 ( 0 )   for l   large enough and, therefore, σ * ( 0 ) = lim l → ∞ σ k l ( r l ) = lim l → ∞ σ k l ( 0 ) = lim l → ∞ σ ( s k l ) = γ   .
Next we prove that ( x * ( t ) , σ * ( t ) ) ∈ Ω ♯ ( x , σ )   for all t > 0   .
Let t > 0   and let { r l }   be a sequence as in 2. of Lemma  A.1 . Consider the unbounded sequence { s l ′ }   , defined by s l ′ = r l + s k l   , which we can suppose, without loss of generality, strictly increasing. Due to the fact that τ σ 1 ( s l ′ ) = τ σ k l 1 ( r l ) + s k l   , we have that lim l → ∞ τ σ 1 ( s l ′ ) − s l ′ > 0   . So { s l ′ }   satisfies condition 1. of Definition  4.1 . From 2. of Lemma  A.1 , we have that lim l → ∞ σ ( s l ′ ) = lim l → ∞ σ k l ( r l ) = σ * ( t )   . On the other hand, from the uniform convergence of { x k l }   to x *   on compact sets and the continuity of x *   we have that lim l → ∞ x ( s l ′ ) = lim l → ∞ x k l ( r l ) = x * ( t )   . Hence ( x ( s l ′ ) , σ ( s l ′ ) ) → ( x * ( t ) , σ * ( t ) )   as l → ∞   and thereby ( x * ( t ) , σ * ( t ) ) ∈ Ω ♯ ( x , σ )   .
Finally, we prove that ( x * , σ * ) ∈ T V *   . Since ( x * , σ * ) ∈ T V   it suffices to prove that for any pair of times t , t ′   with t < t ′   and σ * ( t ) = σ * ( t ′ )   , V ( x * ( t ) , σ * ( t ) ) ≤ V ( x * ( t ′ ) , σ * ( t ′ ) )   .
Let t , t ′   be a pair of times such that t < t ′   and σ * ( t ) = σ * ( t ′ ) = γ   . Since lim l → ∞ σ k l ( t ) = σ * ( t )   a.e. on R +   , and σ *   is piecewise constant and right continuous, there exists a pair of non-increasing sequences { τ i }   , { τ i ′ }   so that
  • ∙ τ i < τ i ′   for all i   ;
  • ∙ τ i ↘ t   and τ i ′ ↘ t ′   ;
  • ∙ for every i   , lim l → ∞ σ k l ( τ i ) = σ * ( τ i ) = γ   and lim l → ∞ σ k l ( τ i ′ ) = σ * ( τ i ′ ) = γ   .
Fix i   . Since Γ   is finite, there exists l *   such that σ k l ( τ i ) = σ k l ( τ i ′ ) = γ   for all l ≥ l *   . Fix l ′ ≥ l *   . As { s k l }   is unbounded, we have that τ i + s k l > τ i ′ + s k l ′   for l   large enough, say l ≥ l 0   . Then, for l ≥ max { l 0 , l * }   , τ i + s k l > τ i ′ + s k l ′   and σ ( τ i + s k l ) = σ k l ( τ i ) = σ k l ′ ( τ i ′ ) = σ ( τ i ′ + s k l ′ )   . In consequence,
V ( x k l ′ ( τ i ′ ) , σ k l ′ ( τ i ′ ) ) = V ( x ( τ i ′ + s k l ′ ) , σ ( τ i ′ + s k l ′ ) ) ≥
V ( x ( τ i + s k l ) , σ ( τ i + s k l ) ) = V ( x k l ( τ i ) , σ k l ( τ i ) ) .
From the latter, after taking limit as l → ∞   , we get V ( x k l ′ ( τ i ′ ) , σ k l ′ ( τ i ′ ) ) ≥ V ( x * ( τ i ) , σ * ( τ i ) )   and from this, letting l ′ → ∞   , we obtain V ( x * ( τ i ′ ) , σ * ( τ i ′ ) ) ≥ V ( x * ( τ i ) , σ * ( τ i ) )   . Finally, from the continuity of V   and x *   and the right continuity of σ *   , letting i → ∞   it follows that V ( x * ( t ) , σ * ( t ) ) ≤ V ( x * ( t ′ ) , σ * ( t ′ ) )   .
Now we are ready to prove the extension of LaSalle's invariance principle given in Theorem  2.4 .
Proof of Theorem  2.4 . It readily follows from Proposition  4.1 and Lemma  4.1 . In fact, from Proposition  4.1 we have that Ω ♯ ( x , σ ) ⊆ M   . Thus, from Lemma  4.1 , we deduce that Ω ( x ) ⊆ π 1 ( M )   and therefore that x ( t )   tends to π 1 ( M )   as t → ∞   .

5 Proof of Theorem  2.2 

Proof of Theorem  2.2 . Since from Theorem  2.1 we know that T ′   is uniform stable, we only have to prove the remaining statements.
Let ( x , σ ) ∈ T ′   . Since T ′   is uniform stable, it follows that ( x , σ )   is bounded and therefore evolves into some compact subset B   of Ω = R n   . By applying Theorem  2.4 we deduce that x ( t )   tends to π 1 ( M ) = { 0 }   and the global asymptotic stability of T ′   follows.
Suppose now that T ′ ⊆ T a [ τ D , N 0 ]   . Since V   is a weak Lyapunov-like function for the family of trajectories T * = T V ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   , and T ′ ⊆ T *   , it suffices to prove that T *   is globally uniformly asymptotically stable.
Since we have already proved that T *   is globally asymptotically stable, and in particular uniformly stable, the global uniform asymptotic stability of T *   will be established if we show that T *   verifies (a) of Remark  2.1 .
As T *   is invariant by time translations, i.e., for all s ≥ 0   , ( x ( ⋅ + s ) , σ ( ⋅ + s ) ) ∈ T *   if ( x , σ ) ∈ T *   , in order to prove (a) of Remark  2.1 it is sufficient to show that T *   verifies the weaker condition:
  • (*) for each R > 0   and each ɛ > 0   , there exists T ≥ 0   such that for all ( x , σ ) ∈ T *   , | x ( 0 ) | < R ⟹ | x ( t ) | < ɛ ∀ t ≥ T .  
Suppose that (*) does not hold. Then there exist ɛ 0 > 0   , η 0 > 0   , a sequence of trajectories { ( x k , σ k ) } ⊂ T *   and an increasing and unbounded sequence of times { τ k }   such that | x k ( 0 ) | ≤ η 0   and | x k ( τ k ) | ≥ ɛ 0   for all k   .
Since { ( x k , σ k ) }   is uniformly bounded, from Lemma  A.2 we know that there exists a subsequence { ( x k l , σ k l ) }   and a trajectory ( x * , σ * ) ∈ T *   such that { x k l }   converges to x *   uniformly on compact sets.
Let ɛ ′ = α − 1 ( ɛ 0 / 2 )   , with α   as in 1. of Definition  2.1 . As x *   converges to 0   as t → ∞   , there exists a time T > 0   such that | x * ( T ) | < ɛ ′   . Since { x k l }   converges to x *   uniformly on compact sets, | x k l ( T ) | < ɛ ′   for l   large enough. Then, due to the uniform stability of T *   , we have that, for l   large enough and t ≥ T   , | x k l ( t ) | ≤ α ( | x k l ( T ) | ) ≤ α ( ɛ ′ ) = ɛ 0 2 ,   which is a contradiction.

6 Conclusions

In this paper we have presented an extension of LaSalle's invariance principle for switched nonlinear systems assuming that the family of subsystems is finite and that the switching signals have a positive average dwell-time. This extension enabled us to obtain some asymptotic stability criteria for this class of systems. Examples were presented that show the application of our results to cases either intractable with some of the previously mentioned results or upon which those results give no conclusive answers.
In addition, results about the compactness of the trajectories of the systems involved were exhibit that not only were instrumental used in the proof of some results along the paper, but are important by their own.
Finally, we point out that extensions of LaSalle's principle for switched nonlinear systems in the case that Γ   is infinite and also integral invariance principles for the same class of switched systems have been already obtained and are currently under preparation for publication.
References

  1. A. Bacciotti and L. Mazzi, An invariance principle for nonlinear switched systems, Rapporti interni Nr. 22, Departimento di Matematica, Politecnico di Torino, 2004.
  2. M. Branicky, Multiple Lyapunov functions and other analysis tools for switched and hybrid systems, IEEE Trans. Automat. Contr., vol. 43, 475-482, 1998.
  3. R.A. DeCarlo, M.S. Branicky, S. Pettersson and B. Lennartson, Perspectives and results on the stability and stabilizability of hybrid systems, Proc. IEEE, vol. 88, pp. 1069-1082, 2000.
  4. J. Dugundji, Topology, Allyn and Bacon, Inc., Boston, 1966.
  5. J.P Hespanha, Uniform stability properties of switched linear systems: extensions of LaSalle's Invariance Principle, IEEE Trans. Automat. Control, vol. 49, pp. 470-482, 2004.
  6. J.P. Hespanha, D. Liberzon, D. Angeli and E. Sontag, Nonlinear observability notions and stability of switched systems, IEEE Trans. Automat. Control, vol. 50, pp. 154-168, 2005.
  7. P.E. Kloeden, Nonautonomous attractors of switched systems, submitted, 2004.
  8. J. P. LaSalle, The Stability of Dynamical Systems, ser. Regional Conference Series in Applied Mathematics, Philadelphia, PA: SIAM, 1996.
  9. D. Liberzon, Switching in Systems and Control, Birkhäuser, Boston, 2003.
  10. D. Liberzon and A.S. Morse, Basic problems in stability and design of switched systems, IEEE Control Systems Magazine, vol. 19, pp. 59-70, 1999.
  11. Y. Lin, E.D. Sontag and Y. Wang, A smooth converse Lyapunov theorem for robust stability, SIAM J. Control Optim., vol. 34, pp. 124-160, 1996.
  12. J. Lygeros, K. H. Johansson, S. M. Simić, J. Zhang and S. Sastry, Dynamical Properties of Hybrid Automata, IEEE Trans. Automat. Contr. vol. 48, pp. 2-17, 2003.
  13. P. Peleties and R.A. DeCarlo, Asymptotic stability of m   -switched systems using Lyapunov-like functions, in Proc. 1991 Amer. Control Conf., 1991. pp. 1679-1684.

Appendix

A Some compactness results of tra jectories of switched systems

In this Appendix we will show that, under suitable hypotheses, certain families of trajectories of system ( 1 ) enjoy a certain kind of sequential compactness.
We say that a sequence { ( x k , σ k ) }   of trajectories of ( 1 ) is uniformly bounded if there exists M ≥ 0   such that for all k   , | x k ( t ) | ≤ M   for all t ≥ 0   .
Definition A.1 A family T *   of maximal trajectories of ( 1 ) has the SC property if for every uniformly bounded sequence { ( x k , σ k ) } ⊂ T *   there exist a subsequence { ( x k l , σ k l ) }   and a trajectory ( x * , σ * ) ∈ T *   such that { x k l }   converges to x *   uniformly on compact sets of R +   and lim l → ∞ σ k l ( t ) = σ * ( t )   a.e. on R +   . □  
Proposition A.1 Assume that χ   is a closed covering of R n   .Then T [ χ ] ∩ T a [ τ D , N 0 ]   has the SC property for all τ D > 0   and all N 0 ∈ N   . □  
The following lemma is used in the proof of Proposition  A.1 and in some parts of section 4.
Lemma A.1 Let { σ k }   be a sequence of switching signals in S a [ τ D , N 0 ]   with τ D > 0   and N 0 ∈ N   .
Then there exist a subsequence { σ k l }   and a switching signal σ ∈ S a [ τ D , N 0 ]   such that
  • 1. lim l → ∞ σ k l ( t ) = σ ( t )   for almost all t ≥ 0   ;
  • 2. for each t ∈ R +   there exists a sequence of positive times { r l } l = 1 ∞   such that lim l → ∞ r l = t   , lim l → ∞ σ k l ( r l ) = σ ( t ) a n d lim l → ∞ τ σ k l 1 ( r l ) − r l > 0 .  
□  
Proof. Let R + ¯ = R + ∪ { ∞ }   be the one-point compactification of R +   , which we recall is a compact metric space, and let K = ( R + ¯ × Γ ) N 0   be the set of all the sequences p = { ( t i , γ i ) : t i ∈ R + ¯ , γ i ∈ Γ , i ∈ N 0 }   endowed with the product topology. We note that since K   is the Cartesian product of a countable number of compact metric spaces, it is metrizable (see [4] , Theorem 7.2 on p. 190) and compact (see [4] , Theorem 1.4 on p. 224 ).
For each k ∈ N   , let { t i k } i = 0 ∞   be the sequence of switching times associated to the switching signal σ k   and let { γ i k } i = 0 ∞   be the sequence of points of Γ   defined by γ i k = σ k ( t i k )   . Observe that when N σ k   is finite we have, according to the convention above, that γ i k = γ *   and t i k = ∞   for every i > N σ k   . Let p k = { p k ( i ) = ( t i k , γ i k ) } i = 0 ∞ ∈ K   .
As K   is a compact metric space, there exists a subsequence { p k l } l = 1 ∞   which converges, say to p = { p ( i ) = ( t i , γ i ) } i = 0 ∞   , i.e., for each i ∈ N 0   , t i k l → t i   and γ i k l → γ i   as l → ∞   .
Since for each k ∈ N   , { t i k } i = 0 ∞   is nondecreasing and t 0 k = 0   , it readily follows that { t i } i = 0 ∞   is nondecreasing and t 0 = 0   .
We claim that:
  • (a) For every open interval ( a , b )   , with a < b   , the number of indexes i ∈ N   such that t i ∈ ( a , b )   , is bounded by N 0 + ( b − a ) / τ D   ;
  • (b) the number of indexes i   such that t i = 0   is at most N 0 + 1   .
We will only prove (a) since (b) can be proved in a similar way.
Proof of (a). Suppose on the contrary that there are r > N 0 + ( b − a ) / τ D   indexes, say i 1 , … , i r   , such that t i j ∈ ( a , b )   for j = 1 , … , r   . Since t i j k l → t i j   for each j = 1 , … , r   , we have that t i j k l ∈ ( a , b )   for all j = 1 , … , r   if l   is large enough, which contradicts the fact that σ k   belongs to S a [ τ D , N 0 ]   .
In order to define σ   as in the thesis of the lemma, let { i j } j = 0 N   , with N ≤ ∞   , be the unique subsequence of N 0   that verifies:
  • ∙ 0 = t 0 = ⋯ = t i 0   and t i 0 + 1 > 0   ;
  • ∙ t i j + 1 = ⋯ = t i j + 1   and t i j + 1 < t i j + 1 + 1   for all 0 ≤ j < N   ;
  • ∙ t i N + 1 = ∞   when N < ∞   .
Note that this subsequence is well defined due to (a) and (b).
Now, let σ : R + → Γ   be the switching signal defined by: σ ( t ) = γ i j   for all t ∈ [ t i j , t i j + 1 )   and all j ≤ N   . From (a) it readily follows that σ ∈ S a [ τ D , N 0 ]   .
Now we proceed to prove 1. and 2. of the thesis of the lemma. We will consider two cases.
Case I. t / ∈ { t i j } j = 0 N   .
Let j * ∈ N 0   so that t i j * < t < t i j * + 1   . As lim l → ∞ t i j * k l = t i j *   and lim l → ∞ t i j * + 1 k l = t i j * + 1   , t i j * k l < t < t i j * + 1 k l   for l   large enough, say l ≥ L   . Therefore, for l ≥ L   , σ k l ( t ) = σ k l ( t i j * k l ) = γ i j * k l   and, consequently,
lim l → ∞ σ k l ( t ) = lim l → ∞ γ i j * k l = γ i j * = σ ( t ) . (3)
As { t i j } j = 0 N   is a set of measure zero, the latter shows 1).
From the fact that t i j * k l < t < t i j * + 1 k l   for l ≥ L   , we also have that
lim l → ∞ τ σ k l 1 ( t ) − t = lim l → ∞ t i j * + 1 k l − t = t i j * + 1 − t > 0 ,
which shows that 2) holds with the sequence { r l }   defined by r l = t   for all l ∈ N   .
Case II. t = t i j *   for some j * ∈ N 0   .
By using arguments similar to those used in the preceding case, we have that lim l → ∞ τ σ k l 1 ( t ) − t i j * k l = lim l → ∞ t i j * + 1 k l − t i j * k l = t i j * + 1 − t i j * > 0 ,   and that lim l → ∞ σ ( t i j * k l ) = σ ( t )   .
Consequently, item 2. holds with the sequence { r l }   defined by r l = t i j * k l   for all l ∈ N   .
Remark A.1 It is worth mentioning that it is not necessary that Γ   be a finite set for the thesis of Lemma  A.1 to hold. In fact, as can be easily seen from its proof, it suffices that Γ   be a compact metric space. □  
Remark A.2 A result on compactness of switching signals, proved with arguments different to ours, has recently appeared in [7] . That result (Theorem 1 of that paper) states that given Γ = { 1 , . . . , N }   , the set of switching signals with a fixed dwell-time τ D > 0   is a compact subset of the metric space ( S , d )   where the metric d   is defined by
d ( u , v ) = ∑ n = 1 ∞ 2 − n ∫ 0 n | u ( s ) − v ( s ) | d s ,
for all u   and v   in S   .
By using Lemma  A.1 one can generalize Theorem 1 in [7] to average dwell-time signals (the fixed dwell-time hypothesis is essential in the proof given in [7] ). In fact, if we consider the metric space ( S a [ τ D , N 0 ] , d )   with d   the metric above, the compactness of S a [ τ D , N 0 ]   follows from Lemma  A.1 and the application of Lebesgue's Dominated Convergence Theorem. Moreover, since as pointed out in Remark  A.1 , Lemma  A.1 holds for a compact metric space ( Γ , ρ )   , S a [ τ D , N 0 ]   is compact with the metric
d ( u , v ) = ∑ n = 1 ∞ 2 − n ∫ 0 n ρ ( u ( s ) , v ( s ) ) d s ,
for all u   and v   in S   . □  
Proof of Proposition  A.1 . As { ( x k , σ k ) }   is bounded there exists M ≥ 0   such that | x k ( t ) | ≤ M   for all t ≥ 0   and all k ∈ N   . Let M ′ = max | ξ | ≤ M , γ ∈ Γ | f ( ξ , γ ) |   . Then, for every positive integer k   , | x ˙ k ( t ) | ≤ M ′   for almost all t ∈ [ 0 , + ∞ )   . In consequence { x k }   is equibounded and equicontinuous. Then, applying the Arzela-Ascoli Theorem we deduce the existence of a subsequence { x k l }   and a continuous function x * : R + → R n   such that { x k l }   converges to x *   uniformly on compact subsets of R +   .
Consider the subsequence { σ k l }   . Due to Lemma  A.1 we can suppose without loss of generality that there exists σ * ∈ S a [ τ D , N 0 ]   such that lim l → + ∞ σ k l ( t ) = σ * ( t )   for almost all t ≥ 0   .
We claim that x *   is a solution of ( 1 ) corresponding to σ *   and, in consequence, ( x * , σ * ) ∈ T a [ τ D , N 0 ]   .
Let t > 0   . Then
x * ( t ) = lim l → + ∞ x k l ( t ) = lim l → + ∞ ( x k l ( 0 ) + ∫ 0 t f ( x k l ( s ) , σ k l ( s ) ) d s )
= x * ( 0 ) + lim l → + ∞ ∫ 0 t f ( x k l ( s ) , σ k l ( s ) ) d s .
As | f ( x k l ( s ) , σ k l ( s ) ) | ≤ M ′   for all s ∈ [ 0 , t ]   and lim l → + ∞ f ( x k l ( s ) , σ k l ( s ) ) = f ( x * ( s ) , σ * ( s ) )   for almost all s ∈ [ 0 , t ]   , applying the Lebesgue Dominated Convergence Theorem we have that lim l → + ∞ ∫ 0 t f ( x k l ( s ) , σ k l ( s ) ) d s = ∫ 0 t f ( x * ( s ) , σ * ( s ) ) d s ,   and, consequently, x * ( t ) = x * ( 0 ) + ∫ 0 t f ( x * ( s ) , σ * ( s ) ) d s .   It only remains to show that ( x * , σ * )   belongs to T [ χ ]   . Let t ≥ 0   so that lim l → ∞ σ k l ( t ) = σ * ( t ) = j   .
As Γ   is finite, there exists l * > 0   such that σ k l ( t ) = j   for all l ≥ l *   . Note that due to the definition of T [ χ ]   , we also have that x k l ( t ) ∈ χ j   for all l ≥ l *   . As { x k l ( t ) }   converges to x * ( t )   and χ j   is closed, we deduce that x * ( t ) ∈ χ j   . In consequence,
x * ( t ) ∈ χ σ * ( t ) f o r a l m o s t a l l t ≥ 0 . (4)
Now let t ≥ 0   be arbitrary. Due to ( 4 ) there exists a sequence { s k }   which converges to t   so that t ≤ s k   , σ * ( s k ) = σ * ( t )   and x * ( s k ) ∈ χ σ * ( t )   for all k   . Then, from the continuity of x *   and the fact that χ σ * ( t )   is closed, we have that lim k → ∞ x * ( s k ) = x * ( t ) ∈ χ σ * ( t )   and the proof is completed.
Lemma A.2 Assume that χ   is a closed covering of R n   and V : Ω × Γ → R   , with Ω   an open subset of R n   , is continuous. Let { ( x k , σ k ) }   be a sequence of maximal trajectories of ( 1 ) belonging to T V ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   , τ D > 0   , N 0 ∈ N   , and suppose that there exists a compact subset B ⊂ Ω   such that x k ( t ) ∈ B   for all t ≥ 0   and all k   .
Then there exist a subsequence { ( x k l , σ k l ) }   and a maximal trajectory ( x * , σ * ) ∈ T V ∩ T [ χ ] ∩ T a [ τ D , N 0 ]   such that { x k l }   converges to x *   uniformly on compact sets of R +   and lim l → ∞ σ k l ( t ) = σ * ( t )   a.e. on R +   . □  
Proof. Since { ( x k , σ k ) }   is uniformly bounded, from Proposition  A.1 there exist a subsequence { ( x k l , σ k l ) }   and a maximal trajectory ( x * , σ * ) ∈ T [ χ ] ∩ T a [ τ D , N 0 ]   such that { x k l }   converges to x *   uniformly on compact sets of R +   and lim l → ∞ σ k l ( t ) = σ * ( t )   a.e. on R +   . Therefore the lemma follows provided ( x * , σ * ) ∈ T V   . As x * ( t ) ∈ B ⊂ Ω   for all t ∈ R +   , it only remains to prove that for all pair of times t , t ′   , with t < t ′   and σ * ( t ) = σ * ( t ′ )   , V ( x * ( t ) , σ * ( t ) ) ≥ V ( x * ( t ′ ) , σ * ( t ′ ) )   .
Let t , t ′   be a pair of times such that t < t ′   and σ * ( t ) = σ * ( t ′ ) = γ   . Since lim l → ∞ σ k l ( t ) = σ * ( t )   a.e.
on R +   , and σ *   is piecewise constant and continuous from the right, there exists a pair of non-increasing sequences { s i }   , { s i ′ }   so that
  • ∙ s i < s i ′   for all i   ;
  • ∙ s i ↘ t   and s i ′ ↘ t ′   ;
  • ∙ for every i   , lim l → ∞ σ k l ( s i ) = σ * ( s i ) = γ   and lim l → ∞ σ k l ( s i ′ ) = σ * ( s i ′ ) = γ   .
Fix i   . Since Γ   is finite, we have that σ k l * ( s i ) = σ k l * ( s i ′ ) = γ   for l   large enough, say l ≥ l *   . Then, from the definition of T V   and the fact that s i < s i ′   , it follows that V ( x k l ( s i ) , σ k l ( s i ) ) ≥ V ( x k l ( s i ′ ) , σ k l ( s i ′ ) )   for all l ≥ l *   . In consequence, by taking limit as l → ∞   we obtain that V ( x * ( s i ) , σ * ( s i ) ) ≥ V ( x * ( s i ′ ) , σ * ( s i ′ ) )   and, a posteriori, letting i → ∞   we have that V ( x * ( t ) , σ * ( t ) ) ≥ V ( x * ( t ′ ) , σ * ( t ′ ) )   .