Weak Conservation Laws for Minimizers which are not Pontryagin Extremals *   *   Research report CM05/I-11. Accepted for presentation (Paper No: 113) at the 2nd International Conference “Physics and Control” (PhysCon 2005), August 24-26, 2005, Saint Petersburg, Russia. To appear in the respective Conference Proceedings.

Delfim F. M. Torres delfim@mat.ua.pt

Department of Mathematics University of Aveiro 3810-193 Aveiro, Portugal

Abstract
We prove a Noether-type symmetry theorem for invariant optimal control problems with unrestricted controls. The result establishes weak conservation laws along all the minimizers of the problems, including those minimizers which do not satisfy the Pontryagin Maximum Principle. Mathematics Subject Classification 2000: 49K15, 70H33, 37J15.
Keywords. Noether's symmetry theorem, invariant optimal control problems, gap between optimality and existence, weak conservation laws.

1 Introduction

Emmy Noether's first theorem [11] is one of the most beautiful and fundamental results of the calculus of variations. The result comprises a universal principle, connecting the existence of a family of transformations under which the functional to be minimized is invariant (the existence of variational symmetries) with the existence of conservation laws (first integrals of the Euler-Lagrange differential equations). Conservation laws can then be used to simplify the problem of finding the minimizers. They have played an important role, both in mathematics and physics, since the birth of the calculus of variations in the eighteen century, having been extensively used by giants like the Bernoulli brothers, Newton, Leibniz, Euler, Lagrange, and Legendre. Conservation laws, obtained from Noether's theorem, have a profound effect on a vast number of disciplines, ranging from classical mechanics, where they find important interpretations such as conservation of energy, conservation of momentum, or conservation of angular momentum, to engineering, economics, control theory and their applications [8].
The first extension of Noether's theorem to the more general context of optimal control was published in 1973 [5]. Since then, many Noether-like theorems have been obtained in the context of optimal control – see [17] and references therein. We recall that all such versions of Noether's theorem assume the Pontryagin maximum principle [13] to be satisfied, and use its conditions, including the adjoint system, in their proofs.
Optimal control with unbounded controls is an area of strong current activity, because of numerous applications involving modern technology such as “smart materials” [9]. When there are no restrictions on the values of the control variables, as in the calculus of variations, it is well known that optimal control problems may present solutions for which the Pontryagin Maximum Principle fails to be satisfied (see e.g. [19, §11.1]). This is due to the fact that the hypotheses of the existence theory need to be complemented with additional regularity conditions in order to proceed with the arguments which lead to the maximum principle [15]: unboundedness of the controls “propagates” through the dynamical control system, often causing a lack of regularity for the solutions.
In spite of the gap between the hypotheses of necessary optimality conditions and existence theorems, J. Ball proved [1] that, for time-invariant problems, the conservation of the Hamiltonian (conservation of energy) is still valid for minimizers which might not satisfy the Euler-Lagrange necessary condition.
More recently, in 2002, G. Francfort and J. Sivaloganathan proposed a generalization of Ball's result, giving some applications to hyper-elasticity [7].
In this note we extend the previous results [7] from the calculus of variations framework to the optimal control setting. We obtain weak conservation laws for minimizers which do not necessarily satisfy the Pontryagin maximum principle.

2 Bad Behavior in Optimal Control

The optimal control problem consists to minimize a cost functional I [ x ( ) , u ( ) ] = a b L ( t , x ( t ) , u ( t ) ) d t   subject to a control system described by ordinary differential equations
x ˙ ( t ) = φ ( t , x ( t ) , u ( t ) ) (1)
together with certain appropriate endpoint conditions. The Lagrangian L : [ a , b ] × R n × R m R   and the velocity vector φ : [ a , b ] × R n × R m R n   are given, and assumed to be smooth: L ( , , )   , φ ( , , )   C 1   . We are interested in the case where there are no restrictions on the control set: u ( t ) R m   .
We denote the problem by ( P )   . In the particular case φ ( t , x , u ) = u   , one obtains the fundamental problem of the calculus of variations, which covers all classical mechanics. The choice of the classes X   and U   , respectively of the state x : [ a , b ] R n   and control variables u : [ a , b ] R m   , play an important role in our discussion. In connection with the Pontryagin maximum principle, the optimal controls are typically assumed to be essentially bounded, U = L   [13]; while to guarantee existence, compactness arguments require a bigger class of measurable control functions, U = L 1   [3]. Given an optimal control problem with unrestricted controls, it may happen that the Pontryagin maximum principle is valid, while existence of minimizers is not guaranteed; or it may happen that the minimizers predicted by the existence theory fail to be Pontryagin extremals. Conservation laws are obtained from Noether's theorem, assuming that the minimizers are Pontryagin extremals. In this work our objective is to prove weak conservation laws valid for bad-behaved problems with minimizers which are not Pontryagin extremals. We begin to explain why bad-behavior can occur.
The Pontryagin maximum principle is a necessary optimality condition which can be obtained from a general Lagrange multiplier theorem in spaces of infinite dimension (cf. e.g. [10, 12]). Introducing the Hamiltonian function
H ( t , x , u , ψ ) = L ( t , x , u ) + ψ φ ( t , x , u ) , (2)
where ψ i   , i = 1 , , n   , are the “Lagrange multipliers” or the “generalized momenta”, the multiplier theorem asserts that the optimal control problem is equivalent to the maximization of the augmented functional
J [ x ( ) , u ( ) , ψ ( ) ] = a b ( H ( t , x ( t ) , u ( t ) , ψ ( t ) ) ψ ( t ) x ˙ ( t ) ) d t . (3)
Let us assume, for simplicity, X = C 1 ( [ a , b ] ; R n )   , U = C ( [ a , b ] ; R m )   . Let ( x ~ ( ) , u ~ ( ) , ψ ~ ( ) )   solve the problem, and consider arbitrary C 1   -functions h 1 , h 3 : [ a , b ] R n   , h 1 ( )   vanishing at a   and b   ( h 1 ( ) C 0 1 ( [ a , b ] )   ), and arbitrary continuous h 2 : [ a , b ] R m   . Let ɛ   be a scalar. By definition of maximizer, we have J [ ( x ~ + ɛ h 1 ) ( ) , ( u ~ + ɛ h 2 ) ( ) , ( ψ ~ + ɛ h 3 ) ( ) ] J [ x ~ ( ) , u ~ ( ) , ψ ~ ( ) ] ,   and one has the following necessary condition:
d d ɛ J [ ( x ~ + ɛ h 1 ) ( ) , ( u ~ + ɛ h 2 ) ( ) , ( ψ ~ + ɛ h 3 ) ( ) ] | ɛ = 0 = 0 . (4)
Differentiating  4 gives
0 = a b [ H x ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) h 1 ( t ) + H u ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) h 2 ( t ) + H ψ ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) h 3 ( t ) h 3 ( t ) x ~ ˙ ( t ) ψ ~ ( t ) h ˙ 1 ( t ) ] d t . (5)
Integrating the ψ ~ ( t ) h ˙ 1 ( t )   term by parts, and having in mind that h 1 ( a ) = h 1 ( b ) = 0   , one derives
a b [ ( H x ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) + ψ ~ ˙ ( t ) ) h 1 ( t ) + H u ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) h 2 ( t ) + ( H ψ ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) x ~ ˙ ( t ) ) h 3 ( t ) ] d t = 0 . (6)
Note that  6 was obtained for any variation h 1 ( )   , h 2 ( )   , and h 3 ( )   . Choosing h 1 ( t ) = h 2 ( t ) 0   , and h 3 ( )   arbitrary, one obtains the control system  1 :
x ~ ˙ ( t ) = H ψ ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) , t [ a , b ] . (7)
With h 1 ( )   arbitrary, and h 2 ( t ) = h 3 ( t ) 0   , we obtain the adjoint system :
ψ ~ ˙ ( t ) = H x ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) , t [ a , b ] . (8)
Finally, with h 2 ( )   arbitrary, and h 1 ( t ) = h 3 ( t ) 0   , the maximality condition is obtained:
H u ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) = 0 , t [ a , b ] . (9)
A necessary optimality condition for ( x ~ ( ) , u ~ ( ) )   to be a minimizer of problem ( P )   is given by the Pontryagin maximum principle: there exists ψ ~ ( )   such that the 3-tuple ( x ~ ( ) , u ~ ( ) , ψ ~ ( ) )   satisfy all the conditions  7 ,  8 , and  9 . We recall that conditions  7 ,  8 , and  9 imply the equality
d d t H ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) = H t ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) . (10)
For piecewise smooth state trajectories, X = P C 1 ( [ a , b ] ; R n )   , and piecewise continuous controls, U = P C ( [ a , b ] ; R m )   , similar arguments than those used to derive conditions  7 ,  8 , and  9 continue to be justifiable. In fact, as already mentioned, the arguments can be carried out for essentially bounded controls, U = L ( [ a , b ] ; R m )   , and Lipschitzian state variables, X = W 1 , ( [ a , b ] ; R n )   .
But if one took U = L 1 ( [ a , b ] ; R m )   , and X = W 1 , 1 ( [ a , b ] ; R n )   , as required by the existence theory, integration by parts of ψ ~ ( t ) h ˙ 1 ( t )   in  5 can no longer be justified, and one can not conclude with the adjoint system  8 and equality  10 . This is more than a technical difficulty, and explains the possibility of bad-behavior illustrated by the Ball-Mizel example [2]. In the Ball-Mizel problem one has n = m = 1   , L ( t , x , u ) = ( x 3 t 2 ) 2 u 14 + ε u 2   , and φ ( t , x , u ) = u   :
0 1 [ ( x 3 ( t ) t 2 ) 2 u ( t ) 14 + ε u ( t ) 2 ] d t min , x ˙ ( t ) = u ( t ) , x ( 0 ) = 0 , x ( 1 ) = k .  
For some values of the constants ε   and k   there exists the unique optimal control u ~ ( t ) = 2 k 3 t 1 / 3   [4], which belongs to L 1   but not to L   . The Pontryagin maximum principle is not satisfied since the adjoint system  8  ψ ~ ˙ ( t ) = H x ( t , x ~ ( t ) , u ~ ( t ) , ψ ~ ( t ) ) = t 4 / 3   is not integrable. In this paper we obtain a new version of Noether's theorem, without using the adjoint system  8 and the property  10 . This makes Noether's principle valid both for welland bad-behaved optimal control problems.

3 Conservation Laws in Optimal Control

In 1918 Emmy Noether established the key result to find conservation laws in the calculus of variations [11, 18]. We sketch here the standard argument used to derive Noether's theorem and conservation laws in the optimal control setting (cf. e.g. [5, 14]).
Let us consider a one-parameter group of C 1   -transformations of the form
h s ( t , x , u , ψ ) = ( h t ( t , x , u , ψ , s ) , h x ( t , x , u , ψ , s ) , h u ( t , x , u , ψ , s ) , h ψ ( t , x , u , ψ , s ) ) , (11)
where s   denote the independent parameter of the transformations. We require that to the parameter value s = 0   there corresponds the identity transformation:
h 0 ( t , x , u , ψ ) = ( h t ( t , x , u , ψ , 0 ) , h x ( t , x , u , ψ , 0 ) , h u ( t , x , u , ψ , 0 ) , h ψ ( t , x , u , ψ , 0 ) ) = ( t , x , u , ψ ) . (12)
Associated to the group of transformations  11 we consider the infinitesimal generators
T ( t , x , u , ψ ) = d d s h t ( t , x , u , ψ , s ) | s = 0 , X ( t , x , u , ψ ) = d d s h x ( t , x , u , ψ , s ) | s = 0 , U ( t , x , u , ψ ) = d d s h u ( t , x , u , ψ , s ) | s = 0 , Ψ ( t , x , u , ψ ) = d d s h ψ ( t , x , u , ψ , s ) | s = 0 . (13)
Definition 1. The optimal control problem ( P )   is said to be invariant under a one-parameter group of C 1   -transformations  11 if, and only if,
d d s { [ H ( h s ( t , x ( t ) , u ( t ) , ψ ( t ) ) ) h ψ ( t , x ( t ) , u ( t ) , ψ ( t ) , s ) d h x ( t , x ( t ) , u ( t ) , ψ ( t ) , s ) d t d h t ( t , x ( t ) , u ( t ) , ψ ( t ) , s ) d t ] d h t ( t , x ( t ) , u ( t ) , ψ ( t ) , s ) d t } | s = 0 = 0 , (14)
with H   the Hamiltonian  2 .
Having in mind  12 , condition  14 is equivalent to
H t T + H x X + H u U + H ψ Ψ Ψ x ˙ ( t ) ψ ( t ) d d t X + H d d t T = 0 , (15)
where here, and to the end of the paper, all functions are evaluated at ( t , x ( t ) , u ( t ) , ψ ( t ) )   whenever not indicated. Along a Pontryagin extremal ( x ( ) , u ( ) , ψ ( ) )   equalities  7 ,  8 ,  9 , and  10 are in force, and  15 reduces to d H d t T ψ ˙ ( t ) X ψ ( t ) d X d t + H d T d t = 0 d d t ( ψ ( t ) X H T ) = 0 .   We have just proved Noether's theorem for optimal control problems.
Theorem 1 (Noether's Theorem). If the optimal control problem is invariant under  11 , in the sense of Definition  1 , then
ψ ( t ) X ( t , x ( t ) , u ( t ) , ψ ( t ) ) H ( t , x ( t ) , u ( t ) , ψ ( t ) ) T ( t , x ( t ) , u ( t ) , ψ ( t ) ) = c (16)
( c   a constant; t [ a , b ]   ; T   and X   are given according to  13 ; H   is the Hamiltonian  2 ) is a conservation law, that is,  16 is valid along all the minimizers ( x ( ) , u ( ) )   of ( P )   which are Pontryagin extremals.
All available versions of Noether's theorem found in the literature are valid only for well-behaved optimal control problems (conservation laws are, by definition, valid for minimizers which are Pontryagin extremals). In the next section we provide the first optimal control version of Noether's theorem valid in presence of bad behavior (valid also for minimizers which are not Pontryagin extremals).
For that we need a new notion of conservation law.

4 Weak Conservation Laws in Optimal Control

In 1879 Paul duBois-Reymond proved an important basic result. From duBois-Reymond lemma we know that a b ( ψ ( t ) X H T ) θ ˙ ( t ) d t = 0 , θ ( ) C 0 1 ( [ a , b ] ) ,   is a weak form of conservation law  16 . Follows the main result of the paper.
Theorem 2. If the optimal control problem is invariant under  11 , in the sense of Definition  1 , then
a b [ ψ ( t ) X ( t , x ( t ) , u ( t ) , ψ ( t ) ) H ( t , x ( t ) , u ( t ) , ψ ( t ) ) T ( t , x ( t ) , u ( t ) , ψ ( t ) ) ] θ ˙ ( t ) d t = 0  
( θ ( )   is an arbitrary W 1 , 1 ( [ a , b ] ; R )   function satisfying θ ( a ) = θ ( b ) = 0   ) holds along all the minimizers ( x ( ) , u ( ) , ψ ( ) ) W 1 , 1 × L 1 × W 1 , 1   of  3 .
  • Proof. Replacing the parameter s   of the group  11 by function s θ ( t )   , the infinitesimal generators are then given by
    d d s h t ( t , x , u , ψ , s θ ( t ) ) | s = 0 = T ( t , x , u , ψ ) θ ( t ) , d d s h x ( t , x , u , ψ , s θ ( t ) ) | s = 0 = X ( t , x , u , ψ ) θ ( t ) , d d s h u ( t , x , u , ψ , s θ ( t ) ) | s = 0 = U ( t , x , u , ψ ) θ ( t ) , d d s h ψ ( t , x , u , ψ , s θ ( t ) ) | s = 0 = Ψ ( t , x , u , ψ ) θ ( t ) ,
    with T   , X   , U   , and Ψ   as in  13 , and the necessary and sufficient condition of invariance  15 takes the form
    ( H t T + H x X + H u U + H ψ Ψ Ψ x ˙ ( t ) + H d T d t ψ ( t ) d X d t ) θ ( t ) + ( H T ψ ( t ) X ) θ ˙ ( t ) = 0 . (17)
    Condition  5 with h 1 ( t ) = X θ ( t )   , h 2 ( t ) = U θ ( t )   , and h 3 ( t ) = Ψ θ ( t )   , gives
    a b [ ( H x X + H u U + H ψ Ψ Ψ x ˙ ( t ) ψ ( t ) d X d t ) θ ( t ) ( ψ ( t ) X ) θ ˙ ( t ) ] d t = 0 . (18)
    Using  15 in  18 permits to write
    a b [ ( H t T H d T d t ) θ ( t ) ( ψ ( t ) X ) θ ˙ ( t ) ] d t = 0 ; (19)
    while, on the other hand, using  17 in  18 , one obtains
    a b [ ( H t T + H d T d t ) θ ( t ) + ( H T ) θ ˙ ( t ) ] d t = 0 . (20)
    The conclusion follows summing up  19 and  20 : a b ( H T ψ ( t ) X ) θ ˙ ( t ) d t = 0 .  
Invariance under an infinite continuous group of transformations, which rather than dependence on parameters depend upon arbitrary functions, is considered by Noether in the original paper [11]. This is sometimes called “the second Noether theorem”. We refer the reader to [16] for an extension of the second Noether theorem to optimal control problems which are semi-invariant under symmetries depending upon k   arbitrary functions of the independent variable and their derivatives. Theorem  2 is easily formulated under more general notions of invariance.
Theorem  2 gives, from the invariance properties of the optimal control problems, weak conservation laws along all the minimizers, including those minimizers which does not satisfy the standard necessary optimality conditions like the Pontryagin Maximum Principle or the Euler-Lagrange differential equations.
Such fact may be useful to identify more general classes of welland bad-behaved problems in the calculus of variations and optimal control, e.g., to synthesize a broad class of invariant problems exhibiting the Lavrentiev phenomenon [6].
This possibility is under investigation and will be addressed elsewhere.
Acknowledgements This work was partially supported by the Portuguese Foundation for Science and Technology (FCT) through the Control Theory Group (cotg) of the Centre for Research in Optimization and Control (CEOC).
References
  • [1] J. M. Ball, Minimizers and the Euler-Lagrange equations, Trends and applications of pure mathematics to mechanics (Palaiseau, 1983), 1984, pp. 1–4. [MR 755716 (86e:49022)] [Zbl 0547.73013]
  • [2] J. M. Ball and V. J. Mizel, One-dimensional variational problems whose minimizers do not satisfy the Euler-Lagrange equation, Arch. Rational Mech. Anal. 90 (1985), no. 4, 325–388.
    [MR 801585 (86k:49002)] [Zbl 0585.49002]
  • [3] Lamberto Cesari, Optimization—theory and applications, Applications of Mathematics (New York), vol. 17, Springer-Verlag, New York, 1983. Problems with ordinary differential equations. [MR 688142 (85c:49001)] [Zbl 0506.49001]
  • [4] Frank H. Clarke and R. B. Vinter, On the conditions under which the Euler equation or the maximum principle hold, Appl. Math. Optim. 12 (1984), no. 1, 73–79. [MR 756513 (85m:49051)] [Zbl 0559.49012]
  • [5] D̄or d̄e S. D̄ukić, Noether's theorem for optimum control systems, Internat. J. Control (1) 18 (1973), 667–672. [MR 0341229 (49 #5979)] [Zbl 0281.49009]
  • [6] M. Foss, Examples of the Lavrentiev phenomenon with continuous Sobolev exponent dependence, J. Convex Anal. 10 (2003), no. 2, 445–464. [MR 2043868 (2004m:49044)] [Zbl pre02066990]
  • [7] G. Francfort and J. Sivaloganathan, On conservation laws and necessary conditions in the calculus of variations, Proc. Roy. Soc. Edinburgh Sect. A 132 (2002), no. 6, 1361–1371.
    [MR 1950811 (2003j:49035)] [Zbl 1027.49015]
  • [8] A. M. Gugushvili, O. G. Khutsishvili, V. K. Sesadze, G. N. Dalakishvili, N. A. Mchedlishvili, T. G. Khutsishvili, V. M. Kekenadze, and D. F. M. Torres, Symmetries and conservation laws in optimal control systems, Georgian Technical University, Tbilisi, 2003.
  • [9] Irena Lasiecka, Optimal control problems and Riccati equations for systems with unbounded controls and partially analytic generators – applications to boundary and point control problems, Functional Analytic Methods for Evolution Equations, 2004, pp. 313–369.
  • [10] Antonio Leitão, Cálculo variacional e controle ótimo, Publicações Matemáticas do IMPA. [IMPA Mathematical Publications], Instituto de Matemática Pura e Aplicada (IMPA), Rio de Janeiro, 2001 (Portuguese). 23 o   Colóquio Brasileiro de Matemática. [23rd Brazilian Mathematics Colloquium]. [MR 1846384] [Zbl pre01659603]
  • [11] Emmy Noether, Invariant variation problems, Transport Theory Statist. Phys. 1 (1971), no. 3, 186–207. Translated from the German (Nachr. Akad. Wiss. Göttingen Math.-Phys. Kl. II 1918, 235–257). [MR 0406752 (53 #10538)] [Zbl 0292.49008]
  • [12] Pablo Pedregal, Introduction to optimization, Texts in Applied Mathematics, vol. 46, Springer-Verlag, New York, 2004. [MR 2014219 (2004j:90002)] [Zbl 1036.90002]
  • [13] L. S. Pontryagin, V. G. Boltyanskiĭ, R. V. Gamkrelidze, and E. F. Mishchenko, Selected works. Vol. 4, Classics of Soviet Mathematics, Gordon & Breach Science Publishers, New York, 1986. The mathematical theory of optimal processes; Edited and with a preface by R. V. Gamkrelidze Translated from the Russian by K. N. Trirogoff Translation edited by L. W. Neustadt With a preface by L. W. Neustadt and K. N. Trirogoff Reprint of the 1962 English translation. [MR 898009 (90a:01108)] [Zbl 0882.01027]
  • [14] Delfim F. M. Torres, Conservation laws in optimal control, Dynamics, bifurcations, and control (Kloster Irsee, 2001), 2002, pp. 287–296. [MR 1901565 (2003c:49037)] [Zbl pre01819752]
  • [15] , Lipschitzian regularity of the minimizing trajectories for nonlinear optimal control problems, Math. Control Signals Systems 16 (2003), no. 2-3, 158–174. [MR 2006825 (2004i:49047)] [Zbl 1041.93023]
  • [16] , Gauge symmetries and Noether currents in optimal control, Appl. Math. E-Notes 3 (2003), 49–57 (electronic). [MR 1980565 (2004g:49038)] [Zbl pre01925174]
  • [17] , Quasi-invariant optimal control problems, Port. Math. (N.S.) 61 (2004), no. 1, 97–114. [MR 2040245] [Zbl 1042.49015]
  • [18] Bruce van Brunt, The calculus of variations, Universitext, Springer-Verlag, New York, 2004. [MR 2004181 (2004m:49001)] [Zbl 1039.49001]
  • [19] Richard Vinter, Optimal control, Systems & Control: Foundations & Applications, Birkhäuser Boston Inc., Boston, MA, 2000. [MR 1756410 (2001c:49001)] [Zbl 0952.49001]