Abstract

Bellman's dynamic programming and Pontryagin's maximum principle are two basic tools for studying optimal control theory. We consider the optimal control problem under state constraints and examine the relationship between the maximum principle and dynamic programming via the adjoint, Hamiltonian and value functions. For this purpose the notions of generalized superdifferentials are introduced

Author information

Contact details are reproduced from the original publication and may be historical.

Kyung-Eung Kim

Dept. of Mathematics, Yonsei University, Seodaemoon-ku Shinchon-dong 134, Seoul, Republic of Korea

References

  1. J.-P. Aubin, A. Cellina: Differential Inclusion, Springer-Verlag, Grundlehren der Math. Wiss., 1984.https://doi.org/10.1007/978-3-642-69512-4Google Scholar
  2. J.-P. Aubin, H. Frankowska, C. Olech: Controllability of convex process, SIAM J. on Control and Optimization 24 (1986) 1192-1211.https://doi.org/10.1137/0324072Google Scholar
  3. J.-P. Aubin, H. Frankowska: Set-Valued Analysis, Birkhäuser, Boston et al., 1990.Google Scholar
  4. E. N. Barron, R. Jensen: The Pontryagin maximum principle from dynamic programming and viscosity solutions to first-order partial differential equations, Transactions of the A.M.S. 298 (1986) 635-641.https://doi.org/10.1090/S0002-9947-1986-0860384-4Google Scholar
  5. P. Cannarsa, H. Frankowska: Some characterizations of optimal trajectories in control theory, SIAM J. on Control and Optimization 29 (1991) 1322-1347.https://doi.org/10.1137/0329068Google Scholar
  6. L. Cesari: Optimization Theory and Application, Springer-Verlag, New York et al., 1983.https://doi.org/10.1007/978-1-4613-8165-5Google Scholar
  7. H. Frankowska, B. Kaskosz: A maximum principle for differential inclusion problems with state constraints, Systems and Control Letters 11 (1988) 189-194.https://doi.org/10.1016/0167-6911(88)90058-8Google Scholar
  8. W. H. Fleming, R. W. Rishel: Deterministic and Stochastic Optimal Control, Springer-Verlag, Berlin et al., 1975.https://doi.org/10.1007/978-1-4612-6380-7Google Scholar
  9. M. R. Hestenes: Calculus of Variations and Optimal Control Theory, John Wiley, New York et al., 1966.Google Scholar
  10. E. B. Lee, L. Markus: Foundation of Optimal Control Theory, John Wiley, New York et al., 1967.Google Scholar
  11. X. Y. Zhou: Maximum principle, dynamic programming and their connection in deterministic control, J. Optimization Theory Application 65 (1990) 363-373.https://doi.org/10.1007/BF01102352Google Scholar

Suggested citation

K.-E. Kim. “Relationship Between Dynamic Programming and the Maximum Principle Under State Constraints.” Journal of Convex Analysis 6 (1999), No. 2, 335–348. https://doi.org/10.68381/jca06019

Download BibTeXPublished by Heldermann Verlag.

Published by Heldermann Verlag, 1999. Rights now held by Banach Press.