We revisit the Bang-Bang principle, established for deterministic dynamics with affine control, in a stochastic setting where the dynamics are subject to Brownian motion. We show that such a principle does not generally apply in this context. However, we demonstrate that it does apply under certain conditions with deterministic controls. With stochastic controls, we obtain, under certain conditions, that Mayer's problems with an expectation criterion and a compact control set are equivalent to the same problems with controls taking values in the closed convex hull of the control set. This result is illustrated by a linearized dynamics of the SIR epidemiological model.

Contact details are reproduced from the original publication and may be historical.

Dan Goreac

(1) École d'Actuariat, Université Laval Québec, Canada
(2) LAMA, Université Gustave Eiffel, UPEM,
Univ. Paris Est Creteil, CNRS, Marne-la-Vallée, France
(3) School of Mathematics and Statistics, Shandong University, Weihai, P. R. China

dan.goreac@act.ulaval.ca
  1. F. Avram, L. Freddi, D. Goreac, J. Li, J. Junsong: Controlled compartmental models with time-varying population: normalization, viability and comparison, J. Optim. Theory Appl. 198/3 (2023) 1019–1048.https://doi.org/10.1007/s10957-023-02274-5Google Scholar
  2. S. Bahlali: Necessary and sufficient optimality conditions for relaxed and strict control problems, SIAM J. Control Optim. 47/4 (2008) 2078–2095.https://doi.org/10.1137/070681053Google Scholar
  3. A. G. Bhatt, V. S. Borkar: Occupation measures for controlled Markov processes: characterization and optimality, Ann. Probab. 24 (1996) 1531–1562.https://doi.org/10.1214/aop/1065725192Google Scholar
  4. P.-A. Bliman, M. Duprez: How best can finite-time social distancing reduce epidemic final size?, J. Theor. Biology 511 (2021), art.no. 110557.https://doi.org/10.1016/j.jtbi.2020.110557Google Scholar
  5. P.-A. Bliman, M. Duprez, Y. Privat, N. Vauchelet: Optimal immunity control and final size minimization by social distancing for the SIR epidemic model, J. Optim. Theory Appl. 189 (2021) 408–436.https://doi.org/10.1007/s10957-021-01830-1Google Scholar
  6. P.-A. Bliman, A. Rapaport: On the problem of minimizing the epidemic final size for SIR model by social distancing, IFAC-PapersOnLine 56/2 (2023) 4049–4054.https://doi.org/10.1016/j.ifacol.2023.10.1726Google Scholar
  7. L. Bolzoni, E. Bonacini, R. Della Marca, M. Groppi: Optimal control of epidemic size and duration with limited resources, Math. Biosciences 315 (2019), art.no. 108232.https://doi.org/10.1016/j.mbs.2019.108232Google Scholar
  8. V. Borkar, V. Gaitsgory: Averaging of singularly perturbed controlled stochastic differential equations, Appl. Math. Optimization 56/2 (2007) 169–209.https://doi.org/10.1007/s00245-007-0893-6Google Scholar
  9. T. Britton, L. Leskelä: Optimal intervention strategies for minimizing total incidence during an epidemic, SIAM J. Appl. Math. 83/2 (2023) 354–373.https://doi.org/10.1137/22M1504433Google Scholar
  10. R. Buckdahn, D. Goreac, J. Li: On the near-viability property of controlled mean-field flows, Numer. Algebra Control Optim. 13/3-4 (2023) 630–663.https://doi.org/10.3934/naco.2023004Google Scholar
  11. R. Chenevat, B. Cheviron, S. Roux, A. Rapaport: Extension of the bang-bang principle for piecewise affine dynamics under constraints, preprint hal-04606183 (2024).https://doi.org/10.1109/CDC56724.2024.10886617Google Scholar
  12. V. Drobot: An infinite-dimensional version of Liapunov’s convexity theorem, Michigan Math. J. 17/4 (1970) 405–408.https://doi.org/10.1307/mmj/1029000530Google Scholar
  13. N. El Karoui, H. Nguyen, M. Jeanblanc-Picqué: Compactification methods in the control of degenerate diffusions: existence of an optimal control, Stochastics 20/3 (1987) 169–219.https://doi.org/10.1080/17442508708833443Google Scholar
  14. W. Fleming, D. Vermes: Convex duality approach to the optimal control of diffusions, SIAM J. Control Optimization 36/2 (1989) 1136–1155.https://doi.org/10.1137/0327060Google Scholar
  15. D. Goreac, O. S. Serea: Mayer and optimal stopping stochastic control problems with discontinuous cost, J. Math. Analysis Appl. 380/1 (2011) 327–342.https://doi.org/10.1016/j.jmaa.2011.02.039Google Scholar
  16. W. O. Kermack, A. G. McKendrick: A contribution to the mathematical theory of epidemics, Proc. R. Soc. Lond. Series A 115 (1927) 700–721.https://doi.org/10.1098/rspa.1927.0118Google Scholar
  17. J. P. Lasalle: The ‘bang-bang’ principle, IFAC Proceedings Volumes 1/1 (1960) 503–507.https://doi.org/10.1016/S1474-6670(17)70095-XGoogle Scholar
  18. E. B. Lee, L. Markus: Foundations of Optimal Control Theory, SIAM Series in Applied Mathematics, Society of Industrial and Applied Mathematics, Philadelphia (1986).Google Scholar
  19. X. Li, A. L. Bertozzi, P. Jeffrey Brantingham, Y. Vorobeychik: Optimal policy for control of epidemics with constrained time intervals and region-based interactions, Networks Heter. Media 19/2 (2024) 867–886.https://doi.org/10.3934/nhm.2024039Google Scholar
  20. M. Mezerdi, B. Mezerdi: On the maximum principle for relaxed control problems of nonlinear stochastic systems, Adv. Cont. Discrete Models 8 (2024) 24p.https://doi.org/10.1186/s13662-024-03803-wGoogle Scholar
  21. J. Sereno, A. Anderson, A. Ferramosca, E. A. Hernandez-Vargas, A. Hernán González: Minimizing the epidemic final size while containing the infected peak prevalence in SIR systems, Automatica 144 (2022), art.no. 110496, 8p.https://doi.org/10.1016/j.automatica.2022.110496Google Scholar
  22. M. Sion: On general minimax theorems, Pacific J. Math. 8/1 (1958) 171–176.https://doi.org/10.2140/pjm.1958.8.171Google Scholar
  23. J. Warga: Optimal Control of Differential and Functional Equations, Academic Press, New York (1972).https://doi.org/10.1016/B978-0-12-735150-6.50011-7Google Scholar

R. Chenevat, D. Goreac, Q. Li, A. Rapaport. “About the Bang-Bang Principle for Controlled Affine Dynamics with Brownian Noise.” Journal of Convex Analysis 33 (2026), No. 3&4, 801–816. https://doi.org/10.68381/jca33045