Abstract

We develop a unified framework for convergence analysis of subgradient and subgradient projection methods for minimization of nonsmooth convex functionals in Banach spaces. The important novel features of our analysis are that we neither assume that the functional is uniformly or strongly convex, nor use regularization techniques. Moreover, no boundedness assumptions are made on the level sets of the functional or the feasible set of the problem. In fact, the solution set can be unbounded. Under very mild assumptions, we prove that the sequence of iterates is bounded and it has at least one weak accumulation point which is a minimizer. Moreover, all weak accumulation points of the sequence of Cesàro averages of the iterates are solutions of the minimization problem. Under certain additional assumptions (which are satisfied for several important instances of Banach spaces), we are able to exhibit weak convergence of the whole sequence of iterates to one of the solutions of the optimization problem. To our knowledge, this is the first result of this kind for general nonsmooth convex minimization in Banach spaces.

Author information

Contact details are reproduced from the original publication and may be historical.

Ya. I. Alber

Department of Mathematics, The Technion - Israel Institute of Technology, 32000 Haifa, Israel

A. N. Iusem

Instituto de Matemática Pura e Aplicada, Estrada Dona Castorina 110, Jardim Botânico, Rio de Janeiro, RJ, CEP 22460-320, Brazil

M. V. Solodov

Instituto de Matemática Pura e Aplicada, Estrada Dona Castorina 110, Jardim Botânico, Rio de Janeiro, RJ, CEP 22460-320, Brazil

Keywords

  • Banach spaces
  • nonsmooth optimization
  • subgradient methods
  • metric projection
  • generalized projection
  • weak convergence

References

  1. Ya. I. Alber, A. N. Iusem, and M. V. Solodov: On the projected subgradient methods for nonsmooth convex optimization in a Hilbert space, 1996. To be published.Google Scholar
  2. Ya. I. Alber, A. Kartsatos, and E. Litsyn: Iterative solution of unstable variational inequalities on approximately given sets, Abstract and Applied Analysis, 1(1) (1996) 45-65.https://doi.org/10.1155/S1085337596000024Google Scholar
  3. Ya. I. Alber, A. I Notik: Geometric properties of Banach spaces and approximate methods for solving nonlinear operator equations, Soviet Math. Dokl., 29 (1984) 611-615.Google Scholar
  4. Ya. I. Alber, A. I Notik: On minimization of functionals and solution of variational inequalities in Banach spaces, Soviet Math. Dokl., 34(2) (1987) 296-300.Google Scholar
  5. Ya. I. Alber, A. I Notik: Parallelogram inequalities in Banach spaces and some properties of the duality mapping, Ukranian Math. Journal, 40 (1988) 650-652.https://doi.org/10.1007/BF01057185Google Scholar
  6. Ya. I. Alber, A. I Notik: On the iterative method for variational inequalities with nonsmooth unbounded operators in Banach space, Journal of Mathematical Analysis and Applications, 188(3) (1994) 928-939.https://doi.org/10.1006/jmaa.1994.1471Google Scholar
  7. A. A. Auslender: Optimisation Méthodes Numériques, Masson, Paris, 1976.Google Scholar
  8. R. Correa, C. Lemaréchal: Convergence of some algorithms for convex minimization, Mathematical Programming, 62 (1993) 261-275.https://doi.org/10.1007/BF01585170Google Scholar
  9. J. Diestel: The geometry of Banach spaces, Lecture Notes in Mathematics 485, Springer-Verlag, Berlin, 1975.https://doi.org/10.1007/BFb0082079Google Scholar
  10. J. R. Giles: Convex analysis with applications to differentiation of convex functions, Research notes in mathematics 58, Pitman, Boston, 1982.Google Scholar
  11. J. Lindenstrauss, L. Tzafriri: Classical Banach spaces II, Springer-Verlag, Berlin, 1979.https://doi.org/10.1007/978-3-662-35347-9Google Scholar
  12. V. D. Milman: Geometric theory of Banach spaces. Part II: Geometry of the unit sphere, Russian Mathematics Surveys, 26(6) (1971) 79-163.https://doi.org/10.1070/RM1971v026n06ABEH001273Google Scholar
  13. B. T. Polyak: A general method of solving extremum problems, Soviet Math. Dokl, 8 (1967) 593-597.Google Scholar
  14. B. T. Polyak: Introduction to Optimization, Optimization Software, Inc., Publications Division, New York, 1987.Google Scholar
  15. I. P. Ryazantseva: Convergence of mean iterates for nonlinear monotone equations in Banach space, Vestnik Moscovskogo Universiteta, Series XV, 4 (1987) 61-63. (In Russian).Google Scholar

Suggested citation

Ya. I. Alber, A. N. Iusem, M. V. Solodov. “Minimization of Nonsmooth Convex Functionals in Banach Spaces.” Journal of Convex Analysis 4 (1997), No. 2, 235–255. https://doi.org/10.68381/jca04012

Download BibTeXPublished by Heldermann Verlag.

Published by Heldermann Verlag, 1997. Rights now held by Banach Press LLC.