Abstract
The problem of minimizing an entropy functional subject to linear constraints is a useful example of partially finite convex programming. In the 1990s, Borwein and Lewis provided broad and easy-to-verify conditions that guarantee strong duality for such problems. Their approach is to construct a function in the quasi-relative interior of the relevant infinite-dimensional set, which assures the existence of a point in the core of the relevant finite-dimensional set. We revisit this problem, and provide an alternative proof by directly appealing to the definition of the core, rather than by relying on any properties of the quasi-relative interior. Our approach admits a minor relaxation of the linear independence requirements in Borwein and Lewis' framework, which allows us to work with certain piecewise-defined moment functions precluded by their conditions. We provide such a computed example that illustrates how this relaxation may be used to tame observed Gibbs phenomenon when the underlying data is discontinuous. The relaxation illustrates the understanding we may gain by tackling partially-finite problems from both the finite-dimensional and infinite-dimensional sides. The comparison of these two approaches is informative, as both proofs are constructive.
References
- H. H. Bauschke, P. L. Combettes: Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2nd ed., CMS Books in Mathematics, Springer, Cham (2017).https://doi.org/10.1007/978-3-319-48311-5Google Scholar
- H. H. Bauschke, S. B. Lindstrom: Proximal averages for minimization of entropy functionals, Pure Appl. Funct. Analysis 5/3 (2020) 505–531.Google Scholar
- J. M. Borwein, A. S. Lewis: Duality relationships for entropy-like minimization problems, SIAM J. Control Optimization 29 (1991) 325–338.https://doi.org/10.1137/0329017Google Scholar
- J. M. Borwein, A. S. Lewis: Partially finite convex programming. I: Quasi relative interiors and duality theory, Math. Programming 57 (1992) 15–48.https://doi.org/10.1007/BF01581072Google Scholar
- J. M. Borwein, A. S. Lewis: Partially finite convex programming. II: Explicit lattice models, Math. Programming 57 (1992) 49–83.https://doi.org/10.1007/BF01581073Google Scholar
- J. M. Borwein, A. S. Lewis: Partially-finite programming in L1 and the existence of maximum entropy estimates, SIAM J. Optimization 3/2 (1993) 248–267.https://doi.org/10.1137/0803012Google Scholar
- J. M. Borwein, A. S. Lewis: Convex Analysis and Nonlinear Optimization: Theory and Examples, 2nd ed., Springer, Berlin (2006).https://doi.org/10.1007/978-0-387-31256-9Google Scholar
- J. M. Borwein, M. A. Limber: On Entropy Maximization via Convex Programming, Faculty of Mathematics, University of Waterloo (1992).Google Scholar
- J. M. Borwein, S. B. Lindstrom: Meetings with Lambert W and other special functions in optimization and analysis, Pure Appl. Func. Analysis 1/3 (2016) 361–396.Google Scholar
- J. M. Borwein, J. D. Vanderwerff: Convex Functions: Construction, Characterizations and Counterexamples, Cambridge University Press, Cambridge (2010).https://doi.org/10.1017/CBO9781139087322Google Scholar
- J. M. Borwein, Q. Zhu: Techniques of Variational Analysis, CMS Books in Mathematics, Springer, New York (2005).Google Scholar
- H. Brezis: Functional Analysis, Sobolev Spaces and Partial Differential Equations, Springer, Cham (2010).https://doi.org/10.1007/978-0-387-70914-7Google Scholar
- A. S. Lewis: Pseudo-Haar functions and partially-finite programming, manuscript.Google Scholar
- A. S. Lewis: Consistency of moment systems, Can. J. Math. 47/5 (1995) 995–1006.https://doi.org/10.4153/CJM-1995-052-2Google Scholar
- S. B. Lindstrom: Proximal point algorithms, dynamical systems, and associated operators: Modern perspectives from experimental mathematics, available at https://nova.newcastle.edu.au/vital/access/manager/Repository/uon:34387 (2019).Google Scholar
- R. T. Rockafellar: Convex Analysis, Princeton University Press, Princeton (1970).https://doi.org/10.1515/9781400873173Google Scholar
Suggested citation
Published by Heldermann Verlag, 2022. Rights now held by Banach Press LLC.
