Abstract

We define an information topology (I-topology) and a reverse information topology (rI-topology) on the state space of a C*-subalgebra of Mat(n,C)(n,\mathbb{C}) in terms of sequential convergence with respect to the relative entropy. Open disks with respect to the relative entropy define a base for the topology. This was not evident since Csiszár has shown in the 1960's that the analogue is wrong for probability measures on a countably infinite set. The I-topology is strictly finer than the norm topology, it disconnects the convex state space into its faces. The rI-topology is intermediate and it allows to complete two fundamental theorems of information geometry to the full state space, by taking the closure in the rI-topology. The norm topology can be too coarse for this aim but for commutative algebras it equals the rI-topology, so the difference belongs to the domain of quantum theory. We apply our results to the maximization of the von Neumann entropy under linear constraints and to the maximization of quantum correlations.

Author information

Contact details are reproduced from the original publication and may be historical.

Stephan Weis

Max Planck Institute for Mathematics in the Sciences, Leipzig, Germany

sweis@mis.mpg.de

Keywords

  • Relative entropy
  • information topology
  • exponential family
  • convex support
  • Pythagorean theorem
  • projection theorem
  • maximum entropy
  • mutual information

Mathematics Subject Classification

81P45, 81P16, 54D55, 94A17, 90C26

References

  1. E. M. Alfsen, F. W. Shultz: State Spaces of Operator Algebras, Birkhäuser, Boston (2001).https://doi.org/10.1007/978-1-4612-0147-2Google Scholar
  2. S. Amari: Differential-Geometrical Methods in Statistics, Lecture Notes in Statistics 28, Springer, Berlin (1985).https://doi.org/10.1007/978-1-4612-5056-2Google Scholar
  3. S. Amari: Information geometry on hierarchy of probability distributions, IEEE Trans. Inf. Theory 47 (2001) 1701–1711.https://doi.org/10.1109/18.930911Google Scholar
  4. S. Amari, H. Nagaoka: Methods of Information Geometry, Translations of Mathematical Monographs 191, AMS, Providence (2000).Google Scholar
  5. N. Ay: An information-geometric approach to a theory of pragmatic structuring, Ann. Probab. 30 (2002) 416–436.https://doi.org/10.1214/aop/1020107773Google Scholar
  6. N. Ay, A. Knauf: Maximizing multi-information, Kybernetika 42 (2006) 517–538.Google Scholar
  7. O. Barndorff-Nielsen: Information and Exponential Families in Statistical Theory, John Wiley & Sons, New York (1978).Google Scholar
  8. F. Benatti: Dynamics, Information and Complexity in Quantum Systems, Springer, Dordrecht (2009).Google Scholar
  9. I. Bengtsson, S. Weis, K. Życzkowski: Geometry of the set of mixed quantum states: an apophatic approach, in: Geometric Methods in Physics (Bialowieża, 2011), P. Kielanowski et al. (ed.), Trends in Mathematics, Birkhäuser, Basel (2013) 175–197.https://doi.org/10.1007/978-3-0348-0448-6_15Google Scholar
  10. I. Bengtsson, K. Życzkowski: Geometry of Quantum States. An Introduction to Quantum Entanglement, Cambridge University Press, Cambridge (2006).https://doi.org/10.1017/CBO9780511535048Google Scholar
  11. C. Berge: Topological Spaces, Oliver & Boyd, Edinburgh (1963).Google Scholar
  12. R. Bhatia: Matrix Analysis, Springer, New York (1997).https://doi.org/10.1007/978-1-4612-0653-8Google Scholar
  13. G. Birkhoff: Lattice Theory, 3rd. Ed., AMS Colloquium Publications, AMS, Providence (1973).Google Scholar
  14. I. Bjelaković, J.-D. Deuschel, T. Krüger, R. Seiler, R. Siegmund-Schultze, A. Szkola: A quantum version of Sanov’s theorem, Commun. Math. Phys. 260 (2005) 659–671.https://doi.org/10.1007/s00220-005-1426-2Google Scholar
  15. O. Bratteli, D. W. Robinson: Operator Algebras and Quantum Statistical Mechanics 1, 2nd Ed., Springer, New York (2002).https://doi.org/10.1007/978-3-662-09089-3_1Google Scholar
  16. N. N. Čencov: Statistical Decision Rules and Optimal Inference, Translations of Mathematical Monographs 53, AMS, Providence (1982).Google Scholar
  17. I. Csiszár: On topological properties of f-divergences, Stud. Sci. Math. Hung. 2 (1967) 329–339.Google Scholar
  18. I. Csiszár, F. Matúš: Information projections revisited, IEEE Trans. Inf. Theory 49 (2003) 1474–1490.https://doi.org/10.1109/TIT.2003.810633Google Scholar
  19. I. Csiszár, F. Matúš: On information closures of exponential families: a counterexample, IEEE Trans. Inf. Theory 50 (2004) 922–924.https://doi.org/10.1109/TIT.2004.826661Google Scholar
  20. I. Csiszár, F. Matúš: Closures of exponential families, Ann. Probab. 33 (2005) 582–600.https://doi.org/10.1214/009117904000000766Google Scholar
  21. K. R. Davidson: C*-Algebras by Example, Fields Institute Monographs 6, AMS, Providence (1996).https://doi.org/10.1090/fim/006Google Scholar
  22. R. M. Dudley: On sequential convergence, Trans. Amer. Math. Soc. 112 (1964) 483–507; correction ibid. 148 (1970) 623–624.https://doi.org/10.1090/S0002-9947-1964-0175081-6https://doi.org/10.1090/S0002-9947-1970-0257959-0Google Scholar
  23. R. M. Dudley: Consistency of M -estimators and one-sided bracketing, in: High Dimensional Probability (Oberwolfach, 1996), E. Eberlein et al. (ed.), Progr. Probab. 43, Birkhäuser, Basel (1998) 33–58.https://doi.org/10.1007/978-3-0348-8829-5_3Google Scholar
  24. N. Dunford, J. T. Schwartz: Linear Operators. I: General Theory, Interscience, London (1958).Google Scholar
  25. R. Engelking: General Topology, Sigma Series in Pure Mathematics 6, Heldermann, Berlin (1989).Google Scholar
  26. G. L. Gilardoni: On Pinsker’s and Vajda’s type inequalities for Csiszár’s f-divergences, IEEE Trans. Inf. Theory 56 (2010) 5377–5386.https://doi.org/10.1109/TIT.2010.2068710Google Scholar
  27. M. R. Grasselli, R. F. Streater: On the uniqueness of the Chentsov metric in quantum information geometry, Infin. Dimens. Anal. Quantum Probab. Relat. Top. 4 (2001) 173–182.https://doi.org/10.1142/S0219025701000462Google Scholar
  28. B. Grünbaum: Convex Polytopes, 2nd Ed., Springer, New York (2003).https://doi.org/10.1007/978-1-4613-0019-9Google Scholar
  29. P. R. Halmos: Finite-Dimensional Vector Spaces, Springer, New York (1987).https://doi.org/10.1007/978-1-4612-6387-6_1Google Scholar
  30. P. Harremoës: Information topologies with applications, in: Entropy, Search, Complexity, I. Csiszáe et al. (ed.), Bolyai Society Mathematical Studies 16, Springer, Berlin (2007) 113–150.https://doi.org/10.1007/978-3-540-32777-6_5Google Scholar
  31. M. Hayashi: Quantum Information Theory. An Introduction, Springer, Berlin (2006).Google Scholar
  32. A. S. Holevo: Probabilistic and Statistical Aspects of Quantum Theory, 2nd Ed., Edizioni della Normale, Pisa (2011).https://doi.org/10.1007/978-88-7642-378-9Google Scholar
  33. R. S. Ingarden, A. Kossakowski, M. Ohya: Information Dynamics and Open Systems, Kluwer, Dordrecht (1997).https://doi.org/10.1007/978-94-017-1882-0Google Scholar
  34. E. T. Jaynes: Information theory and statistical mechanics. I, II, Phys. Rev., II. Ser. 106 (1957) 620–630; 108 (1957) 171–190.https://doi.org/10.1103/PhysRev.108.171Google Scholar
  35. A. Jenčová: Geometry of quantum states: dual connections and divergence functions, Rep. Math. Phys. 47 (2001) 121–138.https://doi.org/10.1016/S0034-4877(01)90008-4Google Scholar
  36. T. Kato: Perturbation Theory for Linear Operators, Springer, Berlin (1995).https://doi.org/10.1007/978-3-642-66282-9Google Scholar
  37. S. G. Krantz, H. R. Parks: A Primer of Real Analytic Functions, 2nd Ed., Birkhäuser, Boston (2002).https://doi.org/10.1007/978-0-8176-8134-0Google Scholar
  38. S. Kullback, R. A. Leibler: On information and sufficiency, Ann. Math. Stat. 22 (1951) 79–86.https://doi.org/10.1214/aoms/1177729694Google Scholar
  39. E. H. Lieb: Convex trace functions and the Wigner-Yanase-Dyson conjecture, Adv. Math. 11 (1973) 267–188.https://doi.org/10.1016/0001-8708(73)90011-XGoogle Scholar
  40. G. Lindblad: Entropy, information and quantum measurements, Comm. Math. Phys. 33 (1973) 305–322.https://doi.org/10.1007/BF01646743Google Scholar
  41. F. Matúš: Optimality conditions for maximizers of the information divergence from an exponential family, Kybernetika 43 (2007) 731–746.Google Scholar
  42. F. Matúš, N. Ay: On maximization of the information divergence from an exponential family, in: Proceedings of WUPES’03, J. Vejnarová (ed.), University of Economics Prague (2003) 199–204.Google Scholar
  43. K. Modi, T. Paterek, W. Son, V. Vedral, M. Williamson: Unified view of quantum and classical correlations, Phys. Rev. Lett. 104 (2010) 080501.https://doi.org/10.1103/PhysRevLett.104.080501Google Scholar
  44. G. J. Murphy: C*-Algebras and Operator Theory, Academic Press, Boston (1990).Google Scholar
  45. H. Nagaoka: Differential geometrical aspects of quantum state estimation and relative entropy, in: Quantum Communications and Measurement (Nottingham, 1994), V. P. Belavkin et al. (ed.), Plenum Press, New York (1995) 449–452.https://doi.org/10.1007/978-1-4899-1391-3_44Google Scholar
  46. M. A. Nielsen, I. L. Chuang: Quantum Computation and Quantum Information, Cambridge University Press, Cambridge (2000).Google Scholar
  47. M. Ohya, D. Petz: Quantum Entropy and its Use, Springer, Berlin (1993).https://doi.org/10.1007/978-3-642-57997-4Google Scholar
  48. D. Petz: Quasi-entropies for finite quantum systems, Rep. Math. Phys. 23 (1986) 57–65.https://doi.org/10.1016/0034-4877(86)90067-4Google Scholar
  49. D. Petz: Geometry of canonical correlation on the state space of a quantum system, J. Math. Phys. 35 (1994) 780–795.https://doi.org/10.1063/1.530611Google Scholar
  50. D. Petz: Quantum Information Theory and Quantum Statistics, Springer, Berlin (2008).Google Scholar
  51. M. Reed, B. Simon: Methods of Modern Mathematical Physics I, 2nd Ed., Academic Press, New York (1980).Google Scholar
  52. R. T. Rockafellar: Convex Analysis, Princeton University Press, Princton (1972).Google Scholar
  53. D. Ruelle: Statistical Mechanics. Rigorous Results, World Scientific, Singapore (1999).https://doi.org/10.1142/4090Google Scholar
  54. R. Sanyal, F. Sottile, B. Sturmfels: Orbitopes, Mathematika 57 (2011) 275–314.https://doi.org/10.1112/S002557931100132XGoogle Scholar
  55. R. Schneider: Convex Bodies: The Brunn-Minkowski Theory, Cambridge University Press, Cambridge (1993).https://doi.org/10.1017/CBO9780511526282Google Scholar
  56. A. Uhlmann: Relative entropy and the Wigner-Yanase-Dyson-Lieb concavity in an interpolation theory, Commun. Math. Phys. 54 (1977) 21–32.https://doi.org/10.1007/BF01609834Google Scholar
  57. A. Wehrl: General properties of entropy, Rev. Mod. Phys. 50 (1978) 221–260.https://doi.org/10.1103/RevModPhys.50.221Google Scholar
  58. S. Weis: Exponential Families with Incompatible Statistics and Their Entropy Distance, PhD Thesis, University of Erlangen (2010).Google Scholar
  59. S. Weis: A note on touching cones and faces, J. Convex Analysis 19 (2012) 323–353.https://doi.org/10.68381/jca19019Google Scholar
  60. S. Weis: Quantum convex suppport, Linear Algebra Appl. 435 (2011) 3168–3188; correction: Linear Algebra Appl. 436 (2012) p. xvi.https://doi.org/10.1016/j.laa.2011.06.004Google Scholar
  61. S. Weis, A. Knauf: Entropy distance: new quantum phenomena, J. Math. Phys. 53 (2012) 102206.https://doi.org/10.1063/1.4757652Google Scholar
  62. D. Werner: Funktionalanalysis, 3rd Ed., Springer, Berlin (2000).Google Scholar
  63. E. H. Wichmann: Density matrices arising from incomplete measurements, J. Math. Phys. 4 (1963) 884–896.https://doi.org/10.1063/1.1704014Google Scholar

Suggested citation

S. Weis. “Information Topologies on Non-Commutative State Spaces.” Journal of Convex Analysis 21 (2014), No. 2, 339–399. https://doi.org/10.68381/jca21019

Download BibTeXPublished by Heldermann Verlag.

Published by Heldermann Verlag, 2014. Rights now held by Banach Press LLC.