Abstract

We introduce and study a variational model for segmentation and inpainting of 2-dimensional color images. The model consists in the minimization of a functional dependent on second derivatives, free discontinuity and free gradient discontinuity. The competitors are piecewise C2C^2 vector-valued functions, whose components represent the intensity of RGB channels.

Author information

Contact details are reproduced from the original publication and may be historical.

Franco Tomarelli

Dip. di Matematica, Politecnico di Milano, Piazza Leonardo da Vinci 32, 20133 Milano, Italia

franco.tomarelli@polimi.it

Keywords

  • Calculus of variations
  • free discontinuity problems
  • regularity
  • inpainting
  • image segmentation
  • Gamma convergence

Mathematics Subject Classification

49J45, 49K20

References

  1. L. Ambrosio, N. Fusco, D. Pallara: Functions of Bounded Variation and Free Discontinuity Problems, Oxford Mathematical Monographs, Oxford University Press, Oxford (2000).https://doi.org/10.1093/oso/9780198502456.001.0001Google Scholar
  2. L. Ambrosio, L. Faina, R. March: Variational approximation of a second order free discontinuity problem in computer vision, SIAM J. Math. Anal. 32 (2001) 1171–1197.https://doi.org/10.1137/S0036141000368326Google Scholar
  3. G. Aubert, P. Kornprobst: Mathematical Problems in Image Processing, Partial Differential Equations and the Calculus of Variations, Applied Mathematical Sciences 147, 2nd edition, Springer, New York (2006).https://doi.org/10.1007/978-0-387-44588-5Google Scholar
  4. M. Bergounioux, A. Leaci, G. Nardi, F. Tomarelli: Fractional Sobolev spaces and functions of bounded variation of one variable, Fract. Calc. Appl. Anal. 20(4) (2017) 936–962.https://doi.org/10.1515/fca-2017-0049Google Scholar
  5. M. Bergounioux, L. Piffet: A full second order variational model for multiscale texture analysis, Comput. Optim. Appl. 54(2) (2013) 215–237.https://doi.org/10.1007/s10589-012-9484-9Google Scholar
  6. A. Bertozzi, S. Esedoglu, A. Gillette: Analysis of a two-scale Cahn-Hilliard model for binary image inpainting, Multiscale Model. Simul. 6 (2007) 913–936.https://doi.org/10.1137/060660631Google Scholar
  7. T. Boccellari, F. Tomarelli: Generic uniqueness of minimizer for Blake and Zisserman functional, Rev. Mat. Complut. 26 (2013) 361–408.https://doi.org/10.1007/s13163-012-0103-1Google Scholar
  8. A. Blake, A. Zisserman: Visual Reconstruction, The MIT Press, Cambridge (1987).https://doi.org/10.7551/mitpress/7132.001.0001Google Scholar
  9. A. Braides, A. De Franceschi, E. Vitali: A compactness result for a second-order variational discrete model, ESAIM Math. Model. Numer. Anal. 46 (2012) 389–410.https://doi.org/10.1051/m2an/2011043Google Scholar
  10. L. Calatroni, B. Düring, C.-B. Schönlieb: ADI splitting schemes for a 4th order nonlinear partial differential equation from image processing, Discr. Cont. Dynamical Systems Ser. A 34(3) (2014) 931–957.https://doi.org/10.3934/dcds.2014.34.931Google Scholar
  11. M. Carriero, A. Leaci: Existence theorem for a Dirichlet problem with free discontinuity set, Nonlinear Analysis Theor. Meth. Appl. 15(7) (1990) 661–677.https://doi.org/10.1016/0362-546X(90)90006-3Google Scholar
  12. M. Carriero, A. Leaci, F. Tomarelli: A second order model in image segmentation: Blake and Zisserman functional, in: Variational Methods For Discontinuous Structures: Applications to Image Segmentation, Continuum Mechanics, Homogenization (Como, 1994), Progress in Nonlinear Differential Equations and their Applications 25, Birkhäuser, Basel (1996) 57–72.https://doi.org/10.1007/978-3-0348-9244-5_5Google Scholar
  13. M. Carriero, A. Leaci, F. Tomarelli: Strong minimizers of Blake and Zisserman functional, Ann. Scuola Norm. Sup. Pisa Cl. Sci. Ser. 4, 25(1-2) (1997) 257–285.Google Scholar
  14. M. Carriero, A. Leaci, F. Tomarelli: Necessary conditions for extremals of Blake and Zisserman functional, Comptes Rendus Mathematique 334(4) (2002) 343–348.https://doi.org/10.1016/S1631-073X(02)02231-8Google Scholar
  15. M. Carriero, A. Leaci, F. Tomarelli: Local minimizers for a free gradient discontinuity problem in image segmentation, in: G. Dal Maso, F. Tomarelli (eds.), Variational Methods for Discontinuous Structures, Progress in Nonlinear Differential Equations and their Applications 51, Birkhäuser, Basel (2002) 67–80.https://doi.org/10.1007/978-3-0348-8193-7_5Google Scholar
  16. M. Carriero, A. Leaci, F. Tomarelli: Calculus of variations and image segmentation, J. Physiology Paris 97(2-3) (2003) 343–353.https://doi.org/10.1016/j.jphysparis.2003.09.008Google Scholar
  17. M. Carriero, A. Leaci, F. Tomarelli: Euler equations for Blake and Zisserman functional, Calculus of Variations and Partial Differential Equations 32 (1) (2008) 81–110.https://doi.org/10.1007/s00526-007-0129-2Google Scholar
  18. M. Carriero, A. Leaci, F. Tomarelli: A Dirichlet problem with free gradient discontinuity, Advances in Mathematical Sciences and Applications 20(1) (2010) 107–141.Google Scholar
  19. M. Carriero, A. Leaci, F. Tomarelli: A candidate local minimizer of Blake and Zisserman functional, J. Math. Pures Appl. 96 (2011) 58–87.https://doi.org/10.1016/j.matpur.2011.01.005Google Scholar
  20. M. Carriero, A. Leaci, F. Tomarelli: Uniform density estimates for Blake and Zisserman functional, Discrete and Continuous Dynamical Systems 31(4) (2011) 1129–1150.https://doi.org/10.3934/dcds.2011.31.1129Google Scholar
  21. M. Carriero, A. Leaci, F. Tomarelli: Free gradient discontinuity and image inpainting, J. Math. Sci. (N.Y.) 181(6) (2012) 805–819.https://doi.org/10.1007/s10958-012-0716-4Google Scholar
  22. M. Carriero, A. Leaci, F. Tomarelli: Image inpainting via variational approximation of a Dirichlet problem with free discontinuity, Adv. Calc. Var. 7(3) (2014) 267–295.https://doi.org/10.1515/acv-2012-0020Google Scholar
  23. M. Carriero, A. Leaci, F. Tomarelli: Corrigendum to “A candidate local minimizer of Blake and Zisserman functional”, J. Math. Pures Appl. 104 (2015) 1005–1011.https://doi.org/10.1016/j.matpur.2015.03.012Google Scholar
  24. M. Carriero, A. Leaci, F. Tomarelli: A survey on the Blake-Zisserman functional, Milan J. Math. 83 (2015) 397–420.https://doi.org/10.1007/s00032-015-0246-xGoogle Scholar
  25. V. Caselles, G. Haro, G. Sapiro, J. Verdera: On geometric variational models for inpainting surface holes, Computer Vision and Image Understanding 111 (2008) 351–373.https://doi.org/10.1016/j.cviu.2008.01.002Google Scholar
  26. T. F. Chan, J. Shen: Variational image inpainting, Comm. Pure Appl. Math. 58 (2005) 579–619.https://doi.org/10.1002/cpa.20075Google Scholar
  27. L. Cherfils, H. Fakih, A. Miranville: Finite-dimensional attractors for the Bertozzi-Esedoglu-Gillette-Cahn-Hilliard equation in image inpainting, Inverse Probl. Imaging 9(1) (2015) 105–125.https://doi.org/10.3934/ipi.2015.9.105Google Scholar
  28. L. Cherfils, H. Fakih, A. Miranville: A Cahn-Hilliard system with a fidelity term for color image inpainting, J. Math. Imaging Vis. 54(1) (2016) 117–131.https://doi.org/10.1007/s10851-015-0593-9Google Scholar
  29. S. Esedoglu, J. H. Shen: Digital inpainting based on the Mumford-Shah-Euler image model, Eur. J. Appl. Math. 13(4) (2002) 353–370.https://doi.org/10.1017/S0956792502004904Google Scholar
  30. R. Ferreira, I. Fonseca, M. L. Mascarenhas: A chromaticity-brightness model for color images denoising in a “u + v” framework, Calc. Variations Partial Diff. Equations 56 (2017).https://doi.org/10.1007/s00526-017-1223-8Google Scholar
  31. G. Forlani, C. Nardinocchi, M. Scaioni, P. Zingaretti: Complete classification of raw LIDAR data and 3d reconstruction of buildings, Pattern Anal. Appl. 8(4) (2006) 357–374.https://doi.org/10.1007/s10044-005-0018-2Google Scholar
  32. M. Fornasier, R. March: Restoration of color images by vector valued BV functions and variational calculus, SIAM J. Appl. Math. 68(2) (2007) 437–460.https://doi.org/10.1137/060671875Google Scholar
  33. B. Jadamba, A. A. Khan, G. Rus, M. Sama, B. Winkler: A new convex inversion framework for parameter identification in saddle point problems with an application to the elasticity imaging inverse problem of predicting tumor location, SIAM J. Appl. Math. 74(5) (2014) 1486–1510.https://doi.org/10.1137/130928261Google Scholar
  34. S. H. Kang, R. March: Variational models for image colorization via chromaticity and brightness decomposition, IEEE Transactions Image Processing 16(9) (2007) 2251–2261.https://doi.org/10.1109/TIP.2007.903257Google Scholar
  35. F. A. Lops, F. Maddalena, S. Solimini: Hölder continuity conditions for the solvability of Dirichlet problems involving functionals with free discontinuities, Ann. Inst. H. Poincaré Anal. Non Linéaire 18(6) (2001) 639–673.https://doi.org/10.1016/s0294-1449(01)00077-4Google Scholar
  36. D. Mumford, J. Shah: Optimal approximation by piecewise smooth functions and associated variational problems, Comm. Pure Appl. Math. 42 (1989) 577–685.https://doi.org/10.1002/cpa.3160420503Google Scholar
  37. L. I. Rudin, S. Osher, E. Fatemi: Nonlinear total variation based noise removal algorithms, Physica D 60 (1992) 259–268.https://doi.org/10.1016/0167-2789(92)90242-FGoogle Scholar
  38. M. Zanetti, L. Bruzzone: Piecewise linear approximation of vector-valued images and curves via 2nd-order variational model, IEEE Trans. Image Processing 26(9) (2017) 4414–4429.https://doi.org/10.1109/TIP.2017.2716827Google Scholar
  39. M. Zanetti, V. Ruggiero, M. Miranda Jr.: Numerical minimization of a second-order functional for image segmentation, Commun. Nonlinear Sci. Numer. Simul. 36 (2016) 528-548.https://doi.org/10.1016/j.cnsns.2015.12.018Google Scholar
  40. M. Zanetti, A. Vitti: The Blake-Zisserman model for digital surface models segmentation, in: ISPRS Annals, Copernicus Publications, Göttingen (2013) 355-360.https://doi.org/10.5194/isprsannals-II-5-W2-355-2013Google Scholar

Suggested citation

M. Carriero, A. Leaci, F. Tomarelli. “Segmentation and Inpainting of Color Images.” Journal of Convex Analysis 25 (2018), No. 2, 435–458. https://doi.org/10.68381/jca25030

Download BibTeXPublished by Heldermann Verlag.

Published by Heldermann Verlag, 2018. Rights now held by Banach Press LLC.