Discretization of Total Variation in Optimization with Integrality Constraints (2403.08346v3)
Abstract: We introduce discretizations of infinite-dimensional optimization problems with total variation regularization and integrality constraints on the optimization variables. We advance the discretization of the dual formulation of the total variation term with Raviart--Thomas functions which is known from literature for certain convex problems. Since we have an integrality constraint, the previous analysis from Caillaud and Chambolle [10] does not hold anymore. Even weaker $\Gamma$-convergence results do not hold anymore because the recovery sequences generally need to attain non-integer values to recover the total variation of the limit function. We solve this issue by introducing a discretization of the input functions on an embedded, finer mesh. A superlinear coupling of the mesh sizes implies an averaging on the coarser mesh of the Raviart--Thomas ansatz, which enables to recover the total variation of integer-valued limit functions with integer-valued discretized input functions. Moreover, we are able to estimate the discretized total variation of the recovery sequence by the total variation of its limit and an error depending on the mesh size ratio. For the discretized optimization problems, we additionally add a constraint that vanishes in the limit and enforces compactness of the sequence of minimizers, which yields their convergence to a minimizer of the original problem. This constraint contains a degree of freedom whose admissible range is determined. Its choice may have a strong impact on the solutions in practice as we demonstrate with an example from imaging.
- R. Abergel and L. Moisan. The Shannon total variation. Journal of Mathematical Imaging and Vision, 59(2):341–370, 2017.
- Error estimates for Raviart–Thomas interpolation of any order on anisotropic tetrahedra. Mathematics of Computation, 80(273):141–163, 2011.
- Functions of Bounded Variation and Free Discontinuity Problems, volume 254 of Oxford Mathematical Monographs. Clarendon Press Oxford, 2000.
- C. Bahriawati and C. Carstensen. Three Matlab implementations of the lowest-order Raviart–Thomas mfem with a posteriori error control. Comput. Methods Appl. Math., 5:333–361, 2005.
- DOLFINx: the next generation FEniCS problem solving environment. preprint, 2023.
- S. Bartels. Total variation minimization with finite elements: Convergence and iterative solution. SIAM Journal on Numerical Analysis, 50(3):1162–1180, 2012.
- Discrete total variation flows without regularization. SIAM Journal on Numerical Analysis, 52(1):363–385, 2014.
- Density of polyhedral partitions. Calculus of Variations and Partial Differential Equations, 56(2):28, 2017.
- F. Brezzi and M. Fortin. Mixed and Hybrid Finite Element Methods. Springer New York, NY, 1991.
- C. Caillaud and A. Chambolle. Error estimates for finite differences approximations of the total variation. IMA Journal of Numerical Analysis, 43(2):692–736, 03 2022.
- An upwind finite-difference method for total variation-based image smoothing. SIAM Journal on Imaging Sciences, 4(1):277–299, 2011.
- A. Chambolle and P.-L. Lions. Image recovery via total variation minimization and related problems. Numerische Mathematik, 76(2):167–188, 1997.
- A. Chambolle and T. Pock. Crouzeix–Raviart approximation of the total variation on simplicial meshes. Journal of Mathematical Imaging and Vision, 62(6):872–899, 2020.
- A. Chambolle and T. Pock. Approximating the total variation with finite differences or finite elements. In Andrea Bonito and Ricardo H. Nochetto, editors, Geometric Partial Differential Equations - Part II, volume 22 of Handbook of Numerical Analysis, pages 383–417. Elsevier, 2021.
- A. Chambolle and T. Pock. Learning consistent discretizations of the total variation. SIAM Journal on Imaging Sciences, 14(2):778–813, 2021.
- Accelerated alternating descent methods for Dykstra-like problems. Journal of Mathematical Imaging and Vision, 59(3):481–497, 2017.
- L. Condat. Discrete total variation: New definition and minimization. SIAM Journal on Imaging Sciences, 10(3):1258–1290, 2017.
- A dual algorithm for denoising and preserving edges in image processing. Journal of Numerical Mathematics, 15(2):149–165, 2007.
- M. Gerdts. Solving mixed-integer optimal control problems by Branch&Bound: A case study from automobile test-driving with gear shift. Optimal Control Applications and Methods, 26:1–18, 2005.
- A partial outer convexification approach to control transmission lines. Computational Optimization and Applications, 72(2):431–456, 2019.
- Partial outer convexification for traffic light optimization in road networks. SIAM Journal on Scientific Computing, 39(1):B53–B75, 2017.
- Gurobi Optimization, LLC. Gurobi Optimizer Reference Manual, 2023.
- Challenges in Optimal Control Problems for Gas and Fluid Flow in Networks of Pipes and Canals: From Modeling to Industrial Applications, pages 77–122. Springer Singapore, Singapore, 2017.
- Functional-analytic and numerical issues in splitting methods for total variation-based image reconstruction. Inverse Problems, 30(5):055014, may 2014.
- M. Hintermüller and C.N. Rautenberg. On the density of classes of closed convex sets with pointwise constraints in Sobolev spaces. Journal of Mathematical Analysis and Applications, 426(1):585–593, 2015.
- Piecewise linear approximation of the continuous Rudin–Osher–Fatemi model for image denoising. SIAM Journal on Numerical Analysis, 50(5):2446–2466, 2012.
- S. Leyffer and P. Manns. Sequential linear integer programming for integer optimal control with total variation regularization. ESAIM: Control, Optimisation and Calculus of Variations, 28:66, 2022.
- F. Maggi. Sets of Finite Perimeter and Geometric Variational Problems: An Introduction to Geometric Measure Theory. Number 135. Cambridge University Press, 2012.
- P. Manns and A. Schiemann. On integer optimal control with total variation regularization on multidimensional domains. SIAM Journal on Control and Optimization, 61(6):3415–3441, 2023.
- C. Meyer and A. Schiemann. Regularization and outer approximation algorithms for optimal control in BV. In preparation, 2024.
- L. Modica. The gradient theory of phase transitions and the minimal interface criterion. Archive for Rational Mechanics and Analysis, 98:123–142, 1987.
- Adaptive total variation image deblurring: A majorization–minimization approach. Signal Processing, 89(9):1683–1693, 2009.
- A convex relaxation approach for computing minimal partitions. In 2009 IEEE conference on computer vision and pattern recognition, pages 810–817. IEEE, 2009.
- Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena, 60(1-4):259–268, 1992.
- E. M. Stein and R. Shakarchi. Real analysis: measure theory, integration, and Hilbert spaces. Princeton University Press, 2005.
- J. Wang and B. J. Lucier. Error bounds for finite-difference methods for Rudin–Osher–Fatemi image smoothing. SIAM Journal on Numerical Analysis, 49(2):845–868, 2011.