Flow updates for domain decomposition of entropic optimal transport
Abstract: Domain decomposition has been shown to be a computationally efficient distributed method for solving large scale entropic optimal transport problems. However, a naive implementation of the algorithm can freeze in the limit of very fine partition cells (i.e. it asymptotically becomes stationary and does not find the global minimizer), since information can only travel slowly between cells. In practice this can be avoided by a coarse-to-fine multiscale scheme. In this article we introduce flow updates as an alternative approach. Flow updates can be interpreted as a variant of the celebrated algorithm by Angenent, Haker, and Tannenbaum, and can be combined canonically with domain decomposition. We prove convergence to the global minimizer and provide a formal discussion of its continuity limit. We give a numerical comparison with naive and multiscale domain decomposition, and show that the flow updates prevent freezing in the regime of very many cells. While the multiscale scheme is observed to be faster than the hybrid approach in general, the latter could be a viable alternative in cases where a good initial coupling is available. Our numerical experiments are based on a novel GPU implementation of domain decomposition that we describe in the appendix.
- Minimizing flows for the Monge–Kantorovich problem. SIAM J. Math. Anal., 35(1):61–97, 2003.
- Regularized unbalanced optimal transport as entropy minimization with respect to branching Brownian motion. arXiv:2111.01666, 2021.
- Jean-David Benamou. A domain decomposition method for the polar factorization of vector-valued mappings. SIAM J. Numer. Anal., 32(6):1808–1838, 1994.
- Numerical solution of the optimal transportation problem using the Monge–Ampère equation. Journal of Computational Physics, 260(1):107–126, 2014.
- Robert J. Berman. The Sinkhorn algorithm, parabolic optimal transport and geometric Monge–Ampère equations. Numerische Mathematik, 145:771–836, 2020.
- P. Billingsley. Convergence of Probability Measures. Wiley Series in Probability and Statistics. Wiley, second edn. edition, 1999.
- Asymptotic analysis of domain decomposition for optimal transport (arxiv v1 version). arXiv:2106.08084v1, 2021.
- Asymptotic analysis of domain decomposition for optimal transport. Numerische Mathematik, 153:451–492, 2023.
- Domain decomposition for entropy regularized optimal transport. Numerische Mathematik, 149:819–870, 2021.
- Y. Brenier. Polar factorization and monotone rearrangement of vector-valued functions. Comm. Pure Appl. Math., 44(4):375–417, 1991.
- Yann Brenier. Optimal transport, convection, magnetic relaxation and generalized boussinesq equations. Journal of Nonlinear Science, 19(5):547–570, 10 2009.
- Convergence of entropic schemes for optimal transport and gradient flows. SIAM J. Math. Anal., 49(2):1385–1418, 2017.
- A differential approach to the multi-marginal schrödinger system. SIAM Journal on Mathematical Analysis, 52(1):709–717, 2020.
- On the relation between optimal transport and Schrödinger bridges: a stochastic control viewpoint. Journal of Optimization Theory and Applications, 169:671–691, 2016.
- R. Cominetti and J. San Martin. Asymptotic analysis of the exponential penalty trajectory in linear programming. Mathematical Programming, 67:169–187, 1992.
- IBM ILOG CPLEX. V12.1: User’s manual for CPLEX. International Business Machines Corporation, 46(53):157, 2009.
- M. Cuturi. Sinkhorn distances: Lightspeed computation of optimal transportation distances. In Advances in Neural Information Processing Systems 26 (NIPS 2013), pages 2292–2300, 2013.
- Lemon – an open source C++ graph template library. Electronic Notes in Theoretical Computer Science, 264(5):23–45, 2011. Proceedings of the Second Workshop on Generative Technologies (WGT) 2010.
- Jean Feydy. Geometric data analysis, beyond convolutions. PhD thesis, Universit’e Paris-Saclay, 2020.
- Fast geometric learning with symbolic matrices. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 14448–14462. Curran Associates, Inc., 2020.
- Interpolating between optimal transport and MMD using Sinkhorn divergences. In The 22nd International Conference on Artificial Intelligence and Statistics, pages 2681–2690, 2019.
- Stability of entropic optimal transport and schrödinger bridges. Journal of Functional Analysis, 283(9):109622, 2022.
- Mark Harris et al. Optimizing parallel reduction in cuda. Nvidia developer technology webinar, 2(4):70, 2007.
- Convergence of a Newton algorithm for semi-discrete optimal transport. J. Eur. Math. Soc., 2019.
- Towards a mathematical theory of trajectory inference. arXiv:2102.09204, 2021.
- Christian Léonard. From the Schrödinger problem to the Monge–Kantorovich problem. Journal of Functional Analysis, 262(4):1879–1920, 2012.
- Bruno Lévy. A numerical algorithm for L2 semi-discrete optimal transport in 3D. ESAIM Math. Model. Numer. Anal., 49(6):1693–1715, 2015.
- Quentin Mérigot. A multiscale approach to optimal transport. Computer Graphics Forum, 30(5):1583–1592, 2011.
- OR-Tools. https://developers.google.com/optimization/, 2023.
- Computational optimal transport. Foundations and Trends in Machine Learning, 11(5–6):355–607, 2019.
- Filippo Santambrogio. Optimal Transport for Applied Mathematicians, volume 87 of Progress in Nonlinear Differential Equations and Their Applications. Birkhäuser Boston, 2015.
- A hierarchical approach to optimal transport. In Scale Space and Variational Methods (SSVM 2013), pages 452–464, 2013.
- Convolutional Wasserstein distances: Efficient optimal transportation on geometric domains. ACM Transactions on Graphics (Proc. of SIGGRAPH 2015), 34(4):66:1–66:11, 2015.
- C. Villani. Topics in Optimal Transportation, volume 58 of Graduate Studies in Mathematics. American Mathematical Society, Providence, 2003.
- C. Villani. Optimal Transport: Old and New, volume 338 of Grundlehren der mathematischen Wissenschaften. Springer, 2009.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.