---
title: Optimal Transport (OT)
url: https://www.emergentmind.com/topics/optimal-transport-ot
type: topic
---

# Optimal Transport (OT)

Optimal Transport (OT) is a mathematical theory that equips the space of probability measures with a geometry induced by an underlying cost structure, providing a convex variational framework for optimally reallocating mass between probability distributions. In its modern Kantorovich form, OT underpins a vast array of developments in analysis, geometry, statistics, and machine learning, enabling the comparison and manipulation of distributions via optimal couplings. The theory encompasses foundational results such as metric structure, duality, existence and uniqueness (notably Brenier’s theorem), statistical rates, entropic regularization, and computational schemes such as Sinkhorn’s algorithm, with significant implications for both theoretical and applied disciplines [2407.18163].

## 1. Monge and Kantorovich Formulations

Classically, Monge’s problem seeks a transport map $T:X\to X$ pushing a source measure $\mu$ to a target measure $\nu$ by minimizing a cost functional:
\[
\inf_{T:T_\#\mu=\nu} \int_X c(x,T(x))\,\mu(dx),
\]
with $c:X\times X\to[0,\infty)$ a lower-semicontinuous cost (e.g. $c(x,y)=\|x-y\|^p$). However, this formulation is nonconvex and may fail to admit solutions, particularly when $\mu$ or $\nu$ lacks absolute continuity [2407.18163].

Kantorovich’s relaxation replaces the deterministic map with a probabilistic coupling $\gamma\in\Pi(\mu,\nu)$:
\[
\Pi(\mu,\nu) = \bigl\{\gamma\in\mathcal P(X\times X): \gamma(\cdot\times X)=\mu,\, \gamma(X\times\cdot)=\nu \bigr\},
\]
and considers the convex minimization:
\[
\min_{\gamma\in\Pi(\mu,\nu)}\int_{X\times X} c(x,y)\,\gamma(dx,dy).
\]
This convex program always admits solutions under mild conditions and reduces to the Monge formulation under additional regularity assumptions (e.g., absolute continuity and quadratic cost) via results like Brenier’s theorem [2407.18163].

In the discrete case, couplings correspond to nonnegative matrices $P$ with prescribed row and column sums, transforming the OT problem into a classical linear program, whose solutions are concentrated on sparse permutations in the case of uniform marginals.

## 2. Duality and Structure of Optimal Couplings

OT admits a rich dual structure. The Kantorovich dual problem is
\[
\inf_{\gamma\in\Pi(\mu,\nu)} \int c\,d\gamma \ge \sup_{f,g}\left\{ \int f\,d\mu+\int g\,d\nu : f(x)+g(y)\le c(x,y) \right\}.
\]
For continuous costs on compact spaces, strong duality holds, optimal potentials $(f^*,g^*)$ exist, and the complementary slackness condition $f^*(x)+g^*(y)=c(x,y)$ holds $\gamma^*$-almost everywhere. In the quadratic case, this recovers convex duality and subdifferential calculus central to the geometric structure of transport [2407.18163].

If the source is absolutely continuous, Brenier’s theorem guarantees the existence and uniqueness (up to sets of measure zero) of an optimal map $T=\nabla\varphi$ for $c(x,y)=\|x-y\|^2$, with $\varphi$ a convex potential and the coupling $\gamma=(\text{id},T)_\#\mu$ [2407.18163]. In one dimension, the optimal plan is given in closed form via the increasing rearrangement, and the Wasserstein distance admits an explicit quantile representation.

## 3. Wasserstein Distances: Metric Structure and Properties

For $p\ge1$, the $p$-Wasserstein distance on $\mathcal P_p(\mathbb R^d)$ is defined as
\[
W_p(\mu,\nu) = \left(\inf_{\gamma\in\Pi(\mu,\nu)} \int \|x-y\|^p\,d\gamma(x,y)\right)^{1/p},
\]
providing a true metric that metrizes weak convergence (plus moment convergence) of measures. Fundamental properties include monotonicity in $p$, boundedness by total variation on bounded sets, and explicit quantile formulas in dimension one [2407.18163].

The Wasserstein distance underpins geometric analysis and characterizes convergence of empirical measures at quantifiable rates. When $d>2p$, the minimax rate for $E W_p(\mu_n,\mu)$ is $n^{-1/d}$, a manifestation of the curse of dimensionality [2407.18163]. For smoother underlying measures

Source: https://www.emergentmind.com/topics/optimal-transport-ot