---
title: Tsallis Regularized Optimal Transport
url: https://www.emergentmind.com/topics/tsallis-regularized-optimal-transport
type: topic
---

# Tsallis Regularized Optimal Transport

Tsallis-regularized optimal transport is a class of optimal transport (OT) problems in which the standard cost-minimization formulation is supplemented by a regularization term based on the Tsallis divergence. This approach generalizes entropic (Kullback–Leibler, KL) regularization by introducing a family of power-law (Tsallis or $L^p$) divergences, interpolating between the classic (unregularized) optimal transport, entropic regularization, and quadratic or higher-degree penalizations. Tsallis regularization yields sparse optimal couplings and brings distinct statistical and computational properties, notably offering sample complexity that avoids the curse of dimensionality and enabling new algorithmic implementations. Theoretical investigations have addressed convergence rates, duality theory, central limit properties, and practical iterative schemes. 

## 1. Mathematical Formulation and Duality

Let $P$ and $Q$ be probability measures on a compact set $\Omega \subset \mathbb{R}^d$, and $\Pi(P,Q)$ the set of couplings with marginals $P, Q$. The Tsallis divergence of order $\alpha>1$ (often denoted $q$ in the literature) between a coupling $\pi \ll P \otimes Q$ and $P \otimes Q$ is
\[
D_\varphi(\pi\|P\otimes Q) = \frac{1}{\alpha}\int\left(\left(\frac{d\pi}{d(P\otimes Q)}\right)^\alpha - 1\right)d(P\otimes Q).
\]
Given a continuous cost $c\in\mathcal{C}^1(\Omega\times\Omega)$, the Tsallis-regularized OT problem is
\[
\mathrm{OT}_\alpha(P,Q) = \inf_{\pi\in\Pi(P,Q)} \int c(x,y)\,d\pi(x,y) + D_\varphi(\pi\|P\otimes Q).
\]
For discrete histograms $r, c \in \Delta_n$ and cost matrix $M \in \mathbb{R}^{n\times n}$ with regularization parameter $\lambda>0$, the primal is
\[
d_M^{\lambda, q}(r,c) = \min_{P\in U(r,c)}\langle P, M \rangle - \frac{1}{\lambda} H_q(P),
\]
where $H_q(P)$ denotes Tsallis entropy:
\[
H_q(P) = \frac{1}{1-q}\sum_{i,j} (P_{ij}^q - P_{ij}).
\]
The dual problem (continuous) is
\[
\sup_{f\in L^\infty(P), g\in L^\infty(Q)} \int\left[ f(x)+g(y)-\psi(f(x)+g(y)-c(x,y)) \right]\,d(P \otimes Q)
\]
where $\psi$ is the convex conjugate of $\varphi(t) = (t^\alpha-1)/\alpha$, namely $\psi(u) = (u_+)^\beta/\beta + \text{const}$ with $1/\alpha + 1/\beta = 1$, $u_+ = \max\{u, 0\}$ [2505.04721]. The discrete dual and its Fenchel conjugate reduce to
\[
\max_{u,v\in\mathbb{R}^n}\sum_i u_i p_i + \sum_j v_j q_j - \varepsilon\sum_{i,j}\phi^*\left(\frac{u_i+v_j-C_{ij}}{\varepsilon}\right)
\]
where $\phi^*$ has explicit piecewise form for $q>1$ [2007.00976, 2105.14337].

## 2. Theoretical Properties: Sparsity, Convergence, and Dimensionality

Tsallis regularization with $\alpha>1$ yields couplings whose densities vanish below a threshold, achieving *genuine sparsity* in contrast to the full support of the entropic (KL, $\alpha\to 1$) regularization [2505.04721, 1609.04495, 2007.00976]. The primal is strictly convex for $1<q\leq 2$.

A central result is that, under mild smoothness and compactness assumptions, the empirical Tsallis-regularized OT between empirical measures $P_n, Q_n$ converges at the *parametric rate* $n^{-1/2}$—*independently of the dimension* $d$ [2505.04721]. Specifically, central limit theorems hold for the OT cost, coupling, and dual potentials. This counters prior belief that the lack of strong dual concavity or smoothness in Tsallis regularization induces the curse of dimensionality.

In the framework of $\Gamma$-convergence, minimizers of the Tsallis-regularized problem converge narrowly to those of the unregularized OT as $\varepsilon\to 0$ [2304.06616].

## 3. Algorithmic Schemes and Generalized Sinkhorn Algorithms

Practical computation proceeds via iterative updates of dual potentials, generalizing the Sinkhorn–Knopp matrix scaling to the Tsallis setting. For $q>1$, the dual variable update involves Newton's method or bisection to solve one-dimensional nonlinear equations:
\[
\int \psi'(f+g-c)\,dQ=1
\]
and analogously for $g$ [2505.04721, 2007.00976]. In the discrete setting, the q-Sinkhorn algorithm alternates
\[
u_i^{(k+1)} = \varepsilon\log_q\left\{1/ \sum_j q_j \exp_q\left((v_j^{(k)} - C_{ij})/\varepsilon\right)\right\},
\]
where $\exp_q$ and $\log_q$ are deformed q-exponential and q-logarithm functions [2007.00976, 1609.04495].

For $q>1$, sparsity arises because the derivative of the dual conjugate vanishes on $(-\infty,0]$, so coupling entries are zero wherever $f_i + g_j - C_{ij} < 0$ [2105.14337, 2505.04721]. Algorithmic convergence is monotone and robust under mild conditions, with empirical performance comparable to classical Sinkhorn for a wide range of $q$ [1609.04495, 2007.00976].

## 4. Statistical and Asymptotic Results

Parametric rate convergence with dimension-independence is achieved through an analysis exploiting the geometry of Hölder spaces and a tailored Z-estimation framework for non-Donsker classes [2505.04721]. Central limit theorems are established for the regularized cost, optimal coupling, and dual potentials, characterizing their joint fluctuations around the population values in terms of explicit Gaussian processes and invertible linearizations.

Convergence rates as $\varepsilon\to 0$ have sharp upper bounds: for measures admitting suitable quantization rates, the regularization bias decays as
\[
OT_{q,\varepsilon} - OT = O\left(\varepsilon^{1/(1+(q-1)\alpha)}\log\frac{1}{\varepsilon}\right)
\]
with $\alpha$ the quantization exponent, showing that the KL case ($q=1$) is extremal and fastest [2304.06616]. The strong convexity required for strict statistical error bounds holds efficiently for $1<q\le2$ [2505.04721].

## 5. Applications and Interpretations

Tsallis regularization underpins practical schemes in high-dimensional statistics, machine learning, and distributional inference [2505.04721, 1609.04495]. In ecological inference, it enables accurate reconstruction of joint tables (e.g., ethnicity-vote distributions from marginals and side information), outperforming entropic OT in both accuracy and the alignment of solutions with side constraints when parameters $(q,\lambda)$ are optimally tuned [1609.04495].

For Gaussian and $q$-normal distributions, Tsallis-regularized OT yields explicit closed-form solutions, with regularization tuning the coupling between marginals from tightly coupled (Gaussian map, small $\varepsilon$) to nearly independent (product measures, large $\varepsilon$ or $q\gg1$) [2012.10623].

From an optimization perspective, Tsallis regularization interpolates between the sparse, but less statistically efficient unregularized OT ($\alpha\to1$) and the smooth, fully-supported, but overspread entropic OT ($\alpha\to1^+$), with each value of $\alpha$ balancing bias, sparsity, and statistical efficiency [2505.04721, 1609.04495].

## 6. Comparison with Entropic and Other $f$-divergence Regularizations

The Tsallis-regularized formulation is part of a larger class of $f$-divergence regularized OT problems, which includes the Kullback–Leibler and $\chi^2$ (quadratic) divergences as special cases [2105.14337, 2007.00976]. Distinct from KL, Tsallis regularization produces sparse couplings and provable convergence without the need for strong dual concavity. The semigroup of divergences parametrized by $q$ (or $\alpha$) governs both the degree of sparsity and the algorithmic complexity of the resulting problems. KL regularization is optimal in terms of convergence as $\varepsilon\to0$, but may be suboptimal where sparsity or alignment with interpretable solutions is paramount [2304.06616, 2505.04721].

## 7. Implementation Notes and Empirical Observations

Tsallis-regularized OT problems can be solved using deformed exponential/generalized Sinkhorn routines, mirror descent-based projection methods, or Newton/bisection schemes for dual updates [1609.04495, 2505.04721, 2007.00976]. For $q\approx2$ (Pearson’s $\chi^2$ divergence), row-/column-wise Newton methods are empirically stable and yield very sparse couplings. The choice of $(q, \lambda)$ significantly affects reconstruction accuracy in inference tasks, and in tested real-world settings, optimizing $q$ away from 1 produces substantial improvements over both unregularized and entropic OT [1609.04495]. 

Numerical experiments consistently show that as $q$ increases above 1, the induced optimal coupling becomes sparser, while the number of iterations required for algorithmic convergence remains in line with (or only mildly exceeds) that of the classical Sinkhorn algorithm [2007.00976, 1609.04495]. This confirms that Tsallis regularization is competitive for high-dimensional, large-scale, or sparsity-sensitive transport tasks.

Source: https://www.emergentmind.com/topics/tsallis-regularized-optimal-transport