Papers
Topics
Authors
Recent
Search
2000 character limit reached

Expected Sliced Plans in Optimal Transport

Updated 7 July 2026
  • Expected Sliced Plans are transport couplings obtained by projecting measures onto one-dimensional slices, solving OT problems, and lifting the solutions back to high dimensions.
  • The methodology averages lifted one-dimensional optimal transport plans, offering computational efficiency compared to classical OT while providing an explicit coupling.
  • They bridge the gap between cost-intensive classical OT and fast sliced OT, with applications in interpolation, domain adaptation, and attention mechanisms.

Expected Sliced Plans, introduced in the discrete setting as Expected Sliced Transport (EST) plans, are transport couplings obtained by projecting probability measures onto one-dimensional slices, solving the corresponding one-dimensional optimal transport problems, lifting those plans back to the ambient space, and averaging the lifted couplings over directions. They were developed to resolve a structural limitation of sliced Wasserstein methods: sliced distances are computationally efficient, but they ordinarily do not provide an explicit high-dimensional transport plan. EST therefore occupies an intermediate position between classical optimal transport, which yields a bona fide coupling but is expensive, and sliced optimal transport, which is cheap but usually only returns a scalar discrepancy (Liu et al., 2024).

1. Problem setting and motivation

For probability measures μ1,μ2Pp(Rd)\mu^1,\mu^2 \in \mathcal P_p(\mathbb R^d), classical optimal transport defines the pp-Wasserstein distance by minimizing Euclidean transport cost over couplings γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2). In the discrete case,

μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},

the coupling is a matrix γij\gamma_{ij} with prescribed marginals, and the resulting linear program has complexity roughly O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\})) with standard solvers. Even entropic regularization, while cheaper, still incurs O(nm)\mathcal O(nm) per Sinkhorn iteration and becomes costly for large supports or small regularization (Liu et al., 2024).

Sliced optimal transport reduces this burden by projecting onto one-dimensional directions θSd1\theta \in \mathbb S^{d-1}, solving

Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)

for each slice, and averaging over directions. In one dimension, optimal transport is obtained by sorting or quantile matching, with complexity around O(nlogn+mlogm)\mathcal O(n\log n + m\log m). The resulting sliced Wasserstein distance is therefore much more scalable, and for empirical measures its Monte Carlo approximation typically costs pp0 over pp1 sampled directions. Its principal deficiency is that it averages scalar one-dimensional costs rather than producing a single coupling in pp2, which limits its use in barycenters, interpolation, domain adaptation, embeddings, and related plan-based tasks (Liu et al., 2024, Tanguy et al., 2 Aug 2025).

2. Discrete Expected Sliced Transport construction

The EST construction begins by solving the unique one-dimensional OT problem on each slice. For a fixed pp3, the projected measures pp4 and pp5 admit a unique optimizer pp6. The central operation is then a lifting from this one-dimensional plan back to a coupling pp7 in the original space (Liu et al., 2024).

In the uniform discrete case,

pp8

the projected points are sorted by permutations pp9, and the one-dimensional optimizer is the monotone sorted-to-sorted matching. Lifting simply assigns the same index matching in the ambient space: γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)0 with matrix representation

γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)1

Thus each slice yields a scaled permutation plan (Liu et al., 2024).

For general discrete measures, the lifting must account for projection collisions. Writing γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)2 when γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)3, the projected atoms are equivalence classes γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)4, with class masses

γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)5

The lifted weights are then

γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)6

whenever γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)7 and γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)8. This proportional splitting redistributes the mass assigned by the one-dimensional plan across all pairs within the corresponding source and target projection fibers. Lemma 2.1 shows that the resulting γΓ(μ1,μ2)\gamma \in \Gamma(\mu^1,\mu^2)9 indeed has marginals μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},0 and μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},1 (Liu et al., 2024).

The Expected Sliced Transport plan is the directional expectation

μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},2

where μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},3 is a probability measure on μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},4, typically uniform or absolutely continuous with respect to the uniform measure. In practice,

μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},5

for Monte Carlo directions μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},6 (Liu et al., 2024).

3. Induced discrepancies, metric structure, and generic-measure extensions

Given the EST plan, the original paper defines the Expected Sliced Transport distance

μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},7

Its main theorem states that μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},8 is a metric on the space of finite discrete probability measures in μ1=ip(xi)δxi,μ2=jq(yj)δyj,\mu^1=\sum_i p(x_i)\delta_{x_i}, \qquad \mu^2=\sum_j q(y_j)\delta_{y_j},9. The proof combines symmetry of the slicewise construction, the lower bound γij\gamma_{ij}0, an argument through uniform discrete measures where the quantity coincides with the Projected Wasserstein distance of Rowland et al. (2019), an extension to rational weights by atom replication, and an approximation argument for general finite discrete measures. Under compactness and γij\gamma_{ij}1, the same work also shows that γij\gamma_{ij}2 induces the same topology as γij\gamma_{ij}3 on discrete measures (Liu et al., 2024).

A later generalization reformulates Expected Sliced Plans for generic measures in γij\gamma_{ij}4 by disintegrating each γij\gamma_{ij}5 along the projection map γij\gamma_{ij}6: γij\gamma_{ij}7 For a one-dimensional optimal plan γij\gamma_{ij}8 between γij\gamma_{ij}9 and O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))0, the lifted plan O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))1 couples the fibers O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))2 and O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))3 independently conditional on O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))4. Averaging over O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))5 produces

O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))6

and the associated Expected Sliced discrepancy is

O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))7

This generic-measure analysis shows that the construction remains canonical and measurable, but it also clarifies an important limitation: O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))8 is not a true metric on all of O((min{n,m})3log(min{n,m}))\mathcal O((\min\{n,m\})^3\log(\min\{n,m\}))9, because self-distance can be positive for continuous measures. Two explicit counterexamples are given. For O(nm)\mathcal O(nm)0 and O(nm)\mathcal O(nm)1, one gets O(nm)\mathcal O(nm)2. For O(nm)\mathcal O(nm)3 uniform on the unit ball in O(nm)\mathcal O(nm)4, one gets O(nm)\mathcal O(nm)5. By contrast, if O(nm)\mathcal O(nm)6 is absolutely continuous with respect to the uniform measure and O(nm)\mathcal O(nm)7 is countably discrete, then projection collisions occur only on a null set of directions, and O(nm)\mathcal O(nm)8 becomes a true distance on the countably discrete class O(nm)\mathcal O(nm)9 (Tanguy et al., 2 Aug 2025).

4. Position within sliced-plan methodology

Expected Sliced Plans belong to a broader family of sliced constructions that attempt to recover couplings, not merely distances. For uniform discrete measures, the EST distance can be written as

θSd1\theta \in \mathbb S^{d-1}0

which coincides with the Projected Wasserstein distance studied by Rowland et al. (2019). The same paper also introduces a temperature scheme

θSd1\theta \in \mathbb S^{d-1}1

that interpolates between uniform averaging over directions at θSd1\theta \in \mathbb S^{d-1}2 and concentration on the minimizing slice as θSd1\theta \in \mathbb S^{d-1}3, thereby connecting EST to min-SWGG (Liu et al., 2024).

Later work on Differentiable Generalized Sliced Wasserstein Plans adopts the min-SWGG philosophy rather than global averaging. It formulates min-GSWP as a bilevel problem: the inner problem solves one-dimensional OT after a scalar feature map θSd1\theta \in \mathbb S^{d-1}4, while the outer problem evaluates the lifted plan in the original cost. Because the outer value function is piecewise constant or discontinuous in θSd1\theta \in \mathbb S^{d-1}5, that work introduces a smoothed plan

θSd1\theta \in \mathbb S^{d-1}6

based on Gaussian perturbations and Stein’s lemma. This is literally an expected sliced plan, but only locally around a candidate slice, and its purpose is differentiability of the outer optimization rather than averaging over a global directional law (Chapel et al., 28 May 2025).

The 2025 analysis of generic sliced plans contrasts Expected Sliced Plans with Pivot Sliced Discrepancy. Pivot Sliced Discrepancy is derived from the θSd1\theta \in \mathbb S^{d-1}7-based Wasserstein distance, admits an exact constrained Kantorovich formulation, and is shown to be a semi-metric on θSd1\theta \in \mathbb S^{d-1}8 and a metric under additional assumptions on projections. Expected Sliced Plans, by contrast, are obtained by independent lifting along orthogonal fibers, typically yield dense probabilistic couplings, and do not admit an analogous constrained optimization interpretation (Tanguy et al., 2 Aug 2025).

A concise comparison is therefore:

Construction Slice usage Plan character
Expected Sliced / EST Average lifted plans over many directions Explicit averaged coupling, typically dense
min-SWGG / DGSWP Select or optimize a single slice Explicit single-slice coupling, upper-bounding OT
Pivot Sliced Discrepancy Enforce a constrained projected coupling Constrained Wasserstein plan, often sparse
Sliced Wasserstein distance Average one-dimensional costs only No global coupling

Taken together, these works suggest a three-way distinction between averaging slices, optimizing a slice, and constraining a slice; the main technical differences concern admissibility, metric properties, sparsity, and the extent to which the resulting coupling approximates a full OT plan.

5. Computational realizations and differentiable variants

For empirical measures θSd1\theta \in \mathbb S^{d-1}9 and Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)0, a practical EST pipeline consists of sampling Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)1 directions, projecting points, aggregating overlapping projections into one-dimensional atoms, solving one-dimensional OT by sorting and cumulative-mass matching, lifting each one-dimensional optimizer with the proportional splitting rule, averaging the lifted plans, and finally evaluating the Euclidean cost under the averaged coupling. Per slice, the cost is Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)2, and the total complexity is

Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)3

with the map Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)4 piecewise constant for finite supports (Liu et al., 2024).

The generic-measure formulation preserves essentially the same Monte Carlo structure. For empirical measures, one computes the projected matrix Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)5 of the one-dimensional optimal plan, the normalization factors

Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)6

forms the lifted coupling

Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)7

and averages over directions. This retains the Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)8 scaling that makes sliced couplings attractive when full OT is infeasible (Tanguy et al., 2 Aug 2025).

A distinct computational development appears in ESPFormer, which uses Expected Sliced Transport Plans as an attention mechanism. In the uniform equal-support case, each slice Wp(θ#μ1,θ#μ2)W_p\bigl(\theta_\#\mu^1,\theta_\#\mu^2\bigr)9 is implemented through differentiable soft sorting: O(nlogn+mlogm)\mathcal O(n\log n + m\log m)0 followed by

O(nlogn+mlogm)\mathcal O(n\log n + m\log m)1

Axis-aligned slices are used, with O(nlogn+mlogm)\mathcal O(n\log n + m\log m)2, so every feature dimension acts as a slicer. Slice weights are then set by an inverse-temperature softmax,

O(nlogn+mlogm)\mathcal O(n\log n + m\log m)3

and the final attention matrix is

O(nlogn+mlogm)\mathcal O(n\log n + m\log m)4

Because each O(nlogn+mlogm)\mathcal O(n\log n + m\log m)5 is a scaled permutation in the hard-sorting limit and a row/column-balanced matrix under SoftSort, O(nlogn+mlogm)\mathcal O(n\log n + m\log m)6 is approximately doubly-stochastic, and exactly doubly-stochastic as O(nlogn+mlogm)\mathcal O(n\log n + m\log m)7. This construction avoids iterative Sinkhorn normalization, is fully parallelizable across slices, and has overall complexity O(nlogn+mlogm)\mathcal O(n\log n + m\log m)8, compared with O(nlogn+mlogm)\mathcal O(n\log n + m\log m)9 for Sinkformer with pp00 Sinkhorn iterations (Shahbazi et al., 11 Feb 2025).

6. Empirical behavior, applications, and limitations

The original EST experiments compare classical OT, entropic OT, and EST on simple two-dimensional point clouds. OT plans are sparse and typically close to permutations; entropic plans are much more diffuse; EST lies between them, displaying some mass splitting but generally less than entropic OT. On Point Cloud MNIST 2D, EST-based interpolations behave well visually, and increasing the temperature parameter pp01 sharpens the interpolation by reducing splitting. In a weak-convergence experiment along a Wasserstein geodesic pp02, only OT and EST discrepancies go to pp03 as pp04; entropic OT and the outer product pp05 do not. Within a linear optimal transport embedding pipeline, EST embeddings are competitive with OT-based embeddings for moderate pp06, but performance degrades as pp07 increases because different samples then use different effective slicing measures pp08, reducing comparability across embeddings (Liu et al., 2024).

ESPFormer repurposes the same structural idea for attention regularization. Across image classification, point cloud classification, sentiment analysis, and neural machine translation, the reported experiments show consistent gains over vanilla attention and Sinkhorn-based attention. On IWSLT’14 De–En, after 10 epochs of fine-tuning, ESPFormer achieves BLEU scores of pp09 and pp10 in the two tested settings. The paper further reports that gains are especially pronounced in low-data or fine-grained regimes, and attributes this to the doubly-stochastic, more balanced attention patterns induced by ESP (Shahbazi et al., 11 Feb 2025).

The broader sliced-plan literature also exposes important limitations of expected averaging. In gradient-flow experiments, Expected Sliced discrepancy often does not converge to the target, especially in higher dimension or complex geometries. In color transfer, barycentric projections of Expected Sliced Plans often produce duller, less faithful colors than alternative sliced-plan methods. In shape registration, Expected Sliced remains usable as a source of soft correspondences, but Min-Pivot Sliced generally yields better registration quality. By contrast, DGSWP, which optimizes a single generalized slice rather than averaging many of them, performs well for gradient flows in Euclidean and hyperbolic spaces and for conditional flow matching in image generation, where it yields better FID than OT-CFM and I-CFM in the 100-step Euler sampling regime (Tanguy et al., 2 Aug 2025, Chapel et al., 28 May 2025).

Several limitations recur across these works. EST is a non-optimal plan, so its induced cost satisfies pp11. Approximation quality depends on the number of slices pp12, and convergence rates in pp13 are not fully analyzed in the original paper. High temperatures in the min-SWGG interpolation scheme can harm transport-based embeddings because the direction distribution becomes pair-dependent. The generic-measure theory shows that positive self-distance can occur for continuous measures, so metricity is restricted to discrete settings unless the construction is modified. These observations support a more precise view of Expected Sliced Plans: they are principled, explicit, and computationally tractable couplings that successfully bridge sliced OT and plan-based transport in the discrete regime, but their theoretical behavior and empirical suitability depend strongly on how directions are averaged, how lifting is performed, and whether the target application benefits from soft averaged couplings or from sharper single-slice approximations (Liu et al., 2024, Tanguy et al., 2 Aug 2025).

Definition Search Book Streamline Icon: https://streamlinehq.com
References (4)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Expected Sliced Plans.