--- title: Radon–Wasserstein Gradient Flows url: https://www.emergentmind.com/topics/radon-wasserstein-gradient-flows type: topic --- # Radon–Wasserstein Gradient Flows Radon–Wasserstein gradient flows constitute a new class of gradient flows of the Kullback–Leibler (KL) divergence, formulated over novel transportation-based Riemannian geometries on spaces of probability measures. These geometries are defined using the Radon transform so that the gradient-flow velocities depend solely on one-dimensional projections of the evolving measure. The resulting flows—specifically, the Radon–Wasserstein (RW) and Regularized Radon–Wasserstein (RRW) flows—not only admit particle approximations that scale linearly in both the number of particles and the ambient dimension but also demonstrate robust convergence and stability properties, making them effective for high-dimensional sampling tasks [2602.05227]. ## 1. Radon–Wasserstein Geometry The foundational component of RW geometry is the Radon transform. Given \( S^{d-1} \), the unit sphere in \( \mathbb{R}^d \), and \( \theta \in S^{d-1} \), the projection \( \Pi_\theta(x) = x \cdot \theta \) defines the one-dimensional projection of \( x \) onto \( \theta \). For a probability density \( \rho \in \mathcal P_2(\mathbb{R}^d) \), the Radon transform is defined as \[ (R^\theta \rho)(p) = \int_{\{x : x \cdot \theta = p\}} \rho(x) \, d\mathcal{H}^{d-1}(x), \quad p \in \mathbb{R}. \] The full Radon transform \( R\rho \) is the measure on \( D^d = (S^{d-1} \times \mathbb{R})/\{(\theta,p)\sim(-\theta,-p)\} \) given by \( R\rho(d\theta\,dp) = (R^\theta\rho)(p)\,d\theta\,dp \). Its dual, the back-projection \( R^* \), is \[ R^*g(x) = \int_{S^{d-1}} g\big(\theta, \theta \cdot x \big) \, d\theta. \] The RW metric is defined via spherical averages of one-dimensional motions. The RW metric tensor at \( \rho \) is: \[ g^R_\rho(v,v) = \inf_{u\,:\, R^*(\theta u) = v} \int_{S^{d-1}} \int_\mathbb{R} |u(\theta, p)|^2 (R^\theta \rho)(p) dp\,d\theta, \] where the infimum is over all \( u \) such that \( v(x) = R^*\left[\theta\,u(\theta, \theta \cdot x)\right](x) \). This restriction to one-dimensional projections maintains low complexity even as \( d \gg 1 \) [2602.05227]. ## 2. KL Gradient Flows in Radon–Wasserstein Geometry Let the target measure be \( \pi \propto e^{-U(x)} dx \). The KL divergence relative to \( \pi \) is \[ \mathcal F(\rho) = \int_{\mathbb{R}^d} \log \left( \frac{d\rho}{d\pi} \right) d\rho \qquad (\rho \ll \pi). \] The RW gradient flow of \( \mathcal F \) seeks a velocity \( v = -\operatorname{grad}_{g^R} \mathcal F(\rho) \) so that \[ g^R_\rho(v, w) = d\mathcal F(\rho)[w], \ \forall w. \] The associated PDE is the continuity equation \[ \partial_t \rho + \operatorname{div}(\rho v) = 0, \] with \[ v(t,x) = - \int_{S^{d-1}} \theta \left[ \frac{\partial_p (R^\theta \rho_t) + R^\theta (\rho_t \nabla_\theta U)}{R^\theta \rho_t} \right] (x \cdot \theta)\, d\theta. \] Equivalently, \[ v(t,x) = - \int_{S^{d-1}} \theta \left( \partial_p \log R^\theta \rho_t(p) + \frac{R^\theta(\rho_t \nabla_\theta U)(p)}{R^\theta\rho_t(p)} \right)_{p = x \cdot \theta} d\theta. \] The velocity is thus determined by the family of one-dimensional projections and related convolution operations. ## 3. Regularized Radon–Wasserstein Flows The RRW metric introduces kernel smoothing and an entropic regularization parameter. Given a smooth even kernel \( k: \mathbb{R} \to [0,\infty) \) and \( \varepsilon > 0 \), \[ g^{k,\varepsilon}_\rho(v,v) = \inf_{v = R^*(\theta k*u),\, u \in L^2} \int_{S^{d-1}} \int_\mathbb{R} (u(\theta,p))^2 (k * R^\theta \rho + \varepsilon)(p) dp\,d\theta. \] This ensures strictly positive densities along each projection, avoiding density-estimation artifacts in empirical approximations. The RRW gradient flow PDE is \[ \partial_t \rho + \operatorname{div}(\rho v) = 0, \qquad v(t,x) = -\int_{S^{d-1}} \theta \, k*\left[ \frac{k' * R^\theta \rho_t + k*R^\theta(\rho_t \nabla_\theta U)}{k*R^\theta \rho_t + \varepsilon} \right] (x \cdot \theta) d\theta. \] In practice, final smoothing may be omitted for the congruent particle scheme. ## 4. Interacting-Particle Approximations and Algorithms The interaction terms in the RW and RRW flows depend only on one-dimensional projections \( p_i = \theta \cdot x_i \). Particle systems evolve by repeatedly projecting all particles along a sampled random direction, using one-dimensional convolution-based updates for velocities: - At each time step, sample \( \theta_m \sim \mathrm{Unif}(S^{d-1}) \). - Compute projections \( p^i_m = x^i_m \cdot \theta_m \) and projected score terms \( s^i_m = \nabla U(x^i_m) \cdot \theta_m \). - Calculate velocities using either a direct convolution or FFT-accelerated scheme. For the kernel-density Radon–Wasserstein (KDRW) update, \[ v^i_m = \frac{\sum_{j=1}^n k'(p^i_m - p^j_m) + \sum_{j=1}^n k(p^i_m - p^j_m) s^j_m}{\sum_{j=1}^n k(p^i_m - p^j_m) + n\varepsilon} \] with naive \( O(n^2) \) cost per projection. The FFT-accelerated variant bins projected positions, performs convolutions via FFTs (cost \( O(n) + O(G \log G) \) given grid-size \( G \)), and is overall \( O(nd) \), linear in both \( n \) and \( d \) [2602.05227]. ## 5. Theoretical Results and Guarantees The primary results are: - **Well-posedness:** For smooth kernels \( k \), positive \( \varepsilon \), and \( \nabla U \) Lipschitz with quadratic confinement, RRW and KDRW flows admit unique global solutions with controlled second moments. - **Particle system well-posedness:** The finite \( n \) ODEs have unique global solutions, and their empirical measures maintain the moment bound. - **Stability and mean-field convergence:** The PDE and particle flows are stable with respect to initial measure, and the particle approximation converges to the continuum solution as \( n \to \infty \). - **Stochastic-gradient convergence:** The single-direction-per-step Euler discretization achieves mean-squared error \( O(\tau) \), uniformly in \( d \). - **Long-time convergence:** Under nondegeneracy of the kernel’s Fourier transform, RRW flows converge weakly to the target measure as \( t \to \infty \). These results establish the RW and especially the RRW frameworks as robust methods for interacting-particle sampling and transport, with strong guarantees on well-posedness, stability, and convergence that are dimension-independent in critical respects [2602.05227]. ## 6. Numerical Performance and Comparative Assessment The performance of KDRW and RRW methods was assessed on Gaussian and Rosenbrock “banana” target distributions in various dimensions. Metrics included maximum mean discrepancy (MMD\(^2\)) and mean error. Algorithmic comparisons included i.i.d. sampling, Stein variational gradient descent (SVGD), and Langevin Monte Carlo (LMC). Key empirical findings: - **Bandwidth sensitivity:** MMD\(^2\) profiles versus kernel bandwidth show a U-shape; in low \( d \), optimal bandwidth is around 0.2, while in high \( d \) performance is relatively insensitive to bandwidth. - **Per-step cost:** FFT-accelerated RW methods achieve per-step times under 100 ms for \( n \approx 10^4, d \approx 10^3 \), with wall-time scaling linear in both \( n \) and \( d \). - **Convergence:** RW methods decrease MMD\(^2\) rapidly, surpassing the i.i.d. baseline in few steps. SVGD performs comparably for \( n \gg d \) but suffers from variance collapse when \( n < d \). - **Error scaling with sample size:** | \( d \) | i.i.d. Slope | KDRW_fft | RRW_fft | |-----------|--------------|----------|---------| | 2 | –1.10 | –1.49 | –1.65 | | 32 | –1.02 | –1.23 | –1.20 | | 256 | –0.99 | –1.06 | –1.05 | | 2048 | –1.00 | –1.02 | –0.99 | - **Comparison to SVGD:** RW methods outperform SVGD particularly in regimes with \( n < d \), where SVGD collapses variance. These results indicate consistent improvement in quantization error, with super-Monte-Carlo rates in low dimensions and competitive scaling in high dimensions, highlighting the scalability and robustness of the RW and RRW approaches [2602.05227]. Source: https://www.emergentmind.com/topics/radon-wasserstein-gradient-flows