---
title: Soft-Radial Projection in Learning and Cosmology
url: https://www.emergentmind.com/topics/soft-radial-projection
type: topic
---

# Soft-Radial Projection in Learning and Cosmology

Soft-radial projection refers to a class of mathematical transformations designed to retain crucial structural or statistical information while mapping from high-dimensional or unconstrained spaces to sets obeying specific constraints. Two distinct but related contexts dominate the modern literature: (1) differentiable mappings for constrained end-to-end learning in optimization and machine learning [2602.03461], and (2) harmonic-weighted projections in cosmological data analysis to unmix radial scale information in redshift-space distortion (RSD) measurements [2106.05293]. Both address fundamental limitations of hard or orthogonal projections, such as gradient degeneracy or modal mixing, by introducing "soft" or smooth radial weighting along the transformation direction.

## 1. Conceptual Foundations and Motivations

Hard projections, such as orthogonal projection onto a constraint set $C$, are widely used in machine learning pipelines and scientific data processing. However, these projections induce degeneracies in the Jacobian, resulting in rank deficiency and thus non-invertible transformations in directions orthogonal to the active constraints. This can stall optimization, nullify important gradients, and hinder learning dynamics, especially in safety-critical domains requiring constrained predictions [2602.03461].

Similarly, in cosmological data analysis, naive tomographic projections of 3D spatial observations (such as RSDs) result in mixing of linear and nonlinear scales due to the broad Fourier kernels associated with tomographic bins. This mixing introduces model bias, particularly problematic for precision constraints on parameters sensitive to small-scale nonlinearities and their theoretical uncertainties [2106.05293].

Soft-radial projection schemes mitigate these challenges by replacing abrupt, boundary-collapsing projections with smooth, radially parameterized maps or soft harmonic weights. These constructions recover desirable properties: strictly feasible outputs for constrained learning and nearly lossless, scale-selective mode separation for cosmological statistics.

## 2. Formal Definition: Soft-Radial Projection in Constrained Learning

Let $C\subset\mathbb{R}^n$ be a closed convex set with nonempty interior $\mathrm{Int}(C)$, and let $u_0\in\mathrm{Int}(C)$ be a fixed anchor point.

### Construction

1. **Hard Radial Projection**: For $u\in\mathbb{R}^n$, define:
   $$
   \alpha^*(u) := \sup\{\alpha\in[0,1]: u_0 + \alpha(u-u_0)\in C\}
   $$
   $$
   q(u) = \begin{cases}
     u, & u\in C \\
     u_0 + \alpha^*(u)(u-u_0), & u\notin C
   \end{cases}
   $$
2. **Radial Contraction**: Fix a $C^1$ strictly increasing function $r:[0,\infty)\to[\varepsilon,1)$ with $r(0)=\varepsilon>0$ and $\lim_{\rho\to\infty} r(\rho)=1$. Typical parametrizations include rational, exponential, or hyperbolic forms, with tunable scale and minimum value. $r(\cdot)$ governs the strength and smoothness of contraction.

3. **Soft-Radial Projection Map**:
   $$
   \rho(u) := \|u-u_0\|^2
   $$
   $$
   p(u) := u_0 + r(\rho(u)) \big( q(u) - u_0 \big)
   $$

4. **Ray-wise Parameterization**: Writing $u = t v$ with $\|v\|=1$, define $t_\text{bar}(v) := \sup\{ t \geq 0 : t v \in C \}$. Then $q(t v) = \min\{t, t_\text{bar}(v)\} v$, and the full mapping reads
   $$
   p(t v) = r(t^2)\min\{t, t_\text{bar}(v)\} v.
   $$

The key property is that $p(u)\in\mathrm{Int}(C)$ for all $u$, achieving strict feasibility without inducing degeneracy in the Jacobian almost everywhere [2602.03461].

## 3. Theoretical Properties and Advantages

### Jacobian Structure

For $p(u)=r(\|u\|^2)q(u)$ (assuming $u_0=0$ for brevity):
- **Interior ($u\in\mathrm{Int}(C)$)**:
  $$
  J_p(u) = r(\rho) I + 2 r'(\rho) uu^\intercal
  $$
  The eigenvalues are strictly positive, preserving gradients along all directions. The transformation is invertible.

- **Exterior ($u\notin C$)**:
  Using the Minkowski gauge/recession function for the convex set $C$, the Jacobian is generically full-rank except on a null set.

### Comparison to Standard Projection

Orthogonal projection onto $\partial C$ annihilates directions orthogonal to the boundary, which manifests as vanishing singular values in the Jacobian and precludes backpropagation through these collapsed modes. By contrast, soft-radial projection maintains non-zero eigenvalues in all directions, thus fully preserving the gradient signal required for end-to-end learning [2602.03461].

### Universal Approximation

Given any universal approximator $G$ (e.g., deep ReLU networks), the class $\{p\circ g : g \in G\}$ remains universal on $C$:
$$
\forall h:Z\to C \text{ continuous, } \forall \epsilon>0, \exists g\in G : \sup_{z\in Z} \|p(g(z)) - h(z)\| \leq \epsilon
$$
Thus, soft-radial layers can enforce constraints on predictions without loss of expressive power [2602.03461].

## 4. Implementation and Computational Complexity

Algorithmic implementations of soft-radial projection rely on:

1. **Anchor-shifting:** Center inputs at $u_0$.
2. **Boundary search:** For polyhedral $C = \{x : Ax\leq b\}$, compute $\alpha^* = \min_{i: a_i^\intercal v > 0} \frac{b_i-a_i^\intercal u_0}{a_i^\intercal v}$. For ellipsoids or more general sets, closed form or root finding is adopted.
3. **Application of radial map $r$:** Evaluate $r(\rho)$ and combine with $q(u)$.
4. **Autodifferentiation:** The backward pass uses the composite Jacobian formula $J_p(u) = r(\rho)J_q(u) + 2 r'(\rho) q(u) u^\intercal$ for efficient gradient computation.

Complexity is $O(m)$ for $m$ linear constraints, $O(1)$ for balls, and $O(\log(1/\tau))$ for root-finding (for general convex sets) per input [2602.03461].

## 5. Extended Context: Soft-Radial Projection in Cosmological Analysis

In spectroscopic RSD and weak lensing surveys, soft-radial (radial-harmonic) projection adopts harmonic radial weighting:
$$
w(\eta,z) = \cos\left(2\pi \eta \frac{r^{\rm ref}(z)}{\Delta r^{\rm ref}}\right)
$$
where $r^{\rm ref}(z)$ is comoving distance. This weighting, when applied in constructing generalized tomographic window functions, produces angular spectra:
$$
C^{\eta_a\eta_b}(\ell) = \frac{1}{r_w^2} \frac{1}{\pi} \int_0^{\infty} dk_\parallel\;P\big(\sqrt{k_\perp^2+k_\parallel^2}, \mu\big) \widetilde{K}(k_\parallel; \eta_a, \eta_b)
$$
with the kernel $\widetilde{K}(k_\parallel; \eta_a, \eta_b)$ sharply localized in $k_\parallel$ due to the harmonic weight's near-delta-function Fourier transform [2106.05293].

This unmixes small-scale (FoG) and large-scale (linear) radial modes, enabling scale-selective analysis that is otherwise impossible using top-hat binning:
- Each high-$\eta$ bin becomes sensitive to a narrow band in $k_\parallel$
- Large-scale modes ($k_\parallel\lesssim0.04$) are handled separately in hybrid estimators

The method nearly regains the constraining power of the full 3D power spectrum $P(k,\mu)$, essentially eliminating parameter-dependent model bias due to FoG scale mixing. This approach is particularly well-suited for joint RSD and weak lensing analyses [2106.05293].

## 6. Empirical Results and Applications

### End-to-End Learning with Constraints

In constrained machine learning, soft-radial projection achieves strict feasibility and superior convergence relative to baselines.

- **Portfolio Optimization (capped simplex constraints):** Soft-radial projection (SRP) delivers substantially higher net Sharpe ratio (0.90) and lower turnover (0.06) compared to softmax, orthogonal projection, DC3, and HardNet baselines [2602.03461].
- **Resource Dispatch (scaled capped simplex constraints):** SRP matches the best-served rate (0.84) while maintaining higher robustness in the presence of noisy dynamics.

| Method     | SR (net)         | Turnover  |
|------------|------------------|-----------|
| Softmax    | 0.63 (±0.19)     | 0.22      |
| O-Proj     | 0.25 (±0.18)     | 0.48      |
| DC3        | 0.63 (±0.08)     | 0.23      |
| HardNet    | 0.62 (±0.11)     | 0.19      |
| SRP        | 0.90 (±0.03)     | 0.06      |

### Cosmological Parameter Estimation

Comparisons of cosmological information recovery between standard tomographic projection and soft-radial (radial-harmonic) weighting:

| Estimator         | $\sigma(f)$ | $|b_f|/\sigma_f$ |
|-------------------|-------------|-----------------|
| $3$D $P(k,\mu)$   | 0.013       | 0.1             |
| Tomography        | 0.055       | 0.1             |
| Hybrid (radial-harmonic) | 0.013 | 0.1             |

Tomographic estimators lose a factor of $\sim4$ in statistical precision for the growth rate $f$, while the hybrid soft-radial projection method recovers nearly all 3D information in angular space [2106.05293].

## 7. Limitations and Extensions

Key limitations of current soft-radial projection schemes include the requirement that $C$ be convex and contain a known interior point, and the computational demand of harmonic kernel evaluation in cosmological settings. Extensions under active research include handling nonconvex feasible sets, anchor point selection, piecewise convex covers, or endowing the radial contraction map $r(\cdot)$ with data-driven learnable parameters [2602.03461]. In cosmology, optimal partitioning of $\eta$-bins, hybridization with 3D estimators for large-scale modes, and cross-correlation with weak lensing tomography represent continued areas of development [2106.05293].

Source: https://www.emergentmind.com/topics/soft-radial-projection