---
title: Orthogonal Spherical Smoothing Techniques
url: https://www.emergentmind.com/topics/orthogonal-spherical-smoothing
type: topic
---

# Orthogonal Spherical Smoothing Techniques

Searching arXiv for recent papers on orthogonal spherical smoothing and closely related methods.
arXiv search query: orthogonal spherical smoothing Jacobian approximation derivative-free Levenberg-Marquardt nonlinear least squares
Orthogonal spherical smoothing denotes a family of constructions in which smoothing on a sphere, or by spherical perturbations, is coupled to an orthogonality structure. In derivative-free nonlinear least-squares, the term refers to approximating Jacobian matrices by averaging directional finite differences along orthonormal random directions drawn uniformly on the Stiefel manifold; in that setting it underpins a derivative-free Levenberg–Marquardt method with probabilistically first-order accurate gradient models and a high-probability complexity bound [2407.12542]. In other parts of the literature, closely related language denotes averaging over orthogonal spherical-harmonic modes in room acoustics, regularization in an orthogonal spherical basis in parallel MRI, orthogonal projection and tight-frame smoothing on \( \mathbb S^2 \), or coordinate-wise smoothing in a transported orthonormal tangent frame on the sphere [2401.03458][1802.01108][2311.18333][1801.04978].

## 1. Derivative-free definition in nonlinear least-squares

For nonlinear least-squares, let \( r:\mathbb R^n \to \mathbb R^m \) be the vector of residuals and
\[
f(x)=\tfrac12\|r(x)\|^2.
\]
Orthogonal spherical smoothing is introduced componentwise through the spherically smoothed residual
\[
r_{s,i}(x) \coloneqq E_{u\sim \mathrm{Uniform}(S^{n-1})}[\,r_i(x+\gamma u)\,],
\]
where \( S^{n-1} \) is the unit sphere in \( \mathbb R^n \) and \( \gamma>0 \) is a smoothing radius. Its gradient satisfies
\[
\nabla r_{s,i}(x)= (n/\gamma)\;E_{u\sim \mathrm{Uniform}(S^{n-1})}[\,r_i(x+\gamma u)\,u\,].
\]
In implementation one draws \( b \) orthonormal directions
\[
[u_1,\dots,u_b]\in \mathrm{St}(n,b) \coloneqq \{\,U\in\mathbb R^{n\times b}:U^\top U=I_b\,\},
\]
uniformly at random on the Stiefel manifold, and forms
\[
\widetilde{\nabla} r_i(x)=\frac{n}{b}\sum_{j=1}^b
\frac{[\,r_i(x+\gamma u_j)-r_i(x)\,]\,u_j}{\gamma}.
\]
Because any column \( u_j \) of such a \( U \) is marginally uniform on \( S^{n-1} \), this is an unbiased estimator of \( \nabla r_{s,i}(x) \) [2407.12542].

The defining feature is not merely spherical perturbation, but the use of an orthonormal frame. The crucial point is that the \( u_j \), \( j=1,\dots,b \), form an orthonormal frame, so that the sample-average gradient is unbiased. This separates the method from generic independent-direction finite-difference estimators and places it within the broader class of zeroth-order methods based on orthogonal random directions.

## 2. Approximate Jacobian and probabilistic first-order accuracy

Having approximated each \( \nabla r_i(x_k) \) by \( \widetilde{\nabla} r_i(x_k) \), one forms the approximate Jacobian
\[
J_k \coloneqq \widetilde J(x_k)=
\begin{pmatrix}
(\widetilde{\nabla} r_1(x_k))^\top \\
\vdots \\
(\widetilde{\nabla} r_m(x_k))^\top
\end{pmatrix}.
\]
Its \( (i,j) \)-entry is, up to the scaling \( n/b \), a directional finite difference:
\[
[J_k]_{i,j}=\frac{n}{b}\cdot
\frac{r_i(x_k+\gamma_k u_j)-r_i(x_k)}{\gamma_k}.
\]
In many presentations one absorbs the factor \( n/b \) into a weight \( \phi \), and simply writes
\[
[J_k]_{i,j}\approx [r_i(x_k+\mu_k u_j)-r_i(x_k)]/\mu_k
\]
with \( \mu_k=\gamma_k \) [2407.12542].

Under the usual Lipschitz assumptions on \( J(x) \) and \( r(x) \), one shows
\[
E_u[\,\widetilde{\nabla} r_i(x)\,]=\nabla r_{s,i}(x),
\]
and then bounds the bias and variance of the induced gradient model for \( f \):
\[
\|E[\widetilde{\nabla} f(x)]-\nabla f(x)\|=O(\gamma),\qquad
\mathrm{Var}[\widetilde{\nabla} f(x)] = O(1/b)+O(\gamma).
\]
Via a multivariate Chebyshev or Bernstein argument, for any \( s>0 \),
\[
P\bigl(\|\widetilde{\nabla} f(x)-E[\widetilde{\nabla} f(x)]\|\le s\bigr)
\ge 1-O\bigl((\|\nabla f(x)\|+\gamma\|r(x)\|)^2/s^2\bigr).
\]
Combining bias and variance gives, for a suitably chosen \( s=O(\gamma) \), that with probability \( \ge \alpha \),
\[
\|\widetilde{\nabla} f(x)-\nabla f(x)\|
\le \xi_1\|\nabla f(x)\|+\xi_2\gamma,
\]
that is, the gradient model is “probabilistically first-order accurate” [2407.12542].

This formulation makes clear that the smoothing radius \( \gamma \) and the number of orthogonal directions \( b \) jointly control model quality. The data state that the bias is \( O(\gamma) \) and the variance is \( O(1/b)+O(\gamma) \); a plausible implication is that \( \gamma \) governs approximation bias while \( b \) governs directional Monte Carlo variability.

## 3. Embedding in the derivative-free Levenberg–Marquardt iteration

The derivative-free Levenberg–Marquardt method uses the orthogonally smoothed Jacobian at each iterate \( x_k \). The iteration is:

1. draw an orthonormal frame \( U_k=[u_1,\dots,u_b]\sim \mathrm{Uniform}(\mathrm{St}(n,b)) \);
2. form the Jacobian model \( J_k \) with \( \gamma_k=\|d_{k-1}\| \);
3. set the Levenberg–Marquardt step by solving
\[
(J_k^\top J_k+\lambda_k I)d_k=-J_k^\top r(x_k),
\]
where
\[
\lambda_k=\theta_k\|J_k^\top r(x_k)\|.
\]

The step is evaluated by the ratio
\[
\rho_k=
\frac{\|r(x_k)\|^2-\|r(x_k+d_k)\|^2}
{\|r(x_k)\|^2-\|r(x_k)+J_k d_k\|^2}.
\]
One accepts \( x_{k+1}=x_k+d_k \) whenever \( \rho_k\ge p_0 \); otherwise the step is rejected and \( \theta_k \) is increased by a factor \( a_1>1 \). If \( \rho_k\ge p_0 \) but the model-gradient is “small,” one may also decrease \( \theta_k \) by \( a_2<1 \). The practical implementation reuses the same orthonormal directions \( U_k \) across all \( m \) residuals at \( x_k \), and updates \( \gamma_k\leftarrow \|d_{k-1}\| \) to tie the bias \( O(\gamma_k) \) to the actual step-length [2407.12542].

Within this scheme, orthogonal spherical smoothing is not an auxiliary preprocessing step. It is the mechanism by which the Jacobian model is constructed, and it therefore determines both the linear system used to define the Levenberg–Marquardt step and the model reduction appearing in \( \rho_k \).

## 4. Complexity guarantees and relation to orthogonal random-direction methods

Under the Lipschitz and bounded-Jacobian assumptions, and choosing \( b\ge n/2 \) together with \( \gamma_k=\|d_{k-1}\| \), the random model is \( \alpha=\tfrac12 \)-probabilistically accurate with \( \xi_1 \) small enough. Standard trust-region-style and worst-case analysis then yields constants \( \beta>0 \) and \( \kappa_\theta>0 \) such that, for any \( \epsilon\in(0,a_2/(\kappa_\theta\theta_0)] \), with probability at least
\[
1-\exp(-c\cdot k),
\]
one has
\[
\min_{0\le j\le k}\|\nabla f(x_j)\|\le O(1/\sqrt{k}).
\]
Equivalently, the number of iterations \( K_\epsilon \) needed to drive the gradient norm below \( \epsilon \) satisfies, with high probability,
\[
K_\epsilon=O(\epsilon^{-2}),
\]
more precisely
\[
P\bigl(K_\epsilon\le C\,\epsilon^{-2}\bigr)\ge 1-\exp(-c'\epsilon^{-2}),
\]
for computable \( C,c'>0 \) depending on \( n,m \) and the Lipschitz constants. The method only requires evaluations of the \( m \) residuals \( r_1,\dots,r_m \) at \( b+1 \) points per iteration [2407.12542].

A related zeroth-order framework considers a smooth function \( f:\mathbb R^n\to\mathbb R \) with Lipschitz gradient and approximates \( \nabla f \) by finite differences computed in a set of orthogonal random directions that changes with each iteration. There, the smoothed function is
\[
f_r(x)=E_{u\sim \mathrm{Unif}(S^{n-1})}[f(x+r u)],
\]
and the two-sided estimator is
\[
g_k=\frac{n}{2rm}\sum_{i=1}^m [\,f(x_k+r u_i)-f(x_k-r u_i)\,]u_i.
\]
One efficient sampling scheme draws \( Z\in\mathbb R^{n\times n} \) with i.i.d. \( N(0,1) \) entries, computes a QR decomposition \( Z=QR \) with \( R \) diagonal positive, and takes the first \( m \) columns of \( Q \). Orthogonality helps because it enforces \( P P^\top \simeq (n/m)I \) and reduces correlation among directional estimates, lowering variance relative to i.i.d. sampling. The paper recovers spherical smoothing, coordinate descent, and discretized gradient descent as special cases, and establishes convergence rates in convex and Polyak–Łojasiewicz settings [2107.03941].

Taken together, these results place orthogonal spherical smoothing within a larger zeroth-order methodology in which spherical perturbations are combined with orthogonality to obtain unbiasedness, lower correlation, and complexity guarantees.

## 5. Other domain-specific meanings

Taken across the literature, orthogonal spherical smoothing is not a single universal operator. The orthogonality may arise from spherical-harmonic modes, an orthogonal basis in a spherical function space, or an orthonormal tangent frame. The following usages are all explicit in the cited papers.

| Domain | Orthogonality structure | Purpose |
|---|---|---|
| Derivative-free nonlinear least-squares [2407.12542] | Orthonormal random directions on \( \mathrm{St}(n,b) \) | Jacobian approximation for LM |
| Room acoustics [2401.03458] | Orthogonal SH channels of a spherical loudspeaker array | Rank restoration for MUSIC-type DOA estimation |
| Parallel MRI [1802.01108] | Orthogonal spherical-function basis \( f_n^m(\rho,\theta,\phi)=j_n(k\rho)Y_n^m(\theta,\phi) \) | Coil-sensitivity regularization |
| \( \mathbb S^2 \) approximation and denoising [2311.18333] | Orthogonal spherical harmonics and tight spherical framelets | Projection and multiscale smoothing/denoising |
| Spherical data smoothing splines [1801.04978] | Orthonormal basis of \( T_pS^m \) | Coordinate-wise Euclidean spline fitting |

In room acoustics, a multiple-input multiple-output system combines a spherical microphone array and a spherical loudspeaker array. After plane-wave decomposition, one forms \( \bm A(\omega) \) and then defines modal vectors \( \bm a_{nm}(\omega)=\bm A(\omega)\bm d_{nm} \). Averaging over all \( (N_L+1)^2 \) loudspeaker modes gives
\[
\widetilde{\bm S}_{\bm A}(\omega)=\frac{1}{(N_L+1)^2}\bm A(\omega)\bm A^H(\omega),
\]
which restores rank in the averaged cross-spectrum. In particular, reflections sharing the same time delay but arriving from different directions are decorrelated. To decorrelate up to \( R_c \) reflections arriving simultaneously, one needs \( (N_L+1)^2\ge R_c \) [2401.03458].

In parallel MRI reconstruction, the smoothing object is not a random-direction estimator but a regularization in a spherical-function basis. The basis functions are
\[
f_n^m(\rho,\theta,\phi)=j_n(k\rho)Y_n^m(\theta,\phi),
\]
which are mutually orthogonal in \( L^2(\Omega) \) under suitable boundary conditions. Coil sensitivities are expanded in that basis, and the regularizer is
\[
R_c(c_1,\dots,c_J)=\alpha\sum_{j=1}^J\sum_{l=1}^{L}|a_l^{(j)}|.
\]
The paper studies the corresponding joint reconstruction model and a non-linear ADMM solver [1802.01108].

For approximation and denoising on \( \mathbb S^2 \), spherical \( t \)-designs provide equal-weight quadrature points. If \( X_N \) is a \( t \)-design with \( t\ge N \), then quadrature is exact for all spherical harmonics up to degree \( N \), so the truncated expansion
\[
f_N(x)=\sum_{\ell=0}^N\sum_{m=-\ell}^{\ell}\hat f_{\ell m}Y_\ell^m(x)
\]
coincides with the orthogonal projection of \( f \) onto \( \Pi_N \). The same framework is used to construct semi-discrete spherical framelets satisfying a tight-frame property, and thresholding in the framelet domain yields denoising gains on noisy Wendland test functions [2311.18333].

For spherical data on \( S^m \), one may unroll and unwrap data into a single tangent space \( T_pS^m \), pick an orthonormal basis \( \{e_1,\dots,e_m\} \), and fit \( m \) independent scalar smoothing splines to the coordinate functions. This separate, coordinate-wise fitting in an orthonormal frame is explicitly identified as “orthogonal” smoothing, after which the fitted curve is wrapped back to the manifold by parallel transport and the exponential map [1801.04978].

## 6. Terminological scope, misconceptions, and boundary cases

A common misconception is to treat orthogonal spherical smoothing as synonymous with any smoothing procedure on a spherical domain. The cited literature does not support that equivalence. In the derivative-free optimization setting, orthogonality refers to the sampling geometry of the perturbation directions; in room acoustics it refers to spherical-harmonic loudspeaker modes; in MRI it refers to an orthogonal spherical basis; and in manifold smoothing it refers to an orthonormal tangent-frame representation [2407.12542][2401.03458][1802.01108][1801.04978].

Another misconception is that every spherical smoothing method has an orthogonal formulation already built into it. A counterexample is global-field verification on the sphere. There, the smoothing operator is the area-weighted spherical-cap average
\[
f_i'(R)=
\frac{\sum_{j\in\mathcal K_i(R)} f_j a_j}
{\sum_{j\in\mathcal K_i(R)} a_j},
\]
and the paper introduces two acceleration schemes for exactly that same area-size-informed smoothing operator. The paper contains no discussion of orthogonality of the kernel, of diagonalizing the smoothing matrix, or of constructing an orthonormal basis of smoothing functions. It explicitly states that orthogonal kernel derivations, Gram–Schmidt on \( S^2 \), weighted inner-products on irregular spherical grids, discrete orthonormal-basis construction, missing-data handling in an orthogonal framework, and an FSS example built around such an orthogonal operator do not appear there [2412.00936].

These distinctions suggest that “orthogonal spherical smoothing” is best understood as a structural description rather than a single standardized algorithm. In the optimization paper that gives the term its clearest algorithmic meaning, the structure is: spherical smoothing of residual components, orthonormal random directions, unbiased Jacobian estimation, probabilistically first-order accurate models, and a derivative-free Levenberg–Marquardt method with high-probability \( O(\epsilon^{-2}) \) complexity [2407.12542].

Source: https://www.emergentmind.com/topics/orthogonal-spherical-smoothing