---
title: SLERP-Based Quaternion Noise Scheduler
url: https://www.emergentmind.com/topics/slerp-based-quaternion-noise-scheduler
type: topic
---

# SLERP-Based Quaternion Noise Scheduler

Searching arXiv for the cited papers and closely related work on quaternion/rotation scheduling and rectified flow.
arXiv search query: `id:2502.14637 OR id:2509.19696 OR "Rectified Quaternion Flow" OR "SLERP-based quaternion noise scheduler"`
A SLERP-based quaternion noise scheduler is a mechanism for injecting, parameterizing, or integrating rotational uncertainty on $SO(3)$ by moving between unit quaternions along geodesics on $S^3$ rather than by additive perturbation in Euclidean coordinates. In the formulations reported for protein backbone generation and contact-rich manipulation, the scheduler uses spherical linear interpolation (SLERP) or its exponential-map form to preserve the unit-norm constraint, maintain valid rotations at intermediate times, and define time-indexed rotational noise or flow trajectories compatible with learned generative dynamics [2502.14637], [2509.19696]. The term spans at least two closely related constructions: a flow-matching formulation in which quaternion trajectories are built by $q_t = q_0 \otimes \exp\!\big[t \cdot \log(q_0^{-1}\otimes q_1)\big]$, and a diffusion formulation in which rotational corruption is defined by $q_t=\operatorname{SLERP}(q_0,q_{\text{noise}};\mu_t)$ with a monotonically increasing schedule $\mu_t\in[0,1]$.

## 1. Geometric basis on $S^3$ and $SO(3)$

A unit quaternion $q\in\mathbb{R}^4$, $\|q\|_2=1$, double-covers $SO(3)$ [2502.14637]. This representation is central to SLERP-based scheduling because the interpolation is performed directly on the 3-sphere rather than in an ambient unconstrained vector space. In the protein-generation formulation, the exponential map is written as $\exp:\mathfrak{t}\in\mathbb{R}^3\mapsto q=\exp(\tfrac12 \phi u)=[\cos(\phi/2),\sin(\phi/2)u^\top]^\top\in S^3$, where $\phi u$ is axis–angle, while the logarithm map retrieves $\omega=2\log(q)\in\mathbb{R}^3$ [2502.14637]. Quaternion multiplication $\otimes$ implements group composition, and $q^{-1}=[s,-u^\top]^\top$.

The geometric motivation is explicit in the manipulation setting: Gaussian perturbations in $\mathbb{R}^4$ do not respect the unit-norm constraint of quaternions and can easily push samples off the 3-sphere, breaking the group structure of $SO(3)$ [2509.19696]. By contrast, SLERP between two unit quaternions moves along the great-circle geodesic on $S^3$, preserving $\|q\|=1$ at every step and ensuring that intermediate orientations remain valid rotations. This makes quaternion geodesics a natural substrate for forward corruption, reverse denoising, and continuous-time flow integration.

A plausible implication is that the scheduler is not merely a numerical convenience; it is the component that aligns the stochastic or deterministic time parameter with the intrinsic geometry of rotation space. Both reported systems treat rotational evolution as manifold-valued transport rather than coefficient-wise noise injection.

## 2. Canonical SLERP forms and their numerical properties

Two SLERP parameterizations appear in the source material. The manipulation paper gives the standard additive form
$$
\operatorname{SLERP}(q_a,q_b;\mu)=\frac{\sin((1-\mu)\Omega)}{\sin\Omega}\,q_a+\frac{\sin(\mu\Omega)}{\sin\Omega}\,q_b,\qquad
\Omega=\arccos(\langle q_a,q_b\rangle),
$$
and uses it for forward diffusion from a clean quaternion $q_0$ to a random noise quaternion $q_{\text{noise}}$ [2509.19696]. At $t=0$, $\mu_0=0\Rightarrow q_0$; at $t=T$, $\mu_T\approx 1\Rightarrow q_T\approx q_{\text{noise}}$.

The protein-generation paper presents the standard additive SLERP only “for reference”:
$$
\operatorname{SLERP}_a(q_0,q_1;t)=\frac{\sin((1-t)\theta)}{\sin\theta}\,q_0+\frac{\sin(t\theta)}{\sin\theta}\,q_1,\qquad
\theta=\arccos(q_0\cdot q_1),
$$
and identifies its numerical weakness: it is “numerically unstable when $\sin\theta\to 0$ or $\theta\to\pi$” [2502.14637].

The same paper therefore adopts an exponential-map SLERP:
$$
q_t=q_0\otimes \exp\!\big[t\cdot \log(q_0^{-1}\otimes q_1)\big].
$$
Because $q_0^{-1}\otimes q_1=\exp(\tfrac12\theta u)$ implies $\log(q_0^{-1}\otimes q_1)=\tfrac12\theta u$, this form exactly traces the great-circle geodesic at constant speed [2502.14637]. The stated numerical properties are specific: it “never divides by $\sin\theta$, remains stable for small or near-$\pi$ angles, and automatically stays on $S^3$.” In the reported ablations, “SLERP-Exp vs. matrix-geodesic or additive SLERP” is “more stable when $\theta\to 0$ or $\theta\to\pi$ (no NaNs, no renormalization)” and yields “$\approx 25\%$ faster quaternion ops vs. $3\times 3$ matrix exp + log” [2502.14637].

These two formulations are mathematically aligned but operationally distinct. One uses coefficient interpolation with explicit numerical safeguards and renormalization; the other rewrites the path in Lie-group form and treats numerical stability as a direct consequence of the parameterization.

## 3. Time scheduling and noise parameterization

The scheduler is the time-dependent rule that determines how far the quaternion has moved from signal toward noise, or from noise toward sample, at each step. In the diffusion-based manipulation formulation, a standard discrete variance schedule $\{\beta_i\}_{i=1}^T$ is introduced with $\alpha_i=1-\beta_i$ and $\bar{\alpha}_t=\prod_{i=1}^t \alpha_i$, and one “natural choice” is
$$
\mu_t \coloneqq \sqrt{1-\bar{\alpha}_t},\qquad
\text{clean-weight} \coloneqq \sqrt{\bar{\alpha}_t}.
$$
Noise is then injected by geodesic interpolation:
$$
q_t=\operatorname{SLERP}(q_0,q_{\text{noise}};\mu_t).
$$
The scheduler is therefore a monotonically increasing path from the clean quaternion to a fully random orientation [2509.19696].

In ReQFlow, the time variable appears in both training and inference. During training, $t\sim \operatorname{Uniform}[0,1]$; during inference, a discrete grid $t_i=i/L$, $i=0,\dots,L$, is used [2502.14637]. For rotations, the paper introduces an “exponential step–size scheduler” to concentrate sampling near $t=1$:
$$
\kappa(t)=1-\exp(-\gamma t),\qquad \gamma\approx 10,
$$
and replaces
$$
q_t \leftarrow q_0\otimes \exp\!\big(\kappa(t)\cdot \log(q_0^{-1}\otimes q_1)\big).
$$
The instantaneous angular velocity becomes
$$
\hat{\omega}_t=\frac{d\kappa}{dt}\cdot \omega=\gamma e^{-\gamma t}\omega.
$$
The reported effect is explicit: the scheduler “concentrates ‘effort’ near $t=1$, allowing designability $0.97$ with $L=50$ steps,” whereas “without it, $L\ge 500$ needed for similar quality” [2502.14637].

The two schedules reflect different generative semantics. In diffusion, $\mu_t$ indexes corruption severity within a forward noising process. In quaternion flow matching, $\kappa(t)$ warps traversal speed along a paired geodesic and thereby reshapes the effective distribution of integration effort over time. This suggests that “noise scheduler” in this domain names a broader class of time warps on manifold-valued rotational paths, not only forward-noise variances in the diffusion sense.

## 4. Role in flow matching and diffusion models

In ReQFlow, the scheduler is embedded in a deterministic flow-matching objective defined jointly over translations and rotations. The endpoints are sampled as $q_0\sim Q_0=\text{Isotropic-}SO(3)$ and $q_1\sim Q_1$, the empirical distribution of backbone rotations, and the paired path has constant angular velocity
$$
\omega = 2\log(q_0^{-1}\otimes q_1).
$$
The interpolation is
$$
q_t = q_0 \otimes \exp\!\big(t\cdot \log(q_0^{-1}\otimes q_1)\big),
$$
with derivative
$$
\frac{d}{dt}q_t = \tfrac12[0,\omega^\top]^\top \otimes q_t.
$$
A base $SE(3)$-equivariant network $M_\theta$ predicts endpoint $(x_{\theta,1},q_{\theta,1})$ from $(x_t,q_t,t)$, and the instantaneous velocity targets are
$$
v=x_1-x_0,\qquad \omega=2\log(q_0^{-1}\otimes q_1),
$$
$$
v_{\theta,t}=\frac{x_{\theta,1}-x_t}{1-t},\qquad
\omega_{\theta,t}= \frac{2\log(q_t^{-1}\otimes q_{\theta,1})}{1-t}.
$$
The loss is
$$
\mathcal{L}=E_{t,(x_0,x_1)\sim T_0\times T_1}[\|v-v_{\theta,t}\|^2]
+E_{t,(q_0,q_1)\sim Q_0\times Q_1}[\|\omega-\omega_{\theta,t}\|^2]
+\text{(optional auxiliary clash/chain-break loss)}.
$$
The learned field is interpreted as an ODE,
$$
\frac{dx}{dt}=v_{\theta,t},\qquad
\frac{dq}{dt}=\tfrac12[0,\omega_{\theta,t}^\top]^\top\otimes q,
$$
integrated from $t=0$ to $t=1$ [2502.14637].

In the manipulation paper, the scheduler is part of a Transformer-based diffusion model with cross-attention to external wrenches [2509.19696]. At each forward step, the clean quaternion token is replaced with $q_t$ produced by the SLERP scheduler, while the translation token is corrupted analogously with Gaussian noise. The combined 7D token $[p_t,q_t]$ is embedded together with learned timestep embeddings; external wrenches are encoded as context tokens and attend via multi-head cross-attention into the trajectory tokens. During training, the network $\epsilon_\theta$ predicts the quaternion “noise” element in a log-quaternion or axis-angle representation (3D) to avoid outputting raw 4D quaternions. At inference, the learned reverse-process updates quaternions via a small SLERP step, ensuring output remains on $S^3$.

The common structural role is that the scheduler defines the admissible trajectory of quaternion states seen by the model. In one case it parameterizes supervised geodesic transport between coupled endpoints; in the other it parameterizes the corruption ladder that a denoiser must invert.

## 5. Numerical safeguards, implementation, and sampling conventions

Implementation details differ by formulation, but both are organized around preserving valid rotations throughout the computational graph. In the diffusion setting, the forward-noise pseudocode computes $\Omega=\arccos(\operatorname{clamp}(\langle q_0,q_{\text{noise}}\rangle,-1,1))$, uses a small-angle branch when $\Omega<\epsilon_{\text{small}}$, and renormalizes with $q_t\leftarrow q_t/\|q_t\|$ “to avoid drift” [2509.19696]. The paper explicitly identifies “clamping the dot-product into $[-1,1]$ before arccos and renormalizing after interpolation” as numerical safeguards. Quaternions are stored in robot-base frame with scalar-first convention $(q=[w,x,y,z])$ and are “renormalized after every attention block to mitigate drift.”

The random noise quaternion in that formulation is sampled uniformly on $SO(3)$ by drawing a unit axis $u\in S^2$ uniformly, drawing an angle $\theta\in[0,\pi]$ with density proportional to $\sin\theta$—or “simply $\theta\sim\operatorname{Uniform}[0,\pi]$ and re-weight, or use a known unit-quaternion sampler”—and then setting
$$
q_{\text{noise}}=(\cos(\theta/2),\,u\sin(\theta/2)).
$$
This sampling rule supplies the terminal orientation for the SLERP corruption path [2509.19696].

ReQFlow’s implementation uses the same geometric primitives but avoids the additive SLERP denominator. Its training loop samples $x_0\sim \mathcal{N}(0,I_3)$ and $q_0\sim \text{Isotropic-}SO(3)$, forms
$$
x_t\leftarrow (1-t)x_0+tx_1,\qquad
q_t\leftarrow q_0\otimes \exp[t\cdot \log(q_0^{-1}\otimes q_1)],
$$
and computes endpoint-based velocity predictions [2502.14637]. In the ODE Euler inference pseudocode, the update is
$$
x\leftarrow x+v\cdot \Delta t,\qquad
q\leftarrow q\otimes \exp\!\big[\tfrac12\Delta t\cdot \text{weight}\cdot \omega\big],
$$
with $\text{weight}=\gamma e^{-\gamma t}$. The paper states that the same discrete grid $\{t_i\}$ and exponential scheduler are retained during rectification.

A common misconception is that quaternion scheduling automatically eliminates all numerical issues. The reported evidence is narrower. Standard additive SLERP still requires clamping, small-angle handling, and renormalization in the diffusion implementation [2509.19696], whereas the exponential-map form in ReQFlow is specifically described as stable near $\theta\to 0$ and $\theta\to\pi$ and as automatically staying on $S^3$ [2502.14637]. The stability claim therefore depends on the precise SLERP parameterization.

## 6. Rectification, empirical behavior, and domain-specific outcomes

In ReQFlow, the scheduler is coupled to a rectification procedure that fine-tunes the learned model on its own generated pairs. The stated motivation is that “in a vanilla flow, different training pairs yield crossing trajectories, raising transport cost and slowing mixing,” while rectified flow “refits the same model to its own generated pairs to enforce non-crossing/geodesic alignment and reduce overall cost” [2502.14637]. The procedure is three-step: sample noisy $(x_0',q_0')\sim T_0\times Q_0$, run the trained QFlow model for $L$ inference steps to obtain $(x_1',q_1')$, pair these endpoints as new training data, and fine-tune $M_\theta$ with exactly the same quaternion flow matching loss. The source reports a “Theorem (Marginal Preservation)” and a “Theorem (Cost Reduction)” for the rectified coupling.

The empirical effects reported for this SLERP-based rotational scheduler are domain-specific but substantial. In protein backbone generation, “ReQFlow reaches the same designability with far fewer steps (e.g. 50 vs. 500), roughly 10× speedup” [2502.14637]. Additional ablations state: “QFlow (no rectification) at $L=50$: designable fraction $\approx 0.81$,” “ReQFlow at $L=50$: fraction increases to $\approx 0.91$ (PDB),” and “At $L=20$: ReQFlow $\approx 0.87$ vs. QFlow $\approx 0.60$.” For long-chain generation, “ReQFlow remains $\ge 0.80$ designable up to $N=600$, while baselines collapse.” Inference speed is reported as “$\sim 1.8\,\text{s}$ on A100” for a 300-residue backbone, “37× faster than RFdiffusion ($L=50$), 62× faster than Genie2 ($L=1000$).” The abstract states that ReQFlow is “37x faster than RFDiffusion and 63x faster than Genie2 when generating a backbone of length 300” [2502.14637].

In contact-rich manipulation, replacing naive additive Gaussian corruption of quaternion coefficients with the SLERP-based scheduler is reported to “maintain geometric consistency and avoid bias off the manifold” [2509.19696]. On the parkour dataset, the Transformer-Diffusion Model achieved “$0.249^\circ$ mean angular error $\theta_{\text{error}}$ and $0.003^\circ$ axis-deviation $\alpha_{\text{error}}$ (with $0.994\,\text{mm}$ positional error).” A combined parkour + therapy dataset improved rotational error to “$0.233^\circ$ ($\theta$) and $0.002^\circ$ ($\alpha$).” Ablations replacing SLERP with unconstrained Gaussian noise on $(w,x,y,z)$ “increased angular error by more than an order of magnitude and destabilized the learned reverse chain.” The broader system is reported to have achieved “30/30 success rates for cylindrical, square, and star peg insertions without any peg-specific demonstrations in the training data set,” together with sub-millimeter positional accuracy, sub-degree rotational accuracy, and real-time torque control on a KUKA LBR iiwa robot [2509.19696].

Taken together, these results establish a consistent pattern: SLERP-based quaternion scheduling is used where rotational fidelity must be preserved under generative time evolution, and its practical value is tied to manifold consistency, stable interpolation near difficult angular regimes, and improved efficiency or accuracy when compared with unconstrained rotational noise models.

Source: https://www.emergentmind.com/topics/slerp-based-quaternion-noise-scheduler