---
title: Stiefel Optimizer Overview
url: https://www.emergentmind.com/topics/stiefel-optimizer
type: topic
---

# Stiefel Optimizer Overview

A Stiefel optimizer is an optimization method for problems whose variables are matrices with orthonormal columns, typically posed on a Stiefel manifold such as \( \mathrm{St}(n,p)=\{X\in\mathbb{R}^{n\times p}:X^\top X=I_p\} \), on a generalized Stiefel manifold with \(X^\top M X=I_p\), or on related quotient constructions in which orthogonality appears together with gauge symmetries. In the cited literature, the term spans exact Riemannian methods based on tangent projections and retractions, second-order and proximal composite solvers, multiplier-correction and penalty formulations, continuous-time flows that asymptotically land on the manifold, and application-specific training rules that couple standard optimizers with QR or polar retractions [1702.04303, 2205.14173, 2602.05631].

## 1. Manifold setting and geometric primitives

The standard Stiefel manifold is the set of orthonormal \(p\)-frames in \(\mathbb{R}^n\), written in several papers as \( \mathrm{St}(n,p) \) or \( \mathrm{St}_p^n \). Its tangent space at \(X\) is characterized by
\[
T_X\mathrm{St}(n,p)=\{\Delta\in\mathbb{R}^{n\times p}:X^\top \Delta+\Delta^\top X=0\},
\]
or, equivalently, by the decomposition
\[
T_U\mathrm{St}_p^n=\{UA+(I_n-UU^\top)C: A=-A^\top,\ C\in M_{n\times p}(\mathbb{R})\}.
\]
These formulas are the basic constraints that any Stiefel optimizer must respect, either exactly at every iterate or asymptotically along a flow [1702.04303, 1802.05469].

Generalized variants enlarge the class of admissible constraints. For symmetric positive definite \(B\), the generalized Stiefel manifold is
\[
\mathrm{St}_B(p,d)=\{X\in\mathbb{R}^{d\times p}:X^\top B X=I_p\},
\]
with tangent space
\[
T_X\mathrm{St}_B(p,d)=\{Z\in\mathbb{R}^{d\times p}:Z^\top B X+X^\top B Z=0\}.
\]
For positive semidefinite, possibly singular, \(M\), the feasible set is
\[
\mathcal S_M(n,p)=\{X\in\mathbb{R}^{n\times p}:X^\top M X=I_p\},
\]
and the singular-\(M\) case requires a careful separation of range and null-space components [1902.01635, 2602.05631].

The same geometric pattern extends to complex and quotient settings. In quantum-channel optimization, stacking Kraus operators into a block matrix \(K\) yields the isometry constraint \(K^\dagger K=I_n\), so channels are parameterized by the complex Stiefel manifold \(V_n(\mathbb{C}^{nm^2})\). Because Kraus representations are non-unique up to unitary mixing, the physically meaningful space is the quotient \(V_n(\mathbb{C}^{nm^2})/U(nm)\), and the paper establishes that this quotient is homeomorphic to the space of quantum channels [2408.09820].

## 2. Feasibility-preserving update mechanisms

A large part of the Stiefel-optimizer literature is organized around how orthogonality is preserved. Some methods move in tangent directions and retract back to the manifold; some use ambient-space descent plus a feasibility correction; some preserve feasibility through exact group actions; and some deliberately leave the manifold during intermediate iterates but are designed to land on it asymptotically.

| Family | Core update idea | Feasibility mechanism |
|---|---|---|
| Retraction-based first order | Tangent projection of gradients, then descent step | SVD, QR, polar, or Cayley retraction |
| Mixed-direction line search | \(H=\alpha \nabla \mathcal F_1+\beta \nabla \mathcal F_2\) with BB steps | Projection \( \pi(X-\tau H) \) onto \( \mathrm{St}(n,p) \) |
| Intrinsic momentum methods | Evolve position and momentum on the tangent bundle | Polar retraction with exact tangent-bundle preservation |
| Euclidean optimizer plus correction | Apply SGD, Adam, or AdamW to factors, then orthonormalize | QR or polar retraction after each step |
| Group-action methods | Optimize an orthogonal transform \(\Phi\in O(n)\) acting on Stiefel data | Matrix exponential on \(O(n)\) |

The mixed-direction method “Grad-Retrac” is a representative feasible first-order scheme. It uses
\[
\nabla \mathcal{F}_1(X)=G-XG^\top X,\qquad \nabla \mathcal{F}_2(X)=(I-XX^\top)G,
\]
combines them as \(H=\alpha \nabla \mathcal F_1+\beta \nabla \mathcal F_2\) with \(\alpha>0,\beta\ge 0\), and globalizes the update through a non-monotone Barzilai–Borwein line search. Feasibility is maintained either by a second-order approximation or by explicit SVD projection, and the paper proves tangency, descent, and retraction properties [1702.04303].

A different line is the Momentum Stiefel Optimizer. It derives a dissipative second-order system on the tangent bundle \(T\mathsf{St}\), decomposes the tangent variable as \(Q=XY+V\), and discretizes the resulting dynamics so that both \(X^\top X=I\) and tangent compatibility of the momentum are preserved exactly. Its discrete update uses a polar step
\[
X_{i+1}=X_\dagger(X_\dagger^\top X_\dagger)^{-1/2},
\]
and the paper emphasizes that no additional transport or projection is needed to keep momentum in the changing tangent spaces [2205.14173].

Several recent deep-learning implementations are deliberately hybrid rather than fully intrinsic. StelLA constrains the adapter factors \(U\in\mathrm{St}(r,m)\) and \(V\in\mathrm{St}(r,n)\), projects Euclidean gradients onto the tangent spaces, runs any Euclidean optimizer on the projected gradients, reprojects the perturbation to the tangent space, and retracts by the polar map \(\rho_Y(\Delta)=\uf(Y+\Delta)\). The method is explicitly described as a flexible and modular design that converts any Euclidean optimizer to a Riemannian one [2510.01938]. A related LoRA method constrains only the \(B\) factor to \( \mathrm{St}(d,r) \), uses Adam-style preconditioning in ambient space, projects the resulting direction onto the tangent space, and retracts by the \(Q\)-factor of a QR decomposition [2508.17901]. Spectral Compact Training uses standard AdamW on spectral factors \(U,s,V\) and then retracts \(U\) and \(V\) to the Stiefel manifold by QR after every optimizer step [2604.00733].

In system identification on Stiefel data, the optimization variable can be moved from the manifold itself to the orthogonal group. For observations \(Y_j\in\mathrm{St}_{n,k}\), the paper on autoregressive processes estimates \(\Phi\in O(n)\) by minimizing
\[
f(\Phi)=\sum_{\ell=1}^N \mathrm{dist}(Y_{\ell+1},\Phi Y_\ell)^2,
\]
and updates \(\Phi\) through conjugate gradient descent with line search along \(\Phi\exp(-\tau\Delta)\), which preserves orthogonality automatically because \(\exp(-\tau\Delta)\in O(n)\) [2509.24767].

## 3. Second-order, proximal, and penalty formulations

Beyond first-order retraction methods, the literature contains an extensive second-order and composite-optimization theory. A central embedded-manifold result is the Hessian formula
\[
\operatorname{Hess} G(U)=\big(\operatorname{Hess}\bar G(U)-E(U)\otimes I_n\big)\big|_{T_U\mathrm{St}_p^n\times T_U\mathrm{St}_p^n},
\]
together with an explicit local tangent-frame construction and a QR-retraction Newton algorithm. This framework is used to recover second-order conditions for the Procrustes and Penrose regression problems and to derive necessary and sufficient local-minimum conditions for the Brockett problem [1802.05469].

Composite objectives of the form
\[
\min_X\;F(X)=f(X)+h(X)\qquad \text{s.t. }X^\top X=I_r,
\]
with \(f\) smooth and \(h\) convex but possibly nonsmooth, motivate proximal quasi-Newton and proximal Newton methods on the Stiefel manifold. ManPQN solves a tangent-space proximal subproblem with a variable positive definite operator \(\mathcal B_k\), updates by a retraction, and uses a nonmonotone line search. The paper proves global convergence, an \(O(1/\epsilon^2)\) iteration bound for obtaining an \(\epsilon\)-stationary point, and local linear convergence under a pullback-Hessian positivity condition [2501.09516].

ARPQN and ARPN add adaptive quadratic regularization. ARPQN solves
\[
\min_{V\in T_{X_k}\mathcal M}\ \langle \nabla f(X_k),V\rangle+\frac12\langle (\mathcal B_k+\sigma_k I)[V],V\rangle+h(X_k+V),
\]
while ARPN uses a more geometric model with \(h(\mathbf R_{X_k}(V))\). The paper establishes global convergence and local linear convergence for ARPQN, and local q-superlinear convergence for ARPN under stronger assumptions [2404.11112].

Multiplier-correction methods represent another exact-feasibility strategy. Starting from a feasible iterate \(X^{(k)}\), they first perform a function-value reduction step along an arbitrary Euclidean descent direction and then apply a proximal orthogonal correction inside the range space of the intermediate point, \(X^{(k+1)}=\bar X^{(k)}Q\) with \(Q^\top Q=I_p\). The correction is obtained from the SVD of a \(p\times p\) matrix and is designed to reduce the asymmetry of the Lagrange multipliers. The paper proves monotone decrease of the objective, convergence of every accumulation point to a first-order stationary point, and an \(O(1/\epsilon^2)\) complexity estimate [2011.14781].

Penalty formulations are prominent for generalized constraints. SLEP reformulates
\[
\min_X f(X)\quad \text{s.t.}\quad X^\top M X=I_p
\]
as the smooth unconstrained problem
\[
\min_X h(X):=f(\mathcal A(X))+\frac{\beta}{4}\|X^\top M X-I_p\|_F^2,\qquad
\mathcal A(X)=X\Big(\frac32 I_p-\frac12 X^\top M X\Big).
\]
For sufficiently large \(\beta\), the paper proves local equivalence of first-order stationary points, second-order stationary points, and local minimizers between the penalty model and the original generalized-Stiefel problem, including the singular-\(M\) case. The stated motivation is that SLEP eliminates the need for retractions and vector transports and permits direct application of unconstrained methods [2602.05631].

Preconditioning changes the geometry rather than the objective. On \(\mathrm{St}_B(p,d)\), a metric defined by an SPD matrix \(M_X\) yields a Riemannian gradient
\[
\operatorname{grad} f(X)=\Pi_X(M_X^{-1}\nabla\bar f(X)),
\]
and corresponding projection, retraction, vector-transport, and Hessian formulas. The paper’s central claim is that metric choice functions as a preconditioner: it can reduce geometric cost and improve conditioning of the Riemannian Hessian near the solution [1902.01635].

## 4. Convergence guarantees, landscape results, and computational limits

The convergence theory of Stiefel optimizers is strong at the level of stationarity but limited at the level of worst-case global optimality. Retraction-based first-order methods prove descent and feasibility; second-order and proximal methods prove convergence of accumulation points to stationary points; multiplier-correction methods prove monotone decrease; and adaptive regularization yields local linear or q-superlinear rates under suitable curvature conditions [1702.04303, 2501.09516, 2404.11112, 2011.14781].

Continuous-time analysis adds a different perspective. The landing-flow system
\[
\dot X=-\psi(X)X-\lambda X(X^\top X-I_p),
\qquad \psi(X)=2\,\mathrm{skewsym}(\nabla f(X)X^\top),
\]
is designed so that trajectories may leave the manifold at finite time but satisfy \(X(t)^\top X(t)\to I_p\) asymptotically. The paper proves global existence, monotone decrease of the orthogonality defect, convergence to the set of critical points on the Stiefel manifold, and asymptotic stability of isolated local minima [2202.09058].

In special application domains, the geometry can remove suboptimal local extrema. For continuous functionals on the space of quantum channels, the quotient map from the complex Stiefel manifold preserves non-strict local extrema, and if the functional is continuous and convex or concave then there are no local but non-global minima or maxima on either the channel space or the Stiefel manifold. The paper explicitly applies this “no traps” result to mean-value, entropy-related, channel-generation, and gate-generation objectives [2408.09820].

Worst-case complexity is much harsher. Linear programming with linear constraints over a Stiefel manifold, and unconstrained quadratic programming over a Stiefel manifold, are both NP-hard in general. The same paper proves nonexistence of FPTAS for these problem classes unless \( \mathrm{P}=\mathrm{NP} \), and extends related hardness results to Grassmann and flag manifolds. Its practical lesson is explicit: local methods and heuristics are essential, and tractable relaxations such as semidefinite programming may be indispensable for certification or approximation [2507.02839].

Taken together, these results delimit the scope of any Stiefel optimizer. Exact feasibility, descent, and high-quality local behavior are well supported theoretically; uniform polynomial-time guarantees for global optimization are not.

## 5. Application-specific realizations

In quantum control and open quantum systems, the Stiefel manifold provides the geometric arena for optimization over Kraus representations of quantum channels. Stacking Kraus operators produces the isometry constraint \(K^\dagger K=I_n\), the quotient \(V_n(\mathbb{C}^{nm^2})/U(nm)\) removes Kraus non-uniqueness, and the induced quotient metric defines a distance on channel space. The framework is then used to analyze control landscapes for mean values, entropy-related objectives, channel generation, and gate generation, for both Markovian and non-Markovian dynamics [2408.09820].

In parameter-efficient fine-tuning, StelLA treats LoRA as a subspace-learning problem with
\[
\tilde W=W+\frac{\alpha}{r}USV^\top,\qquad
U\in \mathrm{St}(r,m),\quad V\in \mathrm{St}(r,n),\quad S\in\mathbb R^{r\times r}.
\]
The paper reports that product Stiefel geometry \(\mathrm{St}(r,m)\times\mathbb R^{r\times r}\times\mathrm{St}(r,n)\) works better than a plain Euclidean three-factor model, outperforms a quotient geometry formulation, and that polar retraction performs about as well as the exponential map but is cheaper [2510.01938]. A separate LoRA paper constrains only \(B\) in \(W=W_0+BA\) to \( \mathrm{St}(d,r) \), uses Adam-preconditioned Riemannian updates for \(B\), and measures effective rank by SVD entropy. A representative result reported there is that with nominal rank \(r=16\) on LLaMA-3.2-1B, the Stiefel method uses all \(16\) dimensions, while AdamW averages about \(12\) effective dimensions [2508.17901].

In compact neural training, Spectral Compact Training permanently stores each dense layer as
\[
W=U\,\operatorname{diag}(s)\,V^\top,
\qquad U^\top U=I,\quad V^\top V=I,
\]
runs standard backpropagation and AdamW on \(U,s,V\), and then retracts \(U\) and \(V\) by QR after each step. The paper reports up to \(199\times\) memory reduction per MLP layer at rank \(32\), a full training step of a \(70\)B-parameter architecture on a Steam Deck handheld with \(7.2\) GB peak memory versus \(1{,}245\) GB for dense FP32 training with Adam, and orthogonality error below \(2\times 10^{-6}\) in the \(70\)B validation benchmark [2604.00733].

In probabilistic partial least squares, exact Stiefel optimization enforces the identifiable constraints \(W^\top W=I_r\) and \(C^\top C=I_r\) over the product manifold
\[
\mathrm{St}(p,r)\times \mathrm{St}(q,r)\times \mathbb R_{++}^{2r+1}.
\]
The solver uses projected Riemannian gradients, QR retractions, Armijo backtracking, and a block-coordinate variant with closed-form scalar updates. The reported empirical outcomes include near-nominal predictive coverage without post-hoc recalibration and improved stability of parameter recovery [2605.11607].

In autoregressive modeling on manifolds, the Stiefel constraint appears in system identification rather than direct state evolution. The unknown parameter is an orthogonal transform \(\Phi\in O(n)\) acting on Stiefel observations, estimated by minimizing \(\sum_{\ell=1}^N \mathrm{dist}(Y_{\ell+1},\Phi Y_\ell)^2\) using conjugate gradient descent and matrix-exponential updates on \(O(n)\) [2509.24767].

In spectrum-controlled neural layers, ManifoldFlow keeps a Stiefel basis \(Q\) but relaxes the fixed unit spectrum through
\[
W=Q S^{1/2},\qquad Q^\top Q=I,\quad S\succ 0.
\]
Because \(W^\top W=S\), the eigenvalues of \(S\) are exactly the squared singular values of the realized weight, so eigenvalue clipping on \(S\) gives direct singular-value control. The \(Q\) factor uses the same Stiefel optimizer as the fixed-Stiefel baseline, while \(S\) is updated on the SPD cone by an affine-invariant rule [2607.04535].

## 6. Conceptual distinctions and common misconceptions

A frequent misconception is that a Stiefel optimizer is necessarily a fully intrinsic Riemannian algorithm. The literature is broader. Some methods are intrinsic from the outset, such as retraction-based gradient, conjugate-gradient, Newton, and proximal quasi-Newton schemes [1702.04303, 1802.05469, 2501.09516]. Others are explicitly hybrid: standard AdamW or Adam is applied in ambient space and orthogonality is restored afterward by QR or polar retraction, as in Spectral Compact Training and Stiefel-constrained LoRA [2604.00733, 2508.17901]. SLEP goes further: it is presented not as a Riemannian method, but as a smooth unconstrained reformulation whose local stationary structure matches the original generalized-Stiefel problem for sufficiently large penalty parameters [2602.05631].

A second misconception is that “orthogonal” and “spectrally constrained” are interchangeable. Standard fixed-spectrum Stiefel layers force all represented singular values to equal one, whereas ManifoldFlow keeps the basis on the Stiefel manifold but learns a bounded positive spectrum through an SPD factor. The paper’s point is precisely that an orthonormal basis need not imply a frozen singular spectrum [2607.04535].

A third misconception is that the full Stiefel manifold is always the correct search space. In quantum channels, physically equivalent Kraus families are related by a unitary action, so the meaningful parameter space is the quotient \(V_n(\mathbb{C}^{nm^2})/U(nm)\), not the unreduced complex Stiefel manifold [2408.09820].

The practical implication is that “Stiefel optimizer” is best understood as a family of orthogonality-aware optimization schemes rather than a single algorithmic template. What unifies them is the treatment of orthogonality as a geometric constraint to be preserved, exploited, or encoded exactly; what separates them is whether the constraint is handled by intrinsic Riemannian motion, exact retraction after Euclidean updates, quotient reduction, penalty equivalence, or coupled product-manifold dynamics.

Source: https://www.emergentmind.com/topics/stiefel-optimizer