---
title: Cayley Transform Parametrization
url: https://www.emergentmind.com/topics/cayley-transform-parametrization
type: topic
---

# Cayley Transform Parametrization

The Cayley transform parametrization is a classical and versatile technique that provides a rational (non-exponential) map from the Lie algebra of skew-symmetric (or anti-Hermitian, or more generally Lie algebra) elements to certain matrix Lie groups such as SO(n), SU(n), and the Stiefel manifold. Its algebraic structure, computational efficiency, and unconstrained variable usage have made it fundamental in diverse areas, including quantum mechanics, optimization on manifolds, machine learning, molecular simulation, K-theory, and geometric statistics.

## 1. Mathematical Foundation of the Cayley Transform Parametrization

The Cayley transform for a Lie group $G$ (e.g., $SO(n)$, $SU(n)$) is a rational map from the associated Lie algebra $\mathfrak{g}$ (typically skew-symmetric or anti-Hermitian matrices) to $G$. The essential form is
\[
C(M) = (I + M)(I - M)^{-1}
\]
where $M$ is skew-symmetric ($M^\top = -M$) or anti-Hermitian ($M^\dagger = -M$), and $I - M$ is invertible. For $SU(2)$, one takes $M=2i a\, \mathbf{n}\cdot\mathbf{J}$ with $\mathbf{J}$ the spin generators, $a \in \mathbb{R}$, and $\mathbf{n}^2=1$ [1506.00500].

For real orthogonal matrices $U\in O(n)$, the Cayley transform maps skew-symmetric $S$ to orthogonal $Q$ via $Q=(I-S)(I+S)^{-1}$, if $I+S$ is invertible [2601.16271]. Conversely, for certain $U$, especially with eigenvalue $-1$, a "signature" diagonal $D\in\{\pm1\}^n$ is used so that $DU$ lies in the Cayley domain. Then $U = D(I - S)(I + S)^{-1}$ is a global representation for all $O(n)$ matrices [2601.16271, 1707.09520].

A central property is that orthogonality/unitarity is automatic: if $S^\top = -S$, then
\[
Q^\top Q = [(I+S)^{-1}(I-S)]^\top (I-S)(I+S)^{-1} = I
\]
since the product $(I-S^2) = (I-S)(I+S) = (I+S)(I-S)$. Analogous constructions hold for skew-Hermitian $A$ and the unitary group $U(n)$.

## 2. Extensions: Scaled and Generalized Cayley Parametrizations

The classical Cayley parametrization does not cover matrices with eigenvalue $-1$ because $I-S$ becomes singular. To resolve this, Kahan and successors introduced a "scaled Cayley transform":
\[
W = (I + A)^{-1}(I - A) D
\]
where $A$ is skew-symmetric and $D$ is a fixed diagonal of signs for $O(n)$ [1707.09520, 1811.04142]. In the complex/unitary case, $A$ becomes skew-Hermitian and $D=\operatorname{diag}(e^{i\theta_j})$ is a diagonal of phases, allowing a differentiable parameterization of $U(n)$ with $A$ and $\theta$ as unconstrained variables [1811.04142].

For rectangular orthogonal matrices and the Stiefel manifold $\St(n,p)$, the Cayley transform is generalized via block-skew coordinates. Given a "center" $S\in O(n)$, the following map holds for $U\in \St(n,p)$:
\[
\Phi_S(U) = \begin{bmatrix}A_S(U) & -B_S(U)^\top \\ B_S(U) & 0\end{bmatrix}
\]
with $A_S(U)=2(I_p+S_\text{le}^T U)^{-T}(U^T S_\text{le})(I_p+S_\text{le}^TU)^{-1}$ and $B_S(U) = -S_\text{ri}^T U (I_p+S_\text{le}^T U)^{-1}$, so every $U$ in an open dense subset has an unconstrained vector representation [2312.01014, 2305.17901, 1810.02881].

The Cayley parametrization is further extended to the group of rigid-body motions $SE(3)$ in robotics as:
\[
T_\text{Cay}(\xi) = \big(I_4 - \frac{1}{2}\hat{\xi}\big)^{-1} \big(I_4 + \frac{1}{2}\hat{\xi}\big)
\]
where $\xi$ is a 6-vector encoding translation and rotation, and $\hat{\xi}$ is its se(3) matrix representation [2103.07309].

## 3. Computational Techniques and Analytical Properties

A key computational advantage is that the Cayley transform yields polynomial or rational forms in unconstrained variables, which allows efficient evaluation, gradient computation, and inversion. In the $SU(2)$ spin-$j$ case, the Cayley transform of a spin operator leads to a degree-$2j$ matrix polynomial whose coefficients are explicit rational functions (in $\tan(\theta/2)$) and can be computed via resolvent expansions and truncations of determinants [1506.00500].

In high-dimensional settings, the construction of the Cayley parameters can be performed algorithmically, e.g., for any $U\in O(n)$ the signature matrix $D$ can be found by a Gaussian-elimination-style pivoting in $O(n^3)$ arithmetic steps, such that $U = D(I - S)(I + S)^{-1}$, with $\|S\|_2 \le 1 + 2^n$ [2601.16271].

For over-parameterized cases like the Stiefel manifold ($n > p$), the parameter space is a Euclidean ball of dimension $np - \frac{1}{2}p(p+1)$, and direct optimization in this space is possible. Adaptive recentring strategies, which change the center $S$ whenever optimization steps approach a domain singularity, mitigate ill-conditioning and ensure bounded parameter norms [2305.17901, 2312.01014].

In optimization, Cayley-based retractions serve as efficient alternatives to matrix exponentials, QR, or polar decompositions. The iterative Cayley retraction on Stiefel avoids inversion and achieves $O(n p^2)$ complexity per step, markedly accelerating training in deep learning or Riemannian settings [2002.01113].

## 4. Practical Applications in Physics, Machine Learning, and Geometry

Cayley parametrization is utilized in a spectrum of modern applications:

- **Quantum spin and $SU(2)$ theory:** Offers a closed, computationally efficient polynomial form for arbitrary spin-j rotations, advantageous over the exponential/CFZ expansion for iterative algorithms and rational approximations [1506.00500].
- **K-theory and operator algebras:** The Cayley transform provides an explicit isomorphism at the level of cycles between van Daele $K$-theory and KK-theory for graded $C^*$-algebras. It preserves Morita equivalence, compatibility with Kasparov products, and index pairings, underpins $KO$-theory, and enables explicit representative computations for topological phases of matter [1912.07158].
- **Robotics and Vision:** The SE(3) Cayley map enables fast, fully polynomial pose updates without transcendental functions, with improved numerical conditioning for iterative pose alignment (the "CayPer" algorithm) and geometric optimization [2103.07309].
- **Deep Learning:**  
  - Orthogonal and unitary RNNs enforce norm-preserving transformations via Cayley-parametrized weight matrices, yielding better gradient flow and robustness. The "scaled Cayley" overcomes blind spots at eigenvalue $-1$, allowing fully expressive, differentiable unitary or orthogonal parameterizations [1707.09520, 1811.04142].
  - Orthogonal convolution layers via Cayley transforms parameterize filters as skew-symmetric convolutions, enabling direct, fast, and exact orthogonality constraints in both spatial and Fourier domains. This confers stability, tighter Lipschitz bounds, and certified adversarial robustness [2104.07167].
  - Layerwise and end-to-end Lipschitz control in 1D CNNs is enabled by combining Cayley-orthogonal parameterizations with the controllability Gramian, resulting in architectures with provable robustness and unconstrained training [2303.11835].

- **Optimization on Manifolds:**  
  - On the Stiefel (and Grassmann) manifolds, the Cayley parametrization converts orthogonality constraints into unconstrained vector optimization, facilitating Euclidean algorithm transfer, fast iteration, and global convergence guarantees [2312.01014, 2305.17901, 2002.01113, 1810.02881].
- **Data Fitting and Geometric Statistics:**  
  - Ellipsoid fitting via Cayley parametrization replaces constrained search over orthogonal transformations with unconstrained skew-symmetric blocks, allowing globally elliptic solutions and efficient nonlinear least-squares with explicit gradients [2304.10630].
  - Stochastic simulation and random matrix theory exploit the Cayley change-of-variables to sample from Stiefel or Grassmann distributions, with Jacobians computed via Kronecker-structured derivatives and asymptotic normal approximations linking random Cayley parameters to Gaussians under Haar measure [1810.02881].

- **SU(3) Gauge Theory Simulation:**  
  - Modified Cayley maps for $\mathrm{SU}(3)$ include a nonlinear phase to enforce unit determinant, providing a local diffeomorphism to $SU(3)$ suitable for Hamiltonian splitting and hybrid Monte Carlo integration in lattice gauge theory. This construction maintains reversibility, preserves volume, and can enhance numerical stability compared to exponential mappings [2406.11337].

## 5. Limitations and Handling of Singularities

The surjectivity of the classical Cayley map fails on group elements with eigenvalue $-1$ (or, for $SE(3)$, on 180° rotations). Scaled variants (introducing a diagonal $D$ or phase factors in complex/unitary cases) guarantee global parameterizations by moving potential singularities away from the current chart [1707.09520, 2601.16271, 1811.04142]. In Stiefel/Grassmann optimization the domain of the Cayley map is only an open dense subset, but adaptive strategies (center point shifting) or pivoting ensure that optimization iterates remain within the domain [2305.17901, 2312.01014].

Jacobians and differentials of the transform can be singular at chart boundaries, complicating change-of-variable formulas or gradient propagation. In practice, careful numerical safeguards (e.g., monitoring parameter norms, recentering) are employed to avoid these ill-conditioned regions [1810.02881, 2305.17901].

## 6. Comparative Analysis With Exponential and Other Parametrizations

The Cayley transform is a rational function in the algebra parameter, which avoids trigonometric and transcendental evaluations required by the exponential map. For $SU(2)$, the Cayley polynomial for $U_{\rm Cay}(a)$ maps directly and exactly to the exponential parametrization via $a = \tan(\theta/2)$; the Cayley coefficients are purely rational and more amenable to analytic and numerical computation than the truncated Taylor/arcsin series of the exponential (CFZ) expansion [1506.00500].

In optimization and machine learning, the Cayley parametrization leads to O($n^3$) complexity per orthogonality-enforcing update or layer, matching or improving on polar or QR retraction methods especially in high dimensions, and conferring exactness by construction [2002.01113]. Compared to penalty or SVD-based approaches for orthogonal convolutions, the Cayley approach is both more expressive and computationally efficient [2104.07167].

For Lie group-valued integration in molecular dynamics ($SU(3)$), modified Cayley transforms offer improved step-size stability and acceptance rates compared to exponential maps, notably in moderate–coarse regimes; standard exponential maps retain advantages at very small step sizes [2406.11337].

## 7. Summary Table of Canonical Forms and Their Domains

| Group / Manifold | Classical Cayley Map             | Global Extension                   | Domain / Notes                  |
|------------------|----------------------------------|------------------------------------|---------------------------------|
| $SO(n)$          | $Q = (I-S)(I+S)^{-1}$            | $Q = D(I-S)(I+S)^{-1}$, $D$ sign   | $I+S$ invertible; all $O(n)$    |
| $SU(n)$          | $Q = (I-S)(I+S)^{-1}$, $S^\dagger=-S$ | $Q = (I-S)(I+S)^{-1} D$, $D$ unitary phase | $I+S$ invertible                |
| $St(n,p)$        | $U = S(I-V)(I+V)^{-1}I_{n\times p}$ | Adaptive center, block-skew $V$    | Open dense set                  |
| $SE(3)$          | $T_{Cay}(\xi)$ as above          | $180^\circ$ rotation excluded      | $I - \frac{1}{2}\hat\xi$ nonsing|
| $\mathrm{SU}(3)$ | $Q = (I-\Omega)^{-1}(I+\Omega)$  | Modified with phase $\theta(\Omega)$ | Local diffeomorphism            |

## References

- "Cayley transforms of su(2) representations" [1506.00500]
- "A Constructive Cayley Representation of Orthogonal Matrices and Applications to Optimization" [2601.16271]
- "Orthogonal Recurrent Neural Networks with Scaled Cayley Transform" [1707.09520]
- "Complex Unitary Recurrent Neural Networks using Scaled Cayley Transform" [1811.04142]
- "Adaptive Localized Cayley Parametrization for Optimization over Stiefel Manifold" [2305.17901]
- "Generalized Left-Localized Cayley Parametrization for Optimization with Orthogonality Constraints" [2312.01014]
- "Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform" [2002.01113]
- "Orthogonalizing Convolutional Layers with the Cayley Transform" [2104.07167]
- "Random orthogonal matrices and the Cayley transform" [1810.02881]
- "Ellipsoid fitting with the Cayley transform" [2304.10630]
- "A modified Cayley transform for SU(3) molecular dynamics simulations" [2406.11337]
- "Vectorial Parameterizations of Pose" [2103.07309]
- "The Cayley transform in complex, real and graded $K$-theory" [1912.07158]
- "Lipschitz-bounded 1D convolutional neural networks using the Cayley transform and the controllability Gramian" [2303.11835]
- "Cayley parametrization and the rotation group over a non-archimedean pythagorean field" [1607.07055]

The Cayley transform parametrization is thus a structurally transparent, computationally efficient, and algebraically robust tool for representing, analyzing, and optimizing orthogonality and unitarity constraints in both finite and infinite-dimensional settings, across mathematics, physics, engineering, and machine learning.

Source: https://www.emergentmind.com/topics/cayley-transform-parametrization