---
title: Cayley Transform in Matrix Lie Groups
url: https://www.emergentmind.com/topics/cayley-transform
type: topic
---

# Cayley Transform in Matrix Lie Groups

The Cayley transform is a rational, birational, or diffeomorphic map between certain matrix Lie algebras and groups, classically mapping skew-symmetric (or skew-Hermitian) matrices to orthogonal (or unitary) matrices. Its algebraic, analytic, and computational properties allow for efficient parameterizations, optimizations, and structure-preserving numerical methods across mathematical physics, representation theory, optimization on matrix manifolds, deep learning, and operator theory.

## 1. Definition and Foundational Properties

Let $F = \mathbb{R}$ or $\mathbb{C}$. For a skew-symmetric ($A^\top = -A$) or skew-Hermitian ($A^* = -A$) matrix $A \in F^{n \times n}$, the Cayley transform is defined as
\[
C(A) = (I - A)(I + A)^{-1}
\]
provided $I + A$ is invertible. The transform maps skew-generators into the orthogonal (if $A$ real) or unitary (if $A$ complex) group:
- $A^\top = -A$ $\Longrightarrow$ $C(A) \in O(n)$,
- $A^* = -A$ $\Longrightarrow$ $C(A) \in U(n)$.

The inverse Cayley transform recovers $A$ (when $-1 \notin \operatorname{spec}(C(A))$) via
\[
A = (I - W)(I + W)^{-1}
\]
where $W = C(A)$. The Cayley transform is a local diffeomorphism around $A = 0$ and $W = I$, inducing a birational isomorphism between a Zariski open neighborhood of $0$ and $I$ within the Lie algebra and the Lie group, respectively [2411.02071].

The domain of definition excludes points where $I + A$ is singular, i.e., when $A$ has $-1$ as an eigenvalue. This domain issue is fundamental when representing arbitrary orthogonal or unitary matrices.

## 2. Generalizations and Domain Extensions

### Scaled and Pivoted Cayley Transforms

The classical Cayley transform cannot represent matrices with eigenvalue $-1$, as $(I + W)$ becomes singular. The scaled Cayley transform introduces a diagonal signature matrix $D = \operatorname{diag}(\pm 1)$ and reparametrizes as
\[
W = (I + A)^{-1}(I - A) D
\]
for $A^\top = -A$, $D^2 = I$. By altering $D$, every $W \in O(n)$ can be represented—even those with $-1$ eigenvalues [1707.09520].

A recent constructive approach [2601.16271] gives an $O(n^3)$ algorithm to select $D$ ensuring $-1 \notin \operatorname{spec}(DU)$ for any $U \in O(n)$, yielding a bounded skew-symmetric $S$ satisfying
\[
U = D (I - S)(I + S)^{-1}
\]
exactly representing all real orthogonal matrices. The approach provides quantitative spectral bounds for $S$.

The scaled Cayley idea also generalizes to the complex case, with $D = \operatorname{diag}(e^{i\theta_j})$ for $\theta_j \in \mathbb{R}$, leading to a fully parameterized unitary group with all phases learnable in machine learning contexts [1811.04142].

### Further Extensions

- **Cayley on Quadratic Groups:** For broader quadratic Lie groups $G = \{ X : X J X^* = J \}$, the Cayley map preserves $G$, mapping $\mathfrak{g}$ to $G$ [2408.13043, 2406.11337].
- **Representation-Theoretic Generalization:** The Cayley transform applies to representations $\rho: G \rightarrow GL(V)$ provided that $d\rho(\mathfrak{g})$ is closed under the "power-span" property and associated symmetries [2411.02071].

## 3. Applications in Optimization and Geometry

### Matrix Manifolds

The Cayley transform implements computationally efficient retractions and coordinate charts for orthogonality- or unitarity-constrained optimization:

- **Stiefel Manifold:** The generalized Cayley parameterization provides an (almost) global chart of $\mathrm{St}(p,N) = \{U \in \mathbb{R}^{N \times p}: U^\top U = I_p\}$, transferring the optimization problem to an unconstrained Euclidean domain [2305.17901, 1810.02881].
- **ALCP Scheme:** Adaptive locational re-centering mitigates slow convergence near chart singularities, outperforming classical QR- or retraction-based manifold optimizers with negligible overhead [2305.17901].
- **Iterative Cayley Retraction:** An efficient iterative solver enables Riemannian optimization (SGD, Adam) enforcing exact orthogonality, with global $O(1/\sqrt{t})$ convergence, and significant empirical speedup and stability for deep CNN/RNN training [2002.01113].

### Inverse Eigenvalue Problems

The Cayley transform is employed as a retraction in globally convergent Newton-like schemes for symmetric inverse eigenvalue problems, providing exact structure preservation (orthogonality) and avoiding the cost of explicit QR or SVD reorthogonalizations [1304.6209].

## 4. Function Theory, Probability, and Operator Theory

- **Random Matrix Theory:** The Cayley transform parametrizes the Stiefel and Grassmann manifolds, enabling explicit Jacobians for change-of-variables in MCMC and providing asymptotically independent normal approximations for uniform measures via the Euclidean parameters [1810.02881].
- **Quaternionic and Graded Operator Theory:** The Cayley transform extends to quaternionic Hilbert spaces, tying the Cayley spectrum to the S-spectrum and underpinning deficiency index theory akin to the complex setting [1705.05240].
- **$K$-theory:** The Cayley transform yields explicit isomorphisms between van Daele $K$-theory and $KK$-theory, compatible with Kasparov products, index pairings, and real/grading structures, providing cycle-level representatives essential for analytical and physical applications [1912.07158].

## 5. Structure-Preserving Numerical Analysis and Differential Equations

The Cayley transform forms the backbone of commutator-free Lie group integrators for non-autonomous differential equations on quadratic matrix groups, preserving physical and geometrical invariants:

- **Commutator-Free Integrators:** High-order time-propagators composed of Cayley transforms achieve fourth-order global accuracy while guaranteeing exact group structure preservation, circumventing the cost and complexity of matrix exponentials and nested commutators [2408.13043].
- **Modified Cayley for $\mathrm{SU}(3)$:** Implementing rational update steps that locally parameterize $\mathrm{SU}(3)$, the modified Cayley transform ensures reversibility and volume preservation in molecular dynamics and lattice QCD, and achieves superior empirical efficiency in second-order splitting integrators, though is only first-order per link update [2406.11337].

## 6. Deep Learning and Neural Networks

- **Unitary and Orthogonal RNNs:** The Cayley transform (and its scaled and complex-scaled variants) parameterizes orthogonal/unitary recurrent weight matrices, preserving gradient norms exactly (avoiding vanishing/exploding gradients), with direct closed-form gradient updates tied to unconstrained skew-symmetric/Hermitian parameters. The discrete structure of "scaling matrices" $D$ is handled as a hyperparameter or optimized in the complex domain [1707.09520, 1811.04142].
- **Orthogonal Convolutional Layers:** Exact orthogonality is imposed on convolutional layers by implementing the Cayley transform in the Fourier domain, ensuring Lipschitz-$1$ operator norm, enhancing adversarial robustness, and enabling networks to scale to large architectures with guaranteed gradient norm preservation [2104.07167].

## 7. Algebraic Interactions, Representation Theory, and Tensor Structure

- **Kronecker Product:** The Cayley transform of $A \otimes B$ being a Kronecker product reflects deep algebraic structure and only occurs under special conditions on the spectra of $A$ and $B$. Complete criteria exist for when $U_{A \otimes B} = U_A \otimes U_B$ [1305.1015].
- **Representation-Theoretic Classifications:** The Cayley transform applies to certain representations of Lie groups, precisely those whose highest weights lie in a single Weyl group orbit (possibly plus the origin), leading to new characterizations for classical and exceptional simple Lie groups, notably identifying triality in $\mathrm{Spin}(8)$ [2411.02071].

---

The modern landscape of the Cayley transform thus encompasses parametrization of matrix groups and manifolds, efficient algorithms for optimization and sampling, structure-preserving numerical methods in differential equations, deep learning architectures, spectral operator theory, $K$-theory, and representation theory. Its computational variants, domain extensions (via scaling or pivoting), and analytic properties serve as a central toolkit in contexts where preservation of group structure, stability, and geometric fidelity are necessary.

Source: https://www.emergentmind.com/topics/cayley-transform