---
title: Adjoint Tangent Structure
url: https://www.emergentmind.com/topics/adjoint-tangent-structure
type: topic
---

# Adjoint Tangent Structure

Searching arXiv for the core paper and closely related uses of “adjoint tangent structure” across computational differentiation, tangent categories, and geometric settings.
“Adjoint tangent structure” is not a single universally standardized term; rather, it names a recurring pattern in which a nonlinear object is accompanied by two linearized companions: a tangent construction that propagates perturbations forward, and an adjoint construction that propagates sensitivities backward. In numerical modeling, this is the mathematical and algorithmic “shadow” of a nonlinear code [0711.4444]. In the TorchNWP framework for neural-network parameterizations inside numerical weather prediction systems, it is the formalization and implementation of tangent linear and adjoint models for neural-network components embedded in large Fortran models [2603.16976]. In categorical work, the phrase appears through tangent structures whose tangent bundle functor has an adjoint, yielding dual or opposite tangent categories [1605.07275], [2303.05434], [2503.18354], [2508.16302]. In Lie-theoretic and differential-geometric settings, it refers to tangent-bundle or cotangent-bundle structures tied to adjoint actions, adjoint orbits, or adjoint groups [2203.05514], [1310.7683]. Across these contexts, the common invariant is a pair of mutually related linear operators or functors that encode first-order variation and reverse transport of dual data.

## 1. Computational meaning: tangent and adjoint as linearized companions of a nonlinear model

In numerical analysis and data assimilation, the basic object is a nonlinear mapping
\[
Y = F(X),
\]
or, for time-dependent models, a time-stepping scheme
\[
x_{k+1} = M_k(x_k,p).
\]
The tangent linear model describes forward propagation of perturbations, while the adjoint model describes backward propagation of sensitivities [0711.4444]. In the tangent formulation, a perturbation \(\delta x_k\) evolves according to
\[
\delta x_{k+1} = \frac{\partial M_k}{\partial x_k}(x_k,p)\,\delta x_k + \frac{\partial M_k}{\partial p}(x_k,p)\,\delta p.
\]
The adjoint propagates a dual variable \(\lambda_k\) backward through the transposed Jacobian,
\[
\lambda_k = \left(\frac{\partial M_k}{\partial x_k}(x_k,p)\right)^{T}\lambda_{k+1} + \frac{\partial J}{\partial x_k}(x_k,p)^T,
\]
with terminal condition determined by the objective functional \(J\) [0711.4444].

This forward–backward duality is also the basis of algorithmic differentiation. If a program \(P\) computes \(Y=F(X)\) through a composition of elementary instructions, then forward mode computes directional derivatives \(\dot Y = F'(X)\dot X\), while reverse mode computes \(\overline X = F'(X)^*\overline Y\) [0711.4444]. In the language used for large CFD solvers, tangent mode realizes a Jacobian–vector product and adjoint mode realizes a vector–Jacobian product [1912.11717]. A standard consistency identity is
\[
(Jv)^T w = v^T(J^T w),
\]
which expresses the transposed relation between the two codes [1912.11717].

This computational meaning remains valid when the primal nonlinear problem is only partially converged. In that case, one may linearize the fixed-point iteration rather than the converged discrete PDE, obtaining tangent and adjoint systems about non-stationary points [2104.02826]. The resulting sensitivities are approximate, and their accuracy depends on the convergence of the nonlinear system; the paper states that “in the limit of machine zero convergence of the nonlinear problem this approximation error vanishes” [2104.02826]. A plausible implication is that the phrase “adjoint tangent structure” often denotes not merely a pair of formulas, but the entire discipline of keeping linearized and reverse-time models consistent with the discrete nonlinear computation.

## 2. Neural-network adjoint tangent structure in numerical weather prediction

In the TorchNWP work, adjoint tangent structure is the way tangent linear and adjoint models are formalized, implemented, and exposed for neural-network components embedded inside large Fortran numerical weather prediction systems [2603.16976]. The nonlinear neural-network parameterization is written as
\[
y = M(x),
\]
with tangent linear model
\[
Ay = J \cdot Ax,\qquad J = \frac{\partial y}{\partial x},
\]
where \(Ax\) and \(Ay\) denote input and output perturbations [2603.16976]. The adjoint is obtained from a scalar loss
\[
L = y \cdot y^* = y^T y^*,
\]
and automatic differentiation computes
\[
x^* = \frac{\partial L}{\partial x} = J(x)^T y^*.
\]
The paper states: “A scalar loss function \(L = y \cdot y^*\) is constructed. Using the automatic differentiation tool of LibTorch, the gradient of the scalar loss function \(L\) with respect to the input physical quantities is calculated to obtain the adjoint model result” [2603.16976].

TorchNWP builds these operators at the C/C++ level using LibTorch. Neural networks are trained in PyTorch, exported to `.pt` files, loaded by `torch::jit::load`, and called through standardized C/C++ interfaces that are then bound into Fortran through `ISO_C_BINDING` [2603.16976]. The forward interface is explicit: `model_new` initializes the model, `model_forward` performs inference, and `model_delete` frees resources [2603.16976]. The tangent and adjoint calculations are “encapsulated into standardized C/C++ interfaces, which are bound to the Fortran language through the ISO_C_Binding module” [2603.16976].

A central design principle is structural shielding. The paper states that tangent linear and adjoint technologies based on neural networks are implemented “at the C++ layer to shield the impact of the internal structure of neural network models and provide standardized tangent linear and adjoint interfaces” [2603.16976]. In practice, the Fortran host model does not need to know the number of layers, activation functions, or convolution structure; the `.pt` model, LibTorch runtime, and automatic differentiation machinery provide the required derivatives.

This structure is motivated directly by four-dimensional variational data assimilation. The TorchNWP paper says that after coupling a neural-network model with a numerical model, “to adapt to the four-dimensional variational data assimilation system, it is necessary to construct tangent linear and adjoint models corresponding to the neural network model” [2603.16976]. The implementation is intended to simplify the construction of such systems in operational models including CMA-GFS and MCV, and the paper reports applications to deep learning based radiation and non-orographic gravity wave drag parameterizations [2603.16976]. For the CMA-GFS non-orographic gravity wave drag surrogate, the reported six-hour mean absolute errors relative to the original physical scheme are \(0.055\ \mathrm{m/s}\) for 10 m wind speed, \(0.027\ \mathrm{m/s}\) for 500 hPa wind speed, and \(0.013\ \mathrm{K}\) for 500 hPa temperature; the coupled model is also reported to run a 10-day integration stably [2603.16976].

## 3. Large-scale differentiated codes: checkpointing, MPI, and operational geophysical models

The classical geophysical interpretation of adjoint tangent structure is exemplified by OPA–TAPENADE and later by large AD-enabled atmosphere–ocean and CFD systems. In OPA, a FORTRAN95 ocean general circulation model, tangent and adjoint codes were generated mechanically with TAPENADE and validated by comparison with divided differences and by an identical twin experiment [0711.4444]. The paper emphasizes that the differentiated code must mirror the modular structure of the original model, including modules, arrays, dynamic memory, and non-reentrant procedures [0711.4444]. For array notation, TAPENADE differentiates expressions such as
```fortran
zws(:,:,:) = SQRT(ABS(psal(:,:,:)))
```
into array-level adjoint code that also handles nondifferentiability at zero through `WHERE` constructs [0711.4444].

A defining issue in adjoint codes is memory. Reverse mode needs access to intermediate forward states, so naive “store-all” strategies become prohibitive for long integrations. OPA implements Griewank–Walther binomial checkpointing, for which the paper gives
\[
\eta(d,t) = \frac{(d+t)!}{d!\,t!}
\]
as the number of time steps optimally handled with \(d\) snapshots and \(t\) permitted duplicates per time step [0711.4444]. With \(d=15\) snapshots, the paper reports inflection points at \(\eta(15,2)=136\) and \(\eta(15,3)=816\), matching theory [0711.4444]. This makes checkpointing an integral part of the adjoint tangent structure rather than a mere implementation detail.

The same structural issues recur in parallel time-dependent PDE solvers. In JAGUAR, a massively parallel CFD code differentiated by TAPENADE, the two novelties are “1) the adjoint code is obtained by letting the AD tool Tapenade invert the complete layer of message passing interface (MPI) communications, and 2) the adjoint code integrates time-dependent, non-linear and dissipative (hence physically irreversible) PDEs with an explicit time integration loop running for ca. \(10^6\) time steps” [1912.11717]. The approach relies on the Adjoinable MPI library and on binomial checkpointing. The paper reports that for a viscous double shear layer case on 16 cores, a finite-difference sensitivity costs about \(2\) forward runs, tangent AD costs about \(1.7\), and adjoint AD about \(15.4\) relative to one primal run; tangent and adjoint agree to double precision, while finite differences differ in the last digits as expected [1912.11717].

MITgcm-AD v2 places the same ideas in a community ocean–atmosphere framework. There, the forward model, TLM, and adjoint are organized as
\[
x^{n+1} = L_n(x^n),
\qquad
\delta x^{n+1} = L_n' \delta x^n,
\qquad
\lambda^n = L_n^T \lambda^{n+1},
\]
with Tapenade-based source transformation, custom treatment of I/O and MPI exchanges, and binomial checkpointing integrated into the build system [2401.11952]. The motivation is practical: tangent-linear and adjoint models provide “gradient information which enables dynamics-based sensitivity and attribution studies, state and parameter estimation, and rigorous uncertainty quantification” [2401.11952]. In ECCO-style applications, they are essential for efficient large-scale data assimilation [2401.11952].

A plausible synthesis is that in computational science the term “adjoint tangent structure” refers to a three-layer object: the linear algebra of Jacobians and transposes, the code-generation machinery that respects the full discrete algorithm, and the systems engineering needed to make reverse-time differentiation feasible at operational scale.

## 4. Manifold and Lie-theoretic uses: tangent spaces, adjoint actions, and bundle geometry

Outside computational differentiation, the phrase acquires a more geometric meaning. In tangent space backpropagation for \(SO(3)\), \(SE(3)\), and \(Sim(3)\), the relevant structure is the Lie-group tangent space together with the adjoint representation \(\mathrm{Adj}_X\), which moves tangent vectors between group elements and coordinate frames [2103.12032]. For a group element \(X\),
\[
\mathrm{Adj}_X(a) = (X a^\wedge X^{-1})^\vee,
\]
and it satisfies
\[
X\circ \Exp(a) = \Exp(\mathrm{Adj}_X(a))\circ X
\]
[2103.12032]. In composition \(Z=X\circ Y\), the Jacobians in tangent coordinates are
\[
\frac{\partial Z}{\partial X}=I,\qquad \frac{\partial Z}{\partial Y}=\mathrm{Adj}_X,
\]
so reverse-mode gradients on manifolds are transported by adjoint maps rather than by Euclidean embeddings [2103.12032]. The paper describes this explicitly as “tangent space backpropagation,” and a plausible implication is that here “adjoint tangent structure” names the combination of tangent-space differentiation and adjoint frame transport.

In the geometric algebra paper on bivectors, the phrase refers to the commutator action of a bivector \(B\) on vectors and multivectors. The adjoint operation is
\[
\mathrm{ad}_B(\alpha)=[B,\alpha],\qquad B\times \alpha = \tfrac12[B,\alpha],
\]
and on vectors it is the grade-preserving map \(f(v)=B\times v = B\cdot v\) [2412.20566]. The paper connects the eigenstructure of this adjoint action to the outer exponential \(\Lambda^B\), an “outer tangent” \(\ta_\wedge(B)\), and a factorized Cayley–Hamilton theorem [2412.20566]. There, “adjoint tangent structure” designates a spectral and infinitesimal structure underlying spin-group transformations.

The phrase also arises in the geometry of adjoint orbits. For adjoint orbits of \(SL(n,\mathbb{R})\), the paper studies geodesics by identifying the orbit \(\mathrm{Ad}(G)H_\Theta\) with the cotangent bundle \(T^*\mathbb{F}_\Theta\) of an \(SO(n)\)-flag manifold, and then with \(T\mathbb{F}_\Theta\) via an invariant metric [2203.05514]. This yields an “adjoint tangent structure” in which the adjoint orbit of the non-compact group is reinterpreted as a tangent-bundle geometry over the compact adjoint orbit. Geodesics are then described using the Sasaki metric on the tangent bundle and the coupled equations
\[
\left\{
\begin{aligned}
&\nabla_{\dot{\zeta}}\dot{\zeta} = -R(\gamma,\nabla_{\dot{\zeta}}\gamma)\dot{\zeta},\\
&\nabla_{\dot{\zeta}}\nabla_{\dot{\zeta}}\gamma
= -\,g(\nabla_{\dot{\zeta}}\gamma,\nabla_{\dot{\zeta}}\gamma)\,\gamma.
\end{aligned}
\right.
\]
[2203.05514].

A further geometric use appears in the wonderful compactification of an adjoint group. For a simple complex algebraic group \(G\) of adjoint type, the tangent bundle \(T_{\overline G}\) of its wonderful compactification is a \(G\times G\)-equivariant bundle whose fiber at the identity realizes the adjoint representation on \(\mathfrak g\) [1310.7683]. Because this fiber representation is irreducible and because \(\overline G\) is a \(G\times G\)-equivariant compactification, the paper proves that \(T_{\overline G}\) is stable with respect to every polarization [1310.7683]. Here the “adjoint tangent structure” is representation-theoretic: the tangent fiber at the identity is literally the adjoint module.

## 5. Categorical adjoint tangent structures and universal tangent formalisms

In category theory, “adjoint tangent structure” becomes literal: it refers to tangent bundle functors that possess adjoints or dual tangent structures. The starting point is the Cockett–Cruttwell tangent structure, consisting of a tangent functor \(T\), a projection \(p:T\Rightarrow 1_{\mathcal M}\), a zero section \(\eta\), addition \(+\), vertical lift \(\ell\), and canonical flip \(c\), satisfying a family of axioms in \(\mathrm{End}(\mathcal M)\) [1605.07275]. The paper “The free tangent structure” shows that giving such a structure on \(\mathcal M\) is equivalent to giving a strong monoidal functor
\[
F : (\mathbf{Weil1},\otimes,k)\to (\mathrm{End}(\mathcal M),\circ,1_{\mathcal M})
\]
preserving foundational pullbacks and a distinguished equaliser [1605.07275]. This makes \(\mathbf{Weil1}\) the free or initial tangent structure.

The dualization theme becomes explicit in the work on \(\infty\)-toposes. There, Lurie’s tangent bundle functor on presentable \(\infty\)-categories yields a tangent structure on \(L=T^{op}\), while an adjoint functor \(U\) yields a geometric tangent structure on \(T\) itself [2101.08805]. The paper states that Lurie’s tangent bundle functor \(T:T^{op}\to T^{op}\) has a left adjoint \(U^{op}\), and that the opposite \(U:T\to T\) underlies a tangent structure [2101.08805]. For injective \(\infty\)-toposes,
\[
U(\mathcal X)\simeq \mathrm{Fun}^\omega(T(p(\mathcal X)),S),
\]
so the adjoint tangent bundle is computed by applying the Goodwillie/Lurie tangent bundle to the \(\infty\)-category of points [2101.08805]. In this setting, “adjoint tangent structure” is an exact duality between algebraic and geometric tangent bundle functors.

A similar pattern appears for algebras over an operad. The category of \(\mathcal P\)-algebras has tangent bundle
\[
T(A)=A\ltimes A
\]
given by semi-direct product, while the opposite category has a tangent bundle
\[
T^\circ(A)=\mathrm{Free}_A(\Omega_A)
\]
built from Kähler differentials [2303.05434]. These two functors are adjoint:
\[
T^\circ \dashv T,
\]
and both carry full tangent category structure [2303.05434]. The divided power algebra paper later reproduces this pattern in a different algebraic context: the semidirect-product tangent structure on divided power algebras admits an adjoint tangent structure on the opposite category, again described by Kähler-differential-type data [2508.16302].

The formal theory of tangentads generalizes these ideas two-categorically. A tangentad is to a tangent category what a formal monad is to a monad; the paper constructs a 2-comonad on the 2-functor of tangentads and introduces adjunctable and representable tangentads [2503.18354]. An adjunctable tangentad is one for which \(T^n\) has left adjoints \(T^{n\ast}\), allowing mate constructions to define an op-tangent structure [2503.18354]. A representable tangentad is one for which \(T^n\) is right adjoint to \(D_n\times -\) for suitable infinitesimal objects \(D_n\) [2503.18354]. These results suggest that, in formal category theory, an adjoint tangent structure is a tangent structure whose tangent powers themselves participate in a system of adjunctions.

## 6. Conceptual synthesis and recurring themes

Across the literature, “adjoint tangent structure” consistently combines three ingredients. The first is a tangent object: Jacobian action in numerical models, tangent spaces in Lie groups, tangent bundles in geometry, or tangent functors in category theory. The second is an adjoint object: transposed Jacobian, reverse-mode sensitivity, adjoint representation, or a left/right adjoint tangent functor. The third is a compatibility principle ensuring that the two constructions are not independent but dual.

Several recurring themes are visible.

**Forward perturbations versus backward sensitivities**: in numerical weather prediction, ocean modeling, and CFD, the tangent model propagates perturbations and the adjoint propagates sensitivities, typically for 4D-Var or optimization [2603.16976], [2401.11952], [1912.11717].

**Black-box encapsulation versus structural exactness**: TorchNWP shields the internal neural-network architecture while still exposing tangent and adjoint interfaces [2603.16976]. By contrast, OPA, MITgcm, and JAGUAR emphasize exact differentiation of the discrete code, including solvers, arrays, and MPI [0711.4444], [2401.11952], [1912.11717]. This suggests a continuum between encapsulated derivative services and full algorithmic transparency.

**Memory, reversibility, and checkpointing**: reverse-mode tangent structures are rarely purely formal; they require storage or recomputation policies. The OPA and JAGUAR papers make checkpointing a constitutive part of adjoint design [0711.4444], [1912.11717].

**Representation-theoretic and geometric duality**: in adjoint groups, adjoint orbits, and Lie-algebra actions, the tangent structure at a point is controlled by an adjoint representation or an adjoint action [1310.7683], [2203.05514], [2412.20566].

**Universal and opposite constructions**: categorical papers repeatedly realize tangent structure through free, dual, or opposite constructions, often with explicit adjunctions [1605.07275], [2101.08805], [2303.05434], [2503.18354], [2508.16302].

A common misconception is that “adjoint tangent structure” has a unique technical definition. The literature does not support that. The term is domain-relative. In computational science it usually means the pair of tangent-linear and adjoint models associated with a nonlinear code. In higher category theory it may mean a tangent structure whose tangent functor has an adjoint or whose opposite category inherits a dual tangent structure. In geometry it can denote tangent-bundle realizations attached to adjoint actions or adjoint orbits. What unifies these usages is not terminology but structure: a first-order forward object, a dual backward object, and a principled relation between them.

Source: https://www.emergentmind.com/topics/adjoint-tangent-structure