---
title: High-Order Linearization Methods
url: https://www.emergentmind.com/topics/high-order-linearization
type: topic
---

# High-Order Linearization Methods

Searching arXiv for the most relevant papers on high-order linearization and closely related uses of the term.
High-order linearization denotes a family of constructions rather than a single universally accepted method. Across the literature, it refers to procedures that replace nonlinear, higher-derivative, or higher-order interaction structure by linear or linearly organized dynamics while retaining information beyond first-order tangent approximation. In the sources considered here, the phrase covers algorithmic point-linearization of arbitrary-order ordinary differential equations, high-order local-linearization integrators, multilinear polarization schemes for higher-order equations, higher-order variational equations, higher-order corrections to Newton-type optimization, kernel linearization followed by higher-order pooling in representation learning, direct linearization of higher-derivative gravity, finite-order truncations of exact Volterra feedback linearizers for nonlinear PDEs, Carleman liftings to monomial coordinates, and commutation results between higher-order linearization and homogenization [1505.01618], [1208.4765], [2307.03820], [1910.03987].

## 1. Terminological scope and recurring structures

The term “high-order” is used in several distinct senses. In some works it refers to the order of the differential equation itself, as in point-linearization of \(n\)-th order ODEs or Kahan-type discretizations for \(n\)-th order equations [1505.01618], [1911.03161]. In others it refers to the order of approximation, as in second-, third-, and fourth-order corrections to Newton, Gauss–Newton, and Levenberg–Marquardt methods [2307.03820]. In yet others it refers to higher-order statistics or tensor structure, as in order-\(r\) pooled descriptors built after kernel linearization [1701.05432]. A further use appears in higher-derivative field theories, where “higher-order frame” means the original \(f(R)\) formulation rather than an Einstein-frame reduction [1611.08237].

A recurring distinction is between exact and approximate linearization. Exact point transformation of ODEs, exact nonlinear backstepping for hyperbolic PDEs, and exact infinite-dimensional Carleman embeddings belong to the first category, although they may be impractical or infinite-dimensional in use [1505.01618], [2607.04361], [2111.11327]. Truncated Volterra feedback laws, finite-order Carleman models, and higher-order Taylor-like optimizer updates belong to the second category: they no longer remove the nonlinearities exactly, but the uncanceled part begins at a controlled higher order [2607.04361], [2605.05901], [2307.03820]. This suggests that many “high-order linearization” methods are best understood as structured defect-control procedures rather than as one-shot exact reductions.

A second recurring distinction concerns what is being linearized. In some papers the object is the differential equation itself, in others the flow jet, a kernel, a nonlinear least-squares path, or a system matrix. The literature therefore does not support a single canonical definition. Instead, the common thread is the replacement of nonlinear composition laws by linear dynamics in a richer coordinate system, with the retained order determining how much nonlinear structure survives in explicit form.

## 2. Ordinary differential equations and dynamical systems

For scalar ODEs, one major line of work studies point-linearization of arbitrary-order equations. A nonlinear equation
\[
u=f(x,y),\qquad t=g(x,y),\qquad J=f_xg_y-f_yg_x\neq 0
\]
is sought so that the transformed equation takes the Laguerre normal form
\[
u^{(n)}(t)+\sum_{i=0}^{n-3}A_i(t)u^{(i)}(t)=0.
\]
The key result is that the linearizability question can be reduced to the consistency of an overdetermined nonlinear PDE system in \(f\), \(g\), and \(A_i\), together with the constraint \((A_i)_x g_y-(A_i)_y g_x=0\); differential Thomas decomposition is then used as the computational engine, and a symmetry-dimension pretest provides a fast necessary obstruction in high order [1505.01618]. In this framework, high-order linearization is exact if the determining PDE system is consistent.

A different use of the term appears in Local Linearization–Runge–Kutta methods. There the nonlinear IVP
\[
\frac{d\mathbf x(t)}{dt}=\mathbf f(t,\mathbf x(t))
\]
is split at each step into an exactly solvable local linearized problem plus an auxiliary nonlinear remainder equation. The linear part is treated by local linearization, while the remainder is approximated by an explicit RK scheme, yielding updates of the form
\[
\mathbf y_{n+1}=\mathbf y_{LL}(t_n+h_n;t_n,\mathbf y_n)+\boldsymbol\rho(t_n,\mathbf y_n;h_n).
\]
The point emphasized in the paper is that the method’s “high-order” character does not come from a higher-order Taylor linear model of the vector field; it comes from solving the remainder equation with an order-\(\gamma\) RK method. Under \(\mathbf f\in \mathcal C^{\gamma+1}\), the global error is \(O(h^\gamma)\), and the resulting schemes preserve equilibria, preserve linearization at equilibria, and can be implemented as A-stable explicit integrators [1208.4765].

In the Kahan-type literature, high-order linearization is instead algebraic multilinearization. For systems
\[
\frac{d^n x_i}{dt^n}=f_i(x_1,\dots,x_N),
\]
with \(\deg f_i\le n+1\), the \(n\)-th derivative is replaced by the \(n\)-th forward difference and each degree-\((n+1)\) monomial is replaced by its complete symmetric multilinearization across \(n+1\) adjacent time levels. The construction reduces to classical Kahan discretization when \(n=1\), is birational, and is “order-preserving” in the specific sense that an \(n\)-th order ODE becomes an \(n\)-th order difference equation with the same \(nN\)-dimensional initial-value space [1911.03161]. The paper explicitly warns that “order-preserving” here does not refer to numerical order of accuracy.

Equivalent linearization gives yet another meaning. For weakly nonlinear oscillators, the equation is rewritten as an effective linear oscillator with frequency \(\Omega\), and resonant fundamental harmonics are eliminated iteratively. The paper’s central point is that equivalent linearization is not confined to first-order frequency corrections: when first-order averages vanish, one should average over the unperturbed period, compute the first waveform correction, substitute it back, and eliminate the fundamental again. This produces nonzero \(O(\varepsilon^2)\) corrections for systems such as
\[
\ddot x+x+\varepsilon x^{2\mu}=0
\]
and for the van der Pol oscillator, for which the paper obtains
\[
\Omega = 1 + 0\,\varepsilon - \frac{1}{16}\varepsilon^2 + O(\varepsilon^3)
\]
[1605.02978]. The misconception corrected there is that equivalent linearization is only a first-order device.

Higher-order variational equations linearize not the vector field directly but the jet dynamics of the flow along a particular solution \(\psi\). Writing \(A_i=X^{(i)}(\psi)\) and \(Y_i\) for the \(i\)-th derivatives of the flow, the nonlinear hierarchy
\[
\dot Y = A\,\exp_\odot Y
\]
is embedded into a linear system on the graded symmetric algebra,
\[
\dot X=(A\odot \exp_\odot \operatorname{Id}_n)X.
\]
The \(k\)-th truncation \(LVE_\psi^k\) acts on \(\bigoplus_{j=1}^k \operatorname{Sym}^j(\mathbb C^n)\), with explicit block matrices, fundamental matrices, and monodromy formulas [1304.0130]. In this setting, high-order linearization means passing from nonlinear jet recursion to a linear system on symmetric powers.

## 3. Optimization and kernelized representations

In nonlinear least-squares optimization, high-order linearization is used to improve Newton, Gauss–Newton, and Levenberg–Marquardt steps in narrow curved valleys. The paper defines a “natural optimization pathway” by
\[
f(x(t))=(1-t)f(x(0)),
\]
so that \(J(x(0))\dot x(0)=-f(x(0))\) reproduces the Newton step at \(t=0\), and then differentiates this path to compute \(\ddot x\), \(x^{(3)}\), and \(x^{(4)}\). The second-order term is the geodesic acceleration
\[
\ddot x=-J(x)^{-1}f^{(2)}(x)\dot x\dot x,
\]
and higher corrections generate second-, third-, and fourth-order accelerated methods. On the synthetic benchmark \(f(x,y)=(x+y^2,\;K(y-x^2))\) with \(K=10^6\), the paper reports \(18733\) iterations for first order, \(397\) for second order, \(88\) for third order, and \(43\) for fourth order [2307.03820]. The relevant caution is that this is not a classical high-order Taylor minimization of the scalar objective; it is a higher-order expansion of a curved residual-reduction path.

A different construction arises in action recognition. There, a nonlinear sequence kernel on frame-level CNN classifier scores and temporal positions is linearized into explicit feature maps by finite pivot approximations of Gaussian kernels,
\[
\psi(x-x') \approx \langle \tilde\phi(x;Z),\tilde\phi(x';Z)\rangle,
\]
and then higher-order pooling is applied to the concatenated score-time maps. The resulting HOK descriptor is
\[
\mathrm{HOK}(X)=\frac{1}{\sqrt{\Lambda}}\sum_{u=1}^n
\begin{bmatrix}
\sqrt{\zeta_1}\,\Phi_F(x_u;Z_F)\ \sqrt{\zeta_2}\,\Phi_T(u;Z_T)
\end{bmatrix}^{\otimes r},
\]
with \(r=3\) used in the experiments, followed by HOSVD-based power normalization and a linear SVM [1701.05432]. The paper is explicit that the linearized object is the kernel, whereas the high-order object is the pooling statistic. That distinction is central to the method’s interpretation.

## 4. Partial differential equations, higher-derivative field theories, and feedback linearization

In five-dimensional warped \(f(R)\) gravity, linearization in the original higher-derivative formulation is complicated by the term \(f_{RR}(\delta^{(1)}R)^2\), which produces higher-order scalar perturbation equations. The key device is the curvature gauge
\[
\delta^{(1)}R=0,
\]
under which the dangerous higher-derivative contribution disappears from the quadratic action. After scalar-vector-tensor decomposition and elimination of constraints, the scalar normal mode takes the second-order Schrödinger-type form
\[
\delta^{(2)}S_s=\int d^5x\,\mathcal G\left(\Box^{(4)}\mathcal G+\mathcal G''-\frac{\theta''}{\theta}\mathcal G\right),
\]
while the tensor and vector sectors are already second order [1611.08237]. The companion equation-of-motion treatment derives the full linearized field equations before gauge fixing and recovers the same scalar and tensor master equations, while also identifying an additional vector constraint absent from the quadratic-action derivation [1708.03737]. The recurrent misconception addressed by these papers is that working directly in the higher-order frame necessarily leaves one with irreducibly fourth-order physical perturbation equations.

For nonlinear first-order hyperbolic PDEs, exact feedback linearization is available through an infinite Volterra backstepping operator
\[
T[u]=u-K[u],\qquad
K[u](x,t)=\sum_{n=2}^\infty \int_{T_n(x)} k_n(x,\xi_1,\ldots,\xi_n)\prod_{i=1}^n u(\xi_i,t)\,d\xi_n\cdots d\xi_1,
\]
which transforms
\[
u_t=u_x+F[u],\qquad u(1,t)=U(t)
\]
to the transport target \(w_t=w_x,\; w(1,t)=0\) when the exact boundary law \(U(t)=K[u(\cdot,t)](1)\) is used [2607.04361]. The paper’s contribution is to truncate the controller at finite order \(N\),
\[
K_N[u]=\sum_{n=2}^{N}\cdots,
\]
and prove that the tail
\[
|K[u](1)-K_N[u](1)|\le \varepsilon_N(r)
\]
is high-order in the state amplitude, so that every fixed truncation order still yields local stabilization. The theorem gives forward invariance, practical stability, practical finite-time attractivity after one transport crossing time, and asymptotic stability via a class-\(\mathcal{KL}\) estimate; the certified region of attraction grows with \(N\), and the practical residual shrinks with \(\varepsilon_N(r)\) [2607.04361]. Here high-order linearization is explicitly approximate: the first \(N\) nonlinear orders are canceled, and the residual begins at order \(N+1\).

## 5. Homogenization and infinite-dimensional analytic linearization

In nonlinear stochastic homogenization, higher-order linearization becomes a hierarchy of linearized equations around nonlinear correctors, and the central statement is that this hierarchy commutes with homogenization. For the heterogeneous equation
\[
-\nabla \cdot \big( D_pL(\nabla u(x),x)\big)=0,
\]
the paper defines multilinear forcing fields \(\mathbf F_m\) from derivatives of \(D_pL\), stationary higher-order correctors \(\psi^{(m)}_{p,h}\), and linearized coefficient fields
\[
a_p(x):=D_p^2L\big(p+\nabla\phi_p(x),x\big).
\]
The \(m\)-th linearized corrector solves
\[
-\nabla \cdot \left( a_p(x) \nabla \psi^{(m)}_{p,h} \right)
=\nabla \cdot \mathbf{F}_m\!\left( p+\nabla\phi_p(x),\,h+\nabla\psi^{(1)}_{p,h},\,\nabla \psi^{(2)}_{p,h}, \ldots \right),
\]
and the effective derivatives of the homogenized Lagrangian satisfy
\[
D_p^{m+2} \overline{L}(p) h^{\otimes (m+1)}
= \mathbb E\left[ \int_{[0,1]^d} \left( a_p \nabla \psi^{(m+1)}_{p,h} + \mathbf{f}^{(m+1)}_{p,h} \right) \right].
\]
The paper proves simultaneously that \(\overline L\in C_{\rm loc}^{2+\mathsf N,\beta}\), that the \(m\)-th heterogeneous linearized problem homogenizes to the \(m\)-th linearized problem of \(\overline L\), and that higher linearization errors satisfy optimal large-scale estimates of order \(m+1\), yielding a Liouville theorem and an explicit heterogeneous Taylor expansion of arbitrary solutions [1910.03987]. The phrase “higher-order linearization commutes with homogenization” is therefore literal.

In infinite-dimensional Hamiltonian dynamics near an elliptic fixed point, high-order linearization is formulated as symplectic conjugacy to the quadratic Hamiltonian
\[
D_\omega(u)=\sum_{j\in\mathbb Z}\omega_j |u_j|^2
\]
for systems of the form
\[
H=D_\omega+P,\qquad P=O(u^3),
\]
on Gevrey sequence spaces \(h^{s,p,\theta}\) [2108.00060]. The paper first defines formal symplectic linearizability by the existence of a formal generator \(G\) such that
\[
e^{\{G,\cdot\}}H=D_\omega,
\]
equivalently by the vanishing of the unique formal Birkhoff normal form \(Z_H\). Under the Bourgain-type Diophantine condition
\[
|\omega\cdot \ell| > \gamma \prod_{n\in\mathbb Z} \frac{1}{1+|\ell_n|^2 \langle n\rangle^2},
\]
and analytic majorant regularity of the perturbation, the main theorem states that formal symplectic linearization implies analytic symplectic linearization [2108.00060]. This is an infinite-dimensional analogue of the classical principle that formal nonresonant linearization converges under suitable arithmetic control.

## 6. Lifting methods, structure-preserving system linearizations, and computational scaling

Carleman linearization converts polynomial nonlinear dynamics into linear dynamics on monomials. For lattice Boltzmann with BGK equilibrium, the collision operator becomes quadratic in the discrete populations \(f_i\), so the lifted state \(\vec V\) containing monomials up to Carleman order \(O_c\) satisfies
\[
\frac{d\vec V}{dt}=C\vec V
\]
after truncation [2111.11327]. The paper gives an upper bound on the number of Carleman variables,
\[
N_{\text{Carleman}} \le \binom{O_c+Q}{Q},
\]
and shows analytically that when streaming is included the truncation error scales as
\[
\varepsilon_{\max}=O(\Delta t\,\Delta x^{O_c}),
\]
which underlies its statement that the error improves exponentially with Carleman order [2111.11327]. At the same time, linearizing the collision step sacrifices the exactness of streaming: nonlocal products such as \(f_i(\vec x+\Delta \vec x)\,f_j(\vec x)\) appear, so the local lifted basis is no longer closed under transport. The paper’s D1Q3 collision-only example shows that second-order lifting is already exact for that simplified setting.

A 2026 extension addresses the practical assembly bottleneck that emerges precisely in high-order Carleman truncations. For polynomial ODEs \(\dot x=f(x)\), the method uses a shift-and-lift architecture with monomial bases
\[
\mathcal Y=\{x^\beta:1\le |\beta|\le P\},\qquad
\mathcal Z=\{x^\alpha:1\le |\alpha|\le Q\},
\]
constructs a shifted affine polynomial model around a local center \(x_0\), and then forms the truncated lifted affine dynamics
\[
\dot z=A_{ZZ}z+b_Z.
\]
Distinct tuples \((\alpha,i,\beta)\) can produce the same target exponent \(\gamma=\alpha-e_i+\beta\), so the paper introduces symmetry-reduced monomial bases, packed exponent-key indexing
\[
\kappa(\gamma)=\sum_{j=1}^n \gamma_j 2^{(j-1)b},\qquad b=\left\lceil\log_2(2Q+1)\right\rceil,
\]
and sparse triplet coalescing during assembly [2605.05901]. Its exactness proposition states that, for fixed \((P,Q)\) and fixed shift \(x_0\), key-resolved triplet assembly yields the same truncated affine pair \((A_{ZZ},b_Z)\) as term-by-term expansion in exact arithmetic, up to floating-point summation order. The same paper couples shift-and-lift with moving-center expansion, rebuilding \((A_{ZZ},b_Z)\) around the current state, and compares the resulting local high-order linearization with Jacobian linearization through fixed-step error, admissible step size, and cost-at-target-accuracy criteria [2605.05901].

For higher-order linear time-invariant state-space systems
\[
P(\#)\,x(t)=Bu(t),\qquad y(t)=Cx(t)+Du(t),
\]
with regular matrix polynomial
\[
P(\lambda)=\sum_{j=0}^{m}\lambda^j A_j,
\]
another form of high-order linearization is obtained by Fiedler pencils of the Rosenbrock system matrix
\[
S(\lambda)=
\begin{bmatrix}
-P(\lambda) & C\\
B & D
\end{bmatrix}.
\]
The paper constructs system Fiedler pencils \(\mathbb S_\sigma(\lambda)\) that are strictly system equivalent to \(S(\lambda)\), hence preserve transfer function, controllability, observability, and zero structure, including input, output, and input-output decoupling zeros [2106.02915]. Companion forms arise as special cases, and proper generalized Fiedler pencils provide block-tridiagonal and Hermitian structured linearizations. The paper also proves that zero directions of the transfer function can be recovered from eigenvectors of the Fiedler pencils without performing arithmetic operations, in the specific sense that the inverse maps reduce to block extraction in the relevant linearizations [2106.02915].

Taken together, these lifting and pencil-based approaches make clear that high-order linearization is often less about a single approximation formula than about choosing an enlarged coordinate system in which the nonlinear problem becomes linear, sparse, recursive, or structurally equivalent. The principal tradeoffs are equally consistent across the literature: higher retained order improves fidelity, but increases state dimension, preprocessing complexity, closure sensitivity, or the burden of solving auxiliary determining systems.

Source: https://www.emergentmind.com/topics/high-order-linearization