---
title: Invariant Smoother (IS)
url: https://www.emergentmind.com/topics/invariant-smoother-is
type: topic
---

# Invariant Smoother (IS)

Searching arXiv for recent papers on invariant smoothing, Lie-group smoothing, and related invariant RTS/fixed-lag methods.
Invariant Smoother (IS) denotes a class of smoothing methods for estimation problems on matrix Lie groups in which the trajectory is optimized using invariant error coordinates and group-compatible retractions. In the recent literature, the term covers batch Gauss–Newton smoothing with left-invariant perturbations [2204.05256], bias-aware inertial localization on the Two Frames Group (TFG) [2309.13903], right-invariant fixed-lag smoothing for visual–inertial SLAM [2102.08596], and Rauch–Tung–Striebel-type forward–backward smoothing on matrix Lie groups [2403.00075]. Across these variants, the defining objective is not merely to optimize on a manifold, but to exploit Lie-group structure so that process or measurement linearizations become state-estimate independent, or at least less state-dependent, under appropriate group-affine and invariant-measurement assumptions. Earlier invariant-estimation work on \(SE(2)\) with perfect odometry and noisy position measurements already exhibited the central geometric phenomenon—exact preservation of the kinematic manifold induced by deterministic motion—even though that work is a recursive IEKF analysis rather than a batch MAP smoother [1803.02076].

## 1. Definition and terminological boundaries

Invariant smoothing belongs to the estimation-and-control meaning of “smoother”: it is concerned with trajectory estimation from all observations, or from a sliding window of observations, when the state naturally evolves on a Lie group and when the error representation is chosen to respect the underlying symmetry. In this sense, IS is best understood as the smoothing analogue of invariant filtering.

The term should not be conflated with other uses of “smoother.” In numerical linear algebra, a “parameter-dependent smoother” is a multigrid component for parameter-dependent linear systems, with damped Richardson, damped Jacobi, and low-rank exponential-sum approximations as the relevant constructions; that literature is not about invariant estimation on Lie groups [2008.00927]. Nor is IS the same as the linear continuous-time fixed-interval smoother theory in which the “true type” of a smoother is analyzed through a variational formulation and Euler–Lagrange equations; that work studies polynomial steady-state tracking and shows that an optimal smoother behaves, in that sense, like a filter of double the type [0802.0130].

Within invariant estimation itself, an important precursor is the \(SE(2)\) navigation problem with deterministic odometry and noisy position measurements. There the left-invariant error
\[
\begin{pmatrix}
\hat\theta_t-\theta_t\\
R(\theta_t)^T(\hat x_t-x_t)
\end{pmatrix}
\]
and body-frame innovation preserve the exact manifold
\[
R(\hat\theta_t)^T\hat x_t=b_t,
\]
where the standard EKF does not [1803.02076]. This result is historically important because it isolates the structural benefit that later invariant smoothers seek to preserve in batch and fixed-lag settings.

## 2. Lie-group MAP formulation

A representative IS formulation places the trajectory on a matrix Lie group \(G\), with states \((\chi_i)_{i=0}^n\), and writes
\[
\chi_0 \sim \mathcal{N}_L(\bar{\chi}, \mathbf P_0), \qquad \chi_{i+1}=f_i(\chi_i)\exp(w_i), \qquad y_k = h_k(\chi_{I_k}) + n_k.
\]
The trajectory estimate is then the MAP solution
\[
(\chi_i)_i^* = \arg\max_{(\chi_i)_i} \mathbb P\!\left((\chi_i)_i \mid y_0,\dots,y_n\right).
\]
Invariant smoothing linearizes this problem through a left perturbation
\[
\chi_i=\hat{\chi}_i\exp(\xi_i),
\]
so that the update is multiplicative on the group rather than additive in Euclidean coordinates [2309.13903].

The resulting linearized objective has the sparse least-squares form
\[
\tilde{\mathcal C} =
\|\mathbf p_0+\xi_0\|_{\widetilde{\mathbf P}_0}^2
+\sum_i \|\hat u_i-\mathbf F_i\xi_i+\xi_{i+1}\|_{\mathbf Q_i}^2
+\sum_k \|\hat n_k+\mathbf H_k \Xi\|_{\mathbf N_k}^2,
\]
with
\[
\mathbf p_0 = \log(\bar{\chi}_0^{-1}\hat{\chi}_0), \qquad
\hat u_i = \log\!\big(f_i(\hat{\chi}_i)^{-1}\hat{\chi}_{i+1}\big), \qquad
\hat n_k = y_k - h_k(\hat{\chi}_{I_k}),
\]
and \(\Xi\) the concatenation of all increments. The transformed prior covariance is
\[
\widetilde{\mathbf P}_0 = \mathbf J_0^{-1}\mathbf P_0 \mathbf J_0^{-T},
\]
where \(\mathbf J_0\) is the Jacobian associated with the Lie-group retraction [2309.13903].

The defining structural assumption is group-affine dynamics. In the discrete-time formulation,
\[
f_i(\chi_i)=\Upsilon_i \,\Phi(\chi_i)\,\Omega_i,
\]
with \(\Upsilon_i,\Omega_i\in G\) and \(\Phi\) an automorphism. This yields the log-linear property
\[
f_i(\chi_i\exp(\xi)) = \chi_{i+1}\exp(\mathbf F_i \xi), \qquad
\mathbf F_i = \mathbf{Ad}_{\Omega_i^{-1}}\mathbf M.
\]
Because perturbations propagate linearly in the Lie algebra, the process residual
\[
r_i^{\text{proc}} = \log\bigl(f_i(\chi_i)^{-1}\chi_{i+1}\bigr)
\]
linearizes as
\[
r_i^{\text{proc}} \approx \hat a_i - \mathbf F_i \xi_i + \xi_{i+1},
\]
and the state update after solving the linear subproblem is
\[
\hat{\chi}_i \leftarrow \hat{\chi}_i \exp(\xi_i^*) .
\]
This is the essential batch IS mechanism [2204.05256].

## 3. Structural properties of invariant error coordinates

The central claim of IS is structural rather than merely numerical. In the low-process-noise limit, the process model ceases to be a soft penalty and becomes an equality constraint. In the deterministic setting
\[
\chi_{i+1}=f_i(\chi_i),
\]
the zero-noise theorem for invariant smoothing states that, if initialized accordingly, every iteration satisfies
\[
\hat{\chi}_{i+1}=f_i(\hat{\chi}_i),
\]
and, when the prior support is a Lie-subalgebra-supported subspace \(V_0\), all iterations remain in the reachable subspace generated by that support [2204.05256].

The algebraic reason is that the invariant Gauss–Newton increment obeys
\[
\xi_{i+1}^* = \mathbf F_i \xi_i^*,
\]
hence
\[
\hat{\chi}_{i+1}\exp(\xi_{i+1}^*) = f_i(\hat{\chi}_i\exp(\xi_i^*)).
\]
The update therefore preserves the exact deterministic relation instead of merely making its linearized residual small. This is the distinctive zero-noise property of IS.

A second structural advantage concerns Jacobian dependence. In the invariant RTS framework, if the continuous-time process model
\[
\dot X(t)=F\big(X(t),u(t)\big)+X(t)W(t)
\]
is group affine in the sense that
\[
F(X_1X_2,u)=X_1F(X_2,u)+F(X_1,u)X_2-X_1F(I,u)X_2,
\]
and if the measurement model is matched to the chosen left- or right-invariant error, then the linearized error propagation is state independent [2403.00075]. In practice, this means that the process and measurement Jacobians can become state-estimate independent under the ideal assumptions, or less state-dependent when the assumptions are only approximately satisfied.

A third structural theme is observability consistency in fixed-lag smoothing. For right-invariant fixed-lag smoothing on \(SE_2(3)\), the unobservable directions correspond to \(3\) DOF global translation and \(1\) DOF global rotation about gravity. Under the right-invariant error, the nullspace block for each navigation state is
\[
\mathbf{N}_{\pi_i} =
\begin{bmatrix}
\mathbf{g} & \mathbf{0}\\
\mathbf{0} & \mathbf{0}\\
\mathbf{0} & \mathbf{I}_3
\end{bmatrix},
\]
which does not depend on the linearization point. By contrast, in a conventional formulation the corresponding block
\[
\mathbf{N}_{\pi_i} =
\begin{bmatrix}
\mathbf{g} & \mathbf{0}\\
-(\bar{\mathbf{v}}_i)_\times\mathbf{g} & \mathbf{0}\\
-(\bar{\mathbf{p}}_i)_\times\mathbf{g} & \mathbf{I}_3
\end{bmatrix}
\]
depends on the current estimate, and marginalization then injects spurious information into the gauge directions. The right-invariant formulation eliminates this mechanism and thereby resolves the consistency issue without FEJ-style Jacobian freezing [2102.08596].

## 4. Principal algorithmic realizations

The batch Gauss–Newton form of IS is the most direct realization. It iterates over a current trajectory estimate, introduces tangent increments through
\[
\chi_i=\hat{\chi}_i\exp(\xi_i),
\]
solves the sparse linearized problem in the stacked variables \(\Xi\), and retracts back to the group with
\[
\hat{\chi}_i \leftarrow \hat{\chi}_i \exp(\xi_i^*).
\]
Its novelty lies in the invariant retraction and in the process Jacobian \(\mathbf F_i\) induced by group-affine dynamics, not in an exotic solver architecture.

The invariant Rauch–Tung–Striebel smoother (IRTS) is the forward–backward counterpart. It performs a forward invariant EKF pass followed by a backward RTS pass on the Lie algebra. For left-invariant filtering,
\[
z_{f,k}^{\mathrm L} = \check X_{f,k}^{-1}(y_k-\check y_k), \qquad
\hat X_{f,k} = \check X_{f,k}\exp\!\left(-\big(K_{f,k}z_{f,k}^{\mathrm L}\big)^\wedge\right),
\]
while the backward left-invariant smoothing innovation is
\[
z_{s,k}^{\mathrm L} = \log\!\left(\hat X_{s,k+1}^{-1}\check X_{f,k+1}\right)^\vee,
\]
with state update
\[
\hat X_{s,k} = \hat X_{f,k}\exp\!\left(-\big(K_{s,k}z_{s,k}^{\mathrm L}\big)^\wedge\right).
\]
The right-invariant version uses the corresponding right-invariant innovations and left multiplication on the update. Covariance recursion retains the classical RTS form, while the state correction becomes Lie-group consistent [2403.00075].

The right-invariant fixed-lag smoother (RI-FLS) embeds the navigation state in \(SE_2(3)\) and keeps the standard fixed-lag nonlinear least-squares and marginalization pipeline. The innovation is geometric rather than additive: the IMU residual is
\[
\mathbf{r}_x(\mathbf{x}_i,\mathbf{x}_{i|i-1})=\boldsymbol{\eta}(\mathbf{x}_i,\mathbf{x}_{i|i-1}),
\]
with navigation error defined through
\[
X_i = \exp\!\big(\mathcal{L}(\boldsymbol{\xi}_{\pi,i})\big)\,\bar X_i,
\qquad
\boldsymbol{\xi}_{\pi,i} = \mathcal{L}^{-1}\!\left(\log(X_i \bar X_i^{-1})\right).
\]
The solver itself remains an ordinary fixed-lag factor-graph solver; the invariant content resides in the residual and Jacobian definitions [2102.08596].

## 5. Inertial localization and bias-inclusive group design

Inertial navigation is the principal application domain in the present literature because the state naturally combines rotational and translational quantities and because high-grade IMUs create precisely the low-process-noise regime in which conventional smoothers become delicate. For unbiased inertial navigation, the state
\[
(R,v,x)
\]
is embedded in
\[
SE_2(3) :=
\left\{
T=
\begin{bmatrix}
R & v & x\\
0_{3\times 2} & I_2
\end{bmatrix}
\in \mathbb R^{5\times 5}
\ \middle|\
R\in SO(3),\ v\in\mathbb R^3,\ x\in\mathbb R^3
\right\},
\]
and the dynamics admit the group-affine decomposition
\[
\Upsilon_i=
\begin{bmatrix}
\mathbf{Id} & dt\, g & 0\\
0_{3\times2} & I_2
\end{bmatrix}, \qquad
\Phi(T)=
\begin{bmatrix}
R & v & x+dt\,v\\
0_{3\times2} & I_2
\end{bmatrix},
\]
\[
\Omega_i=
\begin{bmatrix}
\exp_{SO(3)}(dt\,\omega_i) & dt\,a_i & 0\\
0_{3\times2} & I_2
\end{bmatrix}.
\]
This is why \(SE_2(3)\) is described as the appropriate embedding for low-noise inertial alignment [2204.05256].

Biases complicate the picture because they are body-frame variables. The TFG-based extension therefore replaces the older \(SE_2(3)\times \mathbb R^3 \times \mathbb R^3\) treatment with a group law in which the accelerometer and gyroscope biases transform as body-frame quantities. For \(\chi=(R,v,p,b^a,b^\omega)\), the TFG composition is
\[
\begin{pmatrix} \chi^{\mathrm{acc}}_1 & b^\omega_1 \end{pmatrix}
\begin{pmatrix} \chi^{\mathrm{acc}}_2 & b^\omega_2 \end{pmatrix}
=
\begin{pmatrix}
\chi^{\mathrm{acc}}_1 \chi^{\mathrm{acc}}_2,\;
b^\omega_2 + R_2^\top b^\omega_1
\end{pmatrix},
\]
where \(\chi^{\mathrm{acc}}=(R,v,p,b^a)\), and the accelerometer-bias part obeys the analogous TFG law [2309.13903].

The corresponding exponential map is
\[
\exp_{TFG}
\begin{pmatrix}
\xi^R\\
\xi^v\\
\xi^p\\
\xi^{b^a}\\
\xi^{b^\omega}
\end{pmatrix}
=
\begin{pmatrix}
\exp(\xi^R)\\
\nu(\xi^R)\,\xi^v\\
\nu(\xi^R)\,\xi^p\\
\nu(-\xi^R)\,\xi^{b^a}\\
\nu(-\xi^R)\,\xi^{b^\omega}
\end{pmatrix},
\]
with logarithm
\[
\log_{TFG}
\begin{pmatrix}
R\\
v\\
p\\
b^a\\
b^\omega
\end{pmatrix}
=
\begin{pmatrix}
\xi^R\\
\nu(\xi^R)^{-1} v\\
\nu(\xi^R)^{-1} p\\
\nu(-\xi^R)^{-1} b^a\\
\nu(-\xi^R)^{-1} b^\omega
\end{pmatrix},
\qquad
\xi^R=\log(R).
\]
Under this retraction, an orientation increment rotates the biases, so orientation and bias are no longer artificially decoupled.

The full discrete inertial model is
\[
\left\{
\begin{aligned}
R_{i+1} & = R_i \exp_m\!\big[\Delta t (\omega_i - b_i^\omega)_\times\big] \\
v_{i+1} & = v_i + \Delta t \big(g + R_i(a_i - b_i^a)\big) \\
p_{i+1} & = p_i + \Delta t\, v_i \\
b^a_{i+1} & = b_i^a \\
b^\omega_{i+1} & = b_i^\omega .
\end{aligned}
\right.
\]
The paper proves that the IMU equations in \(3D\) with accelerometer bias are group affine in the TFG sense whenever \(\omega_i=0\), but not in general for the full \(3D\) model with gyro bias, because the state appears inside
\[
\exp_m\!\big[\Delta t (\omega_i - b_i^\omega)_\times\big].
\]
Thus the TFG-based formulation is not a claim of exact group-affinity in all cases; it is a more principled group design for the bias-inclusive state [2309.13903].

## 6. Empirical behavior, comparisons, and limitations

The experimental record of IS is strongest in regimes with low process noise, poor initialization, or gauge-related consistency issues. In simulated in-motion alignment with IMU at \(200\) Hz, GPS at \(1\) Hz, initial yaw error \(80^\circ\), and one Gauss–Newton iteration per update, the low-noise IS study reports that, for window size \(10\), Forster et al. becomes inconsistent, IS and GTSAM converge to similar final solutions, but IS converges faster and is more consistent, while GTSAM exceeds the \(3\sigma\) bound between \(20\) and \(30\) seconds; for window size \(50\), Forster et al. converges to the same estimates as IS and GTSAM [2204.05256].

For TFG-based inertial localization on KITTI raw data with IMU at \(100\) Hz, position measurements at \(1\) Hz, and \(50\) Monte Carlo runs, the main reported metric is the ratio of consistent trajectories. With window size \(5\), the reported ratios for sequences \(01,05,06,07,08,09,10\) are: TFG \(0.98,0.94,0.96,0.96,0.98,0.84,0.96\); imperfect \(SE_2(3)\)-based IS \(0.78,0.70,0.68,0.94,0.84,0.68,0.88\); and GTSAM \(0.86,0.70,0.66,0.96,0.86,0.70,0.88\). For larger windows the differences shrink, but the TFG method remains competitive and often best or tied [2309.13903].

For right-invariant fixed-lag smoothing in visual–inertial SLAM, the clearest evidence is covariance consistency. In the torus simulation, the reference NEES values are \(3\) for position, \(3\) for orientation, and \(6\) for pose. The reported averages over the last \(10\) seconds are: Incremental FLS \(644.3, 5.0, 657.3\); Batch FLS \(693.6, 102.3, 800.3\); iSAM2 \(5.4, 4.1, 9.3\); and RI-FLS \(3.3, 3.4, 6.6\). On EuRoC, the same paper reports comparable real-data accuracy rather than uniformly superior odometry, which is consistent with its central claim that the main gain is consistency, not necessarily lower ATE on every sequence [2102.08596].

For IRTS, the reported pattern is robustness under poor initialization. On the Starry Night dataset, IRTS and MRTS are comparable when initialization error is low, but IRTS substantially outperforms MRTS when initialization error is high. The same study further reports that one iteration of either smoother strongly outperforms one iteration of either Gauss–Newton method, and that even after \(5\) Gauss–Newton iterations variability remains large [2403.00075].

The limitations are equally structural. Exact state-estimate independence requires a group-affine process model together with matching left- or right-invariant measurements; when those technical conditions fail, the gain is reduced estimate dependence rather than perfect invariance [2403.00075]. The low-noise batch IS analysis assumes that the singular linearized system can already be solved correctly and explicitly delegates the ill-conditioned inversion problem to prior work [2204.05256]. The TFG formulation does not make the full \(3D\) biased IMU model group affine in general [2309.13903]. The RI-FLS consistency proof uses the approximation
\[
\mathbf{A}_i \approx \mathbf{I}_{15}, \qquad \mathbf{A}_{i|i-1}\approx -\mathbf{I}_{15},
\]
and the same paper reports that exact Jacobians slightly worsen NEES [2102.08596].

Taken together, these works define IS as a geometrically structured approach to smoothing in which invariant error coordinates are used to preserve equality constraints in the zero-noise limit, maintain gauge-consistent nullspaces under marginalization, or reduce the estimate dependence of forward–backward linearizations. The unifying principle is that the Lie-group embedding and the choice of invariant error are not auxiliary implementation details; they are the source of the method’s distinctive theoretical and empirical behavior.

Source: https://www.emergentmind.com/topics/invariant-smoother-is