---
title: Natural Filter Equivariants (NFEs)
url: https://www.emergentmind.com/topics/natural-filter-equivariants-nfes
type: topic
---

# Natural Filter Equivariants (NFEs)

Natural Filter Equivariants (NFEs) are a unifying conceptual framework that formalizes symmetry-preserving operators across multiple mathematical and applied domains, including nonlinear observer design, list-function extrapolation, and equivariant convolutional networks. In all settings, “natural filter equivariance” characterizes operators that commute with canonical “filter” perturbation actions—removal, restriction, or transformation—under specified group or predicate symmetries. This concept plays a crucial role in system robustness, generalization, and structure-preserving computation.

## 1. Core Definitions and Formal Frameworks

NFEs are rigorously defined relative to the symmetries of an underlying structure—be it a manifold, a list, or a data grid—by demanding equivariance with respect to both group actions and filter-like operations.

- On **lists** ([2507.08796]), the type \([a]\) denotes all finite lists over a set \(a\), equipped with:
  - **Map operations**: \(\map(\psi):[a]\to[b]\), \(\map(\psi)[x_1, \ldots, x_n] = [\psi(x_1), \ldots, \psi(x_n)]\), indexing action by \(\psi: a \to b\).
  - **Filter operations**: \(\filter(\phi):[a]\to[a]\), \(\filter(\phi)[x_1, \ldots, x_n] = [x_i \mid \phi(x_i) = \mathit{true}]\), where \(\phi: a \to \text{Bool}\).

A function \(f: [a] \to [a]\) is **filter-equivariant** if \(f \circ \filter(\phi) = \filter(\phi) \circ f\) for all predicates \(\phi\). It is a **natural filter-equivariant (NFE)** if, in addition, \(f \circ \map(\psi) = \map(\psi) \circ f\) for all \(\psi\).

- For **nonlinear systems** ([2108.09387], [2004.00828]), consider a control-affine system \((M, f, h)\) with Lie group symmetry \(G\):
  - System: \(\dot\xi = f(\xi, u)\), \(y = h(\xi)\), \(\xi \in M\), \(u \in U\), \(y \in N\).
  - \(G\) acts transitively on \(M\) (\(\phi: G \times M \to M\)), and on inputs (\(\psi: G \times U \to U\)). \(f\) is equivariant: \(D\phi_X(f(\xi, u)) = f(\phi_X(\xi), \psi_X(u))\).

An NFE is then an observer whose state evolves on \(G\), with dynamics, innovation, and update all commuting with group actions—in effect, a “natural” lift of filtering to a symmetry-respecting context.

## 2. Structural Properties and Algebraic Relationships

NFEs exhibit distinct algebraic closures and intersection properties:

- The classes of map-equivariant (\(\mathsf{ME}\)), filter-equivariant (\(\mathsf{FE}\)), and natural filter-equivariant (\(\mathsf{NFE}\)) functions satisfy:
  \[
  \mathsf{NFE} = \mathsf{ME} \cap \mathsf{FE},\quad \mathsf{FE} \not\subseteq \mathsf{ME},\quad \mathsf{ME} \not\subseteq \mathsf{FE}.
  \]
  Concrete examples include:
  - \(\text{id}\) (identity) and \(\text{reverse}\) are in \(\mathsf{NFE}\).
  - Sorting (with fixed ordering) is in \(\mathsf{FE} \setminus \mathsf{NFE}\).
  - The “triangle” function is in \(\mathsf{ME} \setminus \mathsf{FE}\).
  - Expanding (inflate) and reverse are canonical NFEs.

- In **nonlinear systems observer theory**, the NFE formalism corresponds to a class of symmetry-respecting observers (Equivariant Filters or EqF) with:
  - Error, innovation, and update performed equivariantly in the Lie group.
  - The error variable defined globally and intrinsically on the state manifold, avoiding coordinate patches.

## 3. Geometric and Categorical Interpretation

NFEs arise naturally in the language of category theory and geometric structures.

### For list functions ([2507.08796]):

- The assignment \(a \mapsto [a]\) is a list functor \(\mathsf{List}: \mathsf{Set} \to \mathsf{Set}\), with map- and filter-induced natural transformations.
- NFEs are characterized as doubly-natural endomorphisms: they commute with both map and filter-induced transformations, i.e., are “symmetric” with respect to all canonical list symmetries.
- There is a simplicial and multisimplicial geometric account: \(k\)-NFEs correspond to cones over a semi-simplicial diagram of symmetric group actions, yielding a classification by compatible families of list permutations or multisets.

### For nonlinear geometric systems ([2108.09387]):

- The observer state is lifted to the symmetry group, and equivariant error is defined as \(e = \phi_{\hat X^{-1}}(\xi)\), a globally well-defined quantity on \(M\).
- This construction embeds the system in a natural principal bundle and leverages the geometry of group actions.

## 4. Methodological Realizations

NFEs have explicit constructive realizations in multiple technical domains:

### Observer/Filter Design on Manifolds and Lie Groups

- An NFE observes trajectories using a lifted internal model:
  - Equivariant lift \(\Lambda: M \times U \to \mathfrak{g}\) satisfying pre-image and equivariance conditions.
  - Filter equations are implemented in the group:
    \[
    \dot{\hat X} = \hat X \Lambda(\phi_{\bar\xi}(\hat X), u) - \Delta_t \hat X
    \]
  - Covariance dynamics are Riccati equations with explicit curvature corrections accounting for manifold geometry.

### Filter-Equivariant Functions and List Amalgamation

- Any NFE on lists can be reconstructed from its action on all one-element-filtered sublists via the **amalgamation algorithm** ([2507.08796]). This operation inductively builds the output from consistent filtered restrictions:
  ```python
  function AmalFE(f, xs):
      X ← distinctElements(xs)
      for each x in X:
          L[x] ← f( filter ((≠ x), xs) )
      ys ← emptyList
      while there is some x with L[x] nonempty:
          compute score[x] = number of lists L[y] whose head=L[y][0]=x
          choose x0 ∈ X that maximizes score[x]
          append x0 to ys
          for each y in X:
              if L[y] nonempty and head(L[y])=x0:
                  L[y] ← tail(L[y])
      return reverse(ys)
  ```
- The class of all FEs and NFEs forms a monoid under concatenation and composition.

### Equivariant Filter Parameterization for Convolution

- NFEs are instantiated as “atomic basis” expansions for rotation-equivariant filters ([2107.14519]):
  - Any discrete, unrotated filter is exactly represented as a sum of atomic steerable bases \(\varphi^c_{k,l}(x)\), \(\varphi^s_{k,l}(x)\), maintaining equivariance in the continuous domain.
  - Fence-effect (aliasing) is mitigated by folding high frequencies down to within the Nyquist limit on the discrete grid.
  - Discretization yields \(O(h^2p^2)\) equivariance error, which vanishes for fine meshes.

## 5. Robustness, Performance, and Theoretical Guarantees

NFEs confer multiple structural benefits across domains:

- **Global, intrinsic error coordinates**: In nonlinear filtering, the error is defined on the manifold globally, removing the need for local charts and preventing EKF singularities ([2108.09387]).
- **Constant linearization point**: Linearization occurs solely at a fixed origin, significantly reducing linearization error compared to conventional EKF schemes.
- **Curvature correction**: The observer Riccati dynamics include a curvature term that tracks parallel-transport of the covariance, improving consistency, especially during transients.
- **Local (and in special cases global) convergence guarantees**: Under mild observability hypotheses, NFEs yield observers with provable stability ([2108.09387], [2004.00828]).
- **Generalization via amalgamation**: For filter-equivariant sequence-to-sequence models, NFEs allow exact reconstruction on larger inputs once the function is known for small bags, implying strong extrapolation generalization ([2507.08796]).

Experimental evidence demonstrates that, in applications such as image super-resolution, the Fourier-series NFE basis achieves state-of-the-art results, maintaining equivariance and fidelity even without data augmentation ([2107.14519]).

## 6. Connections, Extensions, and Open Problems

NFEs serve as a touchstone for symmetry-preserving design in broad contexts:

- **Generalization to other combinatorial structures**: NFEs defined for lists potentially extend to tree- or graph-structured data, suggesting directions for "tree-filter" or graph-filter equivariant networks ([2507.08796]).
- **Higher-order filter symmetries**: The existence of “\(k\)-filter” operators imposing reconstructibility from larger substructures remains an open problem.
- **Machine learning architectures**: Implementing explicit filter-equivariant constraints as inductive biases in sequence or graph neural networks is a promising but unsolved area.
- **Comparative filter-parametrizations**: The “natural” filter basis, as characterized by NFE theory, outperforms limited or aliasing-prone alternatives (e.g., harmonic/PDO expansions, standard DFT) for low-level image processing tasks ([2107.14519]).

## 7. Illustrative Examples

| Domain          | Canonical NFE Example                  | Reference      |
|-----------------|----------------------------------------|----------------|
| Nonlinear observer | EqF on \(S^2\): Direction estimation | [2108.09387]   |
| List functions  | Reverse, Inflate\(_k\)                 | [2507.08796]   |
| CNN filter design | Fourier-series atomic basis for F-Conv | [2107.14519]   |

In summary, Natural Filter Equivariants rigorously formalize the notion of symmetry-respecting transformation under both filter-like and map-like actions. They yield robust, generalizing, and expressively complete operators in observer design, algebraic function classes, and deep learning architectures, and their study illuminates the deep connections between categorical algebra, geometry, and learning theory.

Source: https://www.emergentmind.com/topics/natural-filter-equivariants-nfes