---
title: Substrate-Independent Invariants of Cognition
url: https://www.emergentmind.com/topics/substrate-independent-invariant-of-cognition
type: topic
---

# Substrate-Independent Invariants of Cognition

A substrate-independent invariant of cognition is a formal, information-theoretic or structural property of an agent–environment system that remains constant, or transforms in precisely defined ways, when cognition is instantiated in different material substrates—whether neural, biochemical, mechanical, or computational. These invariants provide a rigorous framework for comparing, engineering, and analyzing cognition in biological organisms, artificial agents, hybrid human–machine collectives, and basal living systems at every scale.

## 1. Formal Definitions and General Criteria

A substrate-independent invariant of cognition is defined as a relational property I of system trajectories, preserved under isomorphisms between organizational structures and dynamical laws of differing physical substrates. Let $S$ and $S'$ be two systems with configuration spaces $C,\,C'$, dynamical transitions $T,\,T'$, and $\varphi: (C, T) \rightarrow (C', T')$ an isomorphism. The invariant $I$ is a function of trajectory probability distributions such that
$$
I[P(C_0 \rightarrow \ldots \rightarrow C_T)] = I[P'( \varphi(C_0) \rightarrow \ldots \rightarrow \varphi(C_T))]
$$
where $P$ and $P'$ denote the distributions over histories in $S$ and $S'$ respectively [2412.00751].

These invariants arise in frameworks that treat cognition as emerging from the information-processing and dynamical organization of the system rather than its specific biophysical realization.

## 2. Taxonomy of Substrate-Independent Invariants

### A. Information-Theoretic Invariants

- **Mutual information** $I(X; Y)$ between subsystems captures integration and coordination:
  $$
  I(X;Y) = \sum_{x,y} p(x,y) \log \frac{p(x,y)}{p(x)p(y)}
  $$
- **Entropy and multi-information**, e.g., system-level $H(X)$ and total correlation
- **Integrated information** $\Phi$ (as in IIT), quantifying irreducibility of whole-system informational states [2412.00751]
- **Algorithmic complexity and probability**, e.g., Kolmogorov complexity $K_U(s)$ and Solomonoff–Levin algorithmic probability $m_U(s)$, which are invariant up to constants across universal Turing machines [1501.04242]

### B. Dynamical and Topological Invariants

- **Memory-amortized cycles**: Persistent homology classes $[\gamma] \in H_1(M)$ in the topological manifold of memory cycles, capturing the structural reuse and cycle-consistency underlying cognitive inference [2508.14143, 2512.10976]
- **Attractor landscapes and multistability**: Formal existence of multiple attractor states (fixed points or cycles) in the system’s dynamical evolution, independent of specific substrate [1712.00414]
- **Lattice or morphospace of contexts and behavioral patterns**, representing emergent complexity as the context structure rather than as a single scalar [1805.00787]
- **Causal topology**: The abstract directed-graph structure of dependencies among system components, as formalized in causal topography [1206.0259]

### C. Computational and Automata-Theoretic Invariants

- **Stack-nesting and automata hierarchy**: The tuple $(S,k)$, where $S$ is the number of independent stacks and $k$ is stack nesting depth, anchors cognitive computational power in the Chomsky hierarchy, invariant across physical realizations [2008.05580]
- **Morphological computation** metrics, e.g. the MC ratio:
  $$
  MC = \frac{I(M_{t+1}; E_t)}{I(A_{t+1}; E_t)}
  $$
  compares passive body computation and explicit control, invariant under isomorphic morpho-dynamics [2412.00751]

### D. Embedding and Navigation Invariants

- **Remapping and navigation in embedding spaces**: Cognition as the iterative error-minimizing traversal (via gradient or associative retrieval) in embedding or latent state spaces, formalized as:
  $$
  z_{t+1} = z_t - \eta\,\nabla_z L(z_t)
  $$
  where $L$ is an error or energy functional, and the remapping $R_\theta: X \to Z$ absorbs new information [2601.14096]

### E. Unified Capacity Metrics

- **Cognitive capacity (\( \mathcal{C} \)) as geometric mean**: Defined via mutual information-based sensing ($S$), processing ($P$), and action ($A$) sub-capacities,
  $$
  \mathcal{C} = (S P A)^{1/3}
  $$
  with $S, P, A$ measured from empirical trajectories, independent of substrate [2601.12837].

## 3. Core Examples Across Biological and Artificial Substrates

| System                       | Invariant                               | Reference                |
|------------------------------|-----------------------------------------|--------------------------|
| Bacterial colonies           | $I(C_i; C_j)$ for gene-expression       | [2412.00751]             |
| Neural circuits/robotics     | MC ratio, $F$-minimization, $\Phi$      | [2412.00751], [2512.10976]|
| Slime mold (Physarum)        | Multistability, memory kernels, $I(X; Y)$| [1712.00414]            |
| Deep neural nets (LaMa)      | Spatial integration, error structure    | [2308.07039]             |
| Human language/recursion     | Stack-nesting tuple $(S, k)$            | [2008.05580]             |
| Memory-amortized cortex      | Homology classes $H_1(M)$               | [2508.14143], [2512.10976]|
| AI transformer/diffusion     | Embedding remap/error-minimization      | [2601.14096]            |

These examples exemplify invariance for the cognitive phenotype across disparate substrates—e.g., spatial pattern interpolation in both human frontal cortex and convolutional nets; multistability and feedback-driven adaptation in both Physarum and swarms; or stable attractor cycles in both cortical circuitry and motor controller robots.

## 4. Mathematical Structures Underpinning Invariants

### 4.1 Info-Computational Formulations

- **Morphological computation**: $M_{t+1} = F(M_t, E_t)$ for morpho-dynamical state
- **Substrate-independence axiom**: If $(M,F) \cong (M',F')$ via isomorphism $\varphi$, then cognitive trajectories are informationally equivalent [2412.00751]
- **Algorithmic explanations**: The structure of cognitive input–output can be completely described by $K_U(s)$ and $m_U(s)$ up to additive or multiplicative constants [1501.04242]

### 4.2 Dynamical-Systems and Topological Invariants

- **Chain complexes/homology**: Cognitive state-space described as a simplicial complex $X$, with homological invariants $b_k = \text{rank}\,H_k(X)$ classifying recurrent structures [2512.10976]
- **Pattern-formation and attractor criteria**: Symmetry-breaking instabilities and the existence of attractor basins are formalized using the Jacobian $J$ and diffusion matrix $D$, e.g., $\det(J - k^2 D) < 0$ for some $k$ [1712.00414]

### 4.3 Behavioral and Information-Processing Metrics

- **Geometric means over sensory, processing, action channels**: $\mathcal{C}$ as a function of mutual information flows [2601.12837]
- **Difficulty and error-structure invariants**: Item-difficulty curves $p(i)$ and confusion matrices in cognitive task performance, invariant under substrate substitution [2308.07039]

## 5. Maintenance and Generation of Invariants: Self-Organization and Autopoiesis

Cognitive invariants are dynamically maintained by processes of:

- **Self-assembly**, ensuring local rules yield globally coherent informational structures
- **Self-organization**, guiding the $p(C)$ distributions toward high mutual information or low free energy regimes
- **Autopoiesis**, guaranteeing boundary conditions and energetic fluxes preserve the invariant computational structure over time (e.g., $C_{t+1} = G(C_t)$ implies $I(C_t; C_{t+k}) = \text{constant}$ for large $k$) [2412.00751]
- **Amortization** over cycles: Memory-amortized inference frameworks (MAI) highlight how topological cycles in memory serve as reusable invariants for rapid, context-specific inference while minimizing computational and energetic cost [2508.14143, 2512.10976]

## 6. Implications for Cognitive Architectures and Comparative Analysis

- Architectural design principles for AGI and bio-inspired AI follow directly from these invariants, prescribing:
  - **Isomorphic informational topology**: Hardware instantiating the same connectivity and cycle structure as neural substrates
  - **Morphological offloading**: Physical bodies exploiting passive dynamics to minimize central control burden
  - **Adaptive self-organization**: Continuous adjustment to maintain free-energy minima, mutual information structure, and recurrent cycle integrity
- The **cognition space formalism** unifies system complexity across domains, positing every agent in the $(\mathcal{O}, \mathcal{I})$ plane—organizational and informational complexity—with $\mathcal{C}$ serving as a global invariant metric. This accommodates transitions from basal (aneural) through neural to hybrid (human–AI) forms [2601.12837].
- **Automata-theoretic invariants** reveal sharp anatomical and behavioral thresholds in cognitive substrate power, e.g., the jump to indexed-grammar (nested-stack) capacities in humans [2008.05580].

## 7. Controversies and Limitations

Harnad distinguishes between simulation (matching causal topology) and true implementation (requiring matching of the dynamical substrate), asserting only the abstract causal graph is a substrate-independent invariant, and questioning whether full cognition (and feeling) is purely organizational or needs substrate-dependent dynamics [1206.0259]. This underlines a critical open debate on whether functionally-defined invariants suffice, or whether phenomenality is essentially bound to specific dynamics.

## 8. Synthesis

Substrate-independent invariants of cognition are mathematically and empirically robust quantities—mutual information, homology classes, algorithmic complexity, error-structure, stack memory topology, cycle-consistency in memory, or attractor landscape features—preserved across system implementations. They ground unified architectures for comparative cognition, provide substrates for rigorous engineering of novel intelligent systems, and reveal the fundamental organizing principles active in biological, artificial, and hybrid agents. Their identification clarifies the boundaries of cognitive capacity, enables cross-domain transfer of design principles, and sharpens the distinction between genuine cognitive implementation and mere symbolic or computational mirroring.

**Key references**: [2412.00751], [1501.04242], [2508.14143], [2512.10976], [1712.00414], [2308.07039], [2008.05580], [2601.14096], [2601.12837], [1206.0259]

Source: https://www.emergentmind.com/topics/substrate-independent-invariant-of-cognition