Neural Modes: Dynamics and Representations

• Neural modes are mathematically distinct patterns of activity and connectivity that characterize dynamic states in both biological and artificial neural networks.
• They are identified using methods like dynamic mode decomposition, graph-theoretic measures, and representation learning to analyze synchrony, stability, and state transitions.
• In deep learning and spiking networks, neural modes simplify complex connectivity into low-dimensional structures that enhance task performance and computational efficiency.

Neural modes are distinct, mathematically and functionally defined patterns of activity, synchronization, connectivity, or transformation in neural and neural-inspired systems. The term encompasses two broad domains: (1) modes characterizing the organization, oscillatory behavior, or operational state of biological neural networks; and (2) modes as low-dimensional structures or transformation regimes within artificial neural networks, machine learning, and computational neuroscience models. Neural modes are identified using dynamical systems analysis, graph-theoretic measures, modal decomposition (e.g., dynamic mode decomposition), or representation learning frameworks, and they provide rigorous scaffolding for describing information processing, functional connectivity, and the transitions between qualitatively distinct computational or dynamical regimes.

1. Dynamical and Graph-Theoretic Modes in Biological Neural Networks

Neural modes in biological systems are often defined as distinct operating regimes of large-scale brain dynamics, manifesting as changes in synchrony, stability, and network topology. Ahn et al. (Ahn et al., 28 Jun 2025) used resting-state EEG to reveal two principal modes in young adults:

• In autistic individuals during eyes-open rest (EO), the neural dynamics are "more random and less stably connected," characterized by higher maximal Lyapunov exponents ($\lambda_\mathrm{max}$: less stable, more chaotic), lower phase-locking index ($\kappa$: weaker synchrony), lower clustering coefficient ($C$) and global efficiency ($E$) (sparser, less efficient network topology), and lower desynchronization ratio (DR; more prolonged lapses from synchrony).
• When eyes are closed (EC), these measures in autistic individuals shift toward values characteristic of neurotypical (TD) subjects: $\lambda_\mathrm{max}$ slightly decreases (stabilization), $\kappa$ increases (stronger synchrony), and both $C$ and $E$ increase (richer, more efficiently connected functional networks).

Functional interpretation: These neural modes are not mere artifacts of spectral EEG features, but robust, quantifiable states that reflect systemic adaptations to sensory input and may underpin cognitive or behavioral differences (Ahn et al., 28 Jun 2025).

2. Oscillatory Modes and Synchrony-Induced Patterns

Synchrony-induced modes—discrete oscillatory eigenmodes of neural activity—are fundamental for both theoretical models and empirical data. In neural field models of spiking neurons (Esnaola-Acebes et al., 2017), transient standing-wave oscillatory modes arise from synchronous spiking and spatially structured synaptic connectivity. Linearization around the asynchronous state yields:

• For each spatial wave number $K$, an eigenmode with decay rate $\alpha$ (set by heterogeneity), and frequency $\kappa$0 (set by the $\kappa$1-th Fourier coefficient of the connectivity kernel).
• Synaptic patterns favoring excitation produce slow, persistent modes; predominance of inhibition accelerates decay.
• At pattern-forming (Turing) bifurcations, symmetry is spontaneously broken, but the discrete set of oscillatory eigenmodes persists even in strongly inhomogeneous “bump” states, allowing the same modal analysis of both spatially uniform and localized cortical activity.

Biological and computational import: These modes arise specifically from the pulse-like synchrony of spiking networks, absent in rate-only neural fields. They enable characterization of pattern formation and working-memory substrates (Esnaola-Acebes et al., 2017).

3. Modal Decomposition in Artificial and Spiking Neural Networks

In machine learning, neural modes provide interpretable scaffolds for network connectivity and neural activity dynamics:

• Mode-based matrix factorization in spiking networks: The Spiking Mode-based Neural Network (SMNN) framework (Lin et al., 2023) factorizes the recurrent weight matrix $\kappa$2 as $\kappa$3, where $\kappa$4 (input modes) and $\kappa$5 (output modes) span low-dimensional subspaces, and $\kappa$6 (score matrix) weights mode importance.
  • Training occurs directly in mode–score space, reducing complexity from $\kappa$7 to $\kappa$8 with $\kappa$9.
  • Neural dynamics (e.g., filtered spike trains) are projected onto the mode space, revealing low-dimensional attractor structures (“neural manifolds”) that capture task-relevant behavior.
  • The spectrum of scores $C$0 often shows sharp knees, indicating a handful of dominant modes that compress task and activity structure (Lin et al., 2023).
• Dynamic mode decomposition (DMD) for spatiotemporal systems: Neural Dynamic Modes (NeuralDMD) (SaraerToosi et al., 3 Jul 2025) merges neural implicit representations with continuous-time DMD. The spatiotemporal field $C$1 is represented as a sum of spatial modes $C$2, each evolving according to $C$3 with spectrum $C$4. These modes reconcile the expressivity of neural networks with the interpretability of DMD, providing low-rank, stable bases for reconstructing and forecasting highly sparse and noisy measurements in geoscience and astronomy.

4. Operational and Firing Modes in Neuronal Dynamics

Neural modes also denote operational or firing state regimes at the single-neuron or network level:

• Firing modes: In extended FitzHugh–Nagumo models subject to electric fields, transitions are observed between tonic spiking, bursting, regular oscillations, and chaos. Mode transitions are governed by parameters such as cell radius, stimulus amplitude/frequency, and electric field strength. Hopf and period-doubling bifurcations provoke qualitative changes in firing patterns, with each mode quantified by interspike interval statistics, Lyapunov exponents, and geometric phase portraits (Nguessap et al., 12 Feb 2025, Castaños et al., 2016).
• Operational modes in neural coding: A single polynomial-drift model for subthreshold voltage identifies two archetypal operational modes—integrator and coincidence detector—distinguished by the sign of the first nonzero nonlinear coefficient ($C$5 for integrator, $C$6 for detector). Integrators sum temporally dispersed inputs (low-pass), while detectors respond selectively to coincident inputs (temporal filter). These operational modes link channel biophysics to information coding strategies and can be perturbed in disease, altering network-level functions (Knowles et al., 1 Oct 2025).

5. Modes in Deep Learning: Representation, Transformation, and Learning Regimes

Modern deep learning theory frames neural modes at several levels:

• Transformation modes (order-preserving/non-order-preserving): Deep networks comprise neurons operating in two fundamental transformation modes: order-preserving (OPM; $C$7) and non-order-preserving (NPM; $C$8 may vanish or change sign). Layer-wise distributions of OPM/NPM neurons constrain collective weight-organization, with OPMs yielding clustered weight-vectors and NPMs enabling isotropic feature extraction (Lin et al., 5 Jan 2025). Learning phases (OPM-dominated, mixed, saturated) progress as networks transition from linear to nonlinear regimes; sample- and weight-space attraction basins measure generalization and structural stability.
• Modes of class fitting in neural representations: Deep ResNets fit classes with two distinct modes: low-density (simpler, lower variance, fewer mixture components) and high-density (complex, multi-modal, higher KL divergence). These emerge only at deeper layers in residual and related architectures, correlating with memorization properties and adversarial robustness; high-density classes are more vulnerable (Jamroż et al., 2022).
• Linear and nonlinear learning modes: Decomposition of network pathways reveals that some hidden-layer neurons specialize in extracting linearly separable features (linear learning mode), while others (via nonlinear saturation and cooperation) handle linearly inseparable features (nonlinear learning mode). Networks self-organize the population of mode-specialized neurons dynamically, and architectural choices (width, depth) modulate the balance between modes and hence learning capability (Feng et al., 2022).

6. Oscillatory Modes in Stochastic Thermodynamics and Biological Data

Modal decompositions grounded in stochastic dynamical systems theory enable quantification of the thermodynamic and informational cost of neural activity. In linear Langevin models fitted to macaque electrocorticography, the housekeeping entropy production rate ($C$9) splits into independent positive contributions from oscillatory modes—each with frequency $E$0 and spectral power $E$1—identified as functional analogs of rhythms (delta/theta/alpha bands) (Sekizawa et al., 2023). Experimental observations show state-dependent reallocation of dissipation: under anesthesia, delta-band contributions dominate, while theta/alpha decrease, quantifying characteristic shifts in the energetic underpinning of consciousness and information flow.

7. Summary Table: Principal Contexts and Definitions of Neural Modes

Context/Model	Definition/Characterization	Key References
Functional brain dynamics	Spatiotemporal network regimes quantifiable by chaos, synchrony, graph metrics	(Ahn et al., 28 Jun 2025)
Neural field oscillations	Discrete eigenmodes from synchrony, topology, and spatial coupling	(Esnaola-Acebes et al., 2017)
Spiking neural net decomposition	Low-rank input/output modes, scores for interpretability and compression	(Lin et al., 2023)
DMD in neural/computational imaging	Spatiotemporal modal decomposition, continuous spectrum learning	(SaraerToosi et al., 3 Jul 2025)
Firing/operational modes (single cell)	Integration vs. coincidence detection, spiking vs. bursting regimes	(Knowles et al., 1 Oct 2025, Nguessap et al., 12 Feb 2025, Castaños et al., 2016)
Deep net learning/representation	OPM/NPM, linear vs. nonlinear learning, class density modes	(Lin et al., 5 Jan 2025, Feng et al., 2022, Jamroż et al., 2022)
Thermodynamic modal decomposition	Frequency-specific energetic contributions to neural activity	(Sekizawa et al., 2023)

Neural modes thus provide a unifying framework, rooted in mathematically rigorous measures and empirically verifiable phenomena, for dissecting and understanding the diverse operational, functional, and representational regimes in biological and artificial neural systems. These modes underpin transitions in dynamical stability, information processing, and computational structure across all scales of neural organization.