Closed-form latent dynamics for nonlinear encoding with linear embedding
Determine whether there exist nonlinear encoding maps φ: R^{N_rec} → R^K and linear embedding parameters (A ∈ R^{N_rec×N_rec}, M ∈ R^{N_rec×K}) such that, for κ(t) = φ(r(t)) and A · ṙ(t) = −r(t) + M κ(t), the induced latent variables κ(t) obey a closed-form, self-contained dynamical system r-independent of the neural state variables (i.e., κ̇(t) = g(κ(t), u(t)) for some g) and characterize the necessary and sufficient conditions for such constructions.
Sponsor
References
Currently, we do not know whether there are encoding and embedding functions that can produce closed-form solutions for κ(t).
— Latent computing by biological neural networks: A dynamical systems framework
(2502.14337 - Dinc et al., 20 Feb 2025) in Methods, A theory of the latent processing units, subsection “Nonlinear encoding and linear embedding”