Papers
Topics
Authors
Recent
Search
2000 character limit reached

LENS: Latent Embeddings for Nonequilibrium Systems

Updated 8 July 2026
  • LENS is a model-free method for identifying low-dimensional latent variables that capture the irreversible, entropy-producing dynamics in high-dimensional nonequilibrium systems.
  • It employs a forward-versus-time-reversed classifier with a quadratic logit structure, optimizing latent embeddings to preserve time-reversal asymmetry rather than reconstruction fidelity.
  • Empirical validations on linear, periodic, and spatiotemporal benchmarks show that LENS effectively uncovers latent circulating flows and accurately estimates entropy production.

Searching arXiv for papers on “Latent Embeddings of Nonequilibrium Systems” and closely related nonequilibrium latent-representation work. Latent Embeddings of Nonequilibrium Systems (LENS) is a model-free representation-learning method for discovering low-dimensional latent variables that specifically encode the irreversible, entropy-producing degrees of freedom of a high-dimensional stochastic dynamical system in a nonequilibrium steady state (NESS). Its defining construction is a forward-versus-time-reversed trajectory classifier whose logit is constrained to a quadratic form in learned state representations, so that the embedding is optimized not for reconstruction fidelity or variance preservation, but for preserving time-reversal asymmetry and the irreversible flow structure relevant to entropy production (Ji et al., 11 Aug 2025).

1. Definition, scope, and scientific objective

LENS targets high-dimensional stochastic systems observed through time series data and assumed to be in a steady state but not necessarily equilibrium. In that setting, the stationary distribution may be time-independent while detailed balance is broken, so there are circulating probability currents in state space and these currents generate entropy. The central problem addressed by LENS is therefore not generic compression, but identification of latent nonequilibrium degrees of freedom: given observations xt\mathbf{x}_t, learn a low-dimensional embedding ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M such that the induced latent dynamics retain the irreversible flows most relevant to entropy production (Ji et al., 11 Aug 2025).

This objective distinguishes LENS from standard dimensionality reduction. The method is explicitly motivated by the observation that reconstruction-oriented criteria need not align with physical relevance: a feature can be highly variable yet thermodynamically irrelevant, while another can contribute strongly to time-reversal asymmetry despite being subtle in reconstruction space. LENS therefore asks what low-dimensional coordinates best preserve the system’s irreversible flow structure. In the authors’ formulation, the appropriate latent space is the one that best supports discrimination between forward and reversed dynamics and thus best preserves entropy-producing currents (Ji et al., 11 Aug 2025).

A closely related implication is that LENS should be read as a coarse-graining framework for nonequilibrium steady states rather than as a generic latent-variable model. Its learned coordinates are intended to identify which degrees of freedom carry irreversibility, not merely to produce a compact state code.

2. Thermodynamic basis: irreversibility, time reversal, and entropy production

The thermodynamic foundation of LENS is the mismatch between probabilities of forward and time-reversed transitions. For adjacent states x\mathbf{x} and x\mathbf{x}', the entropy production rate is defined as the Kullback–Leibler divergence between forward and reverse transition statistics,

S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].

The key local object is therefore

S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],

which is antisymmetric under time reversal and averages to the entropy production rate (Ji et al., 11 Aug 2025).

LENS exploits the fact that a binary classifier trained on adjacent state pairs labeled as forward or reverse has a Bayes-optimal posterior

C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},

and therefore an optimal logit

S(x,x)=log ⁣[p(xx)p(xx)].S^*(\mathbf{x},\mathbf{x}') = \log\!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].

Thus forward-versus-reverse classification is not a heuristic proxy: at optimum it estimates the local entropy production increment. Averaging the learned logit over forward samples gives an entropy-production estimate (Ji et al., 11 Aug 2025).

The process class considered in the formal development is stationary Markovian dynamics. In the continuous stochastic setting, the underlying dynamics are written as

dx=f(x,t)dt+FdWt,d\mathbf{x} = f(\mathbf{x},t)\,dt + \mathbf{F}\,d\mathbf{W}_t,

with diffusion tensor

D=12FF.\mathbf{D} = \frac{1}{2}\mathbf{F}\mathbf{F}^\intercal.

In steady state, the probability current is

ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M0

and the local velocity field is

ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M1

For short-time increments ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M2, the target logit has the expansion

ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M3

which makes explicit that the forward/reverse log ratio depends on the local irreversible flow field ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M4 rather than on variance-dominant directions (Ji et al., 11 Aug 2025).

3. LENS formulation: latent embedding, quadratic logit, and optimization

LENS defines a classifier

ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M5

trained with the binary cross-entropy objective

ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M6

With sufficient expressivity and data, the optimal logit satisfies

ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M7

and the entropy production rate is estimated by

ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M8

This establishes LENS simultaneously as a latent-variable method and as a neural entropy-production estimator (Ji et al., 11 Aug 2025).

Its distinctive architectural feature is the structured parameterization of the logit in a learned representation ϕθ(xt)RM\boldsymbol{\phi}_\theta(\mathbf{x}_t)\in\mathbb{R}^M9: x\mathbf{x}0 Here x\mathbf{x}1 is constrained to be skew-symmetric and x\mathbf{x}2 is constrained to be symmetric. The skew-symmetric term captures irreversible circulation between two states, while the difference-of-potentials term supplies the most general antisymmetric quadratic correction consistent with the short-time expansion and the linear-theory form (Ji et al., 11 Aug 2025).

The paper further constrains x\mathbf{x}3 to have a block-diagonal form with x\mathbf{x}4 skew-symmetric blocks. Each block corresponds to a two-dimensional latent subspace carrying a rotational or circulatory irreversible flow. This gives the latent space a specific interpretive structure: each pair of latent coordinates can encode a local rotational current. The representation is not unique; the paper notes invariance up to permutations of x\mathbf{x}5 subspaces, rotations within each subspace, and additional ambiguity if eigenvalues are degenerate (Ji et al., 11 Aug 2025).

The workflow is simple. One collects a trajectory x\mathbf{x}6, forms forward pairs x\mathbf{x}7 and reverse pairs x\mathbf{x}8, encodes each state separately with x\mathbf{x}9, computes the quadratic logit, trains the classifier by binary cross-entropy, and then uses the learned score to estimate local and global entropy production. Latent trajectories and averaged flow fields in x\mathbf{x}'0-space can then be visualized, with cyclic currents interpreted as low-dimensional irreversible flows (Ji et al., 11 Aug 2025).

4. Linear theory, universality, and physical interpretation

A major strength of LENS is that its architecture is not only heuristic. For linear stochastic dynamics

x\mathbf{x}'1

with steady-state covariance x\mathbf{x}'2 satisfying

x\mathbf{x}'3

the steady-state velocity field is

x\mathbf{x}'4

Defining

x\mathbf{x}'5

the exact target logit is

x\mathbf{x}'6

where

x\mathbf{x}'7

This is exactly the rationale for the LENS quadratic architecture (Ji et al., 11 Aug 2025).

In the linear case, LENS with linear representations x\mathbf{x}'8 learns a low-rank approximation to the thermodynamic force matrix. The paper writes the induced rank-x\mathbf{x}'9 approximation as

S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].0

and shows that maximizing the LENS objective is equivalent to minimizing a reduced objective over S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].1. The stationary points satisfy

S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].2

The ensemble entropy production rate is

S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].3

The paper further states that the entropy-production approximation improves monotonically with latent dimension S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].4 and reaches zero error when S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].5 (Ji et al., 11 Aug 2025).

The supplement also gives a universality result: any antisymmetric short-time irreversibility function on a compact domain can be approximated arbitrarily well by a LENS-style logit,

S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].6

The proof uses Stone–Weierstrass approximation with monomial feature bases, and a corollary shows that the skew-symmetric part can be brought into canonical block-diagonal S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].7 form without loss of approximation power (Ji et al., 11 Aug 2025).

These results justify the central interpretation of LENS: the learned coordinates are not intended to reconstruct the observation space but to organize the system into coordinates where irreversible probability currents are most visible. In the linear setting this interpretation is exact; more generally it is the design principle of the method.

5. Empirical validation and domains of application

The paper evaluates LENS on three main classes of systems. The first is a linear benchmark: a coupled bead-spring system with thermal gradients, with dynamics

S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].8

For S˙=DKL[p(xx)p(xx)]=Ep(xx)log ⁣[p(xx)p(xx)].\dot{S} = D_{\mathrm{KL}}\big[p(\mathbf{x}\rightarrow \mathbf{x}') \,\|\, p(\mathbf{x}'\rightarrow \mathbf{x})\big] = \mathbb{E}_{p(\mathbf{x}\rightarrow \mathbf{x}')} \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].9 beads, using S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],0 observations and S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],1, LENS estimates the entropy production rate within about S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],2 error across S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],3 orders of magnitude, for both linear and nonlinear encoders. For S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],4 beads under four temperature profiles—linear, Fourier, sine, and alternating—the entropy-production error decreases monotonically with latent dimension S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],5. For S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],6, LENS captures about S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],7 of the total entropy production and reveals a clear circulating latent flow. A notable structural result is that for S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],8, LENS estimates zero entropy production, because the irreversibility-carrying skew-symmetric term requires at least a two-dimensional subspace. Supplementary experiments at S(x,x)=log ⁣[p(xx)p(xx)],S(\mathbf{x},\mathbf{x}') = \log \!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right],9 show that lower-dimensional representations still capture a significant fraction of entropy production, while full dimension recovers essentially the full value. The method also remains effective when the bead positions are rendered into blurred one-dimensional image-like observations, indicating robustness to partial observation (Ji et al., 11 Aug 2025).

The second benchmark is a nonlinear driven particle in a periodic potential,

C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},0

Using a sine activation to reflect periodicity, LENS with C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},1 captures the entropy production rate well, with reported error within about C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},2 across drive strengths. The paper notes that without the sine activation, optimization is unstable and linear encoders fail to learn the periodic irreversibility reliably. This is an important methodological constraint: LENS is model-free in the sense of not requiring a mechanistic reduced model, but architecture still matters (Ji et al., 11 Aug 2025).

The third system is the two-dimensional Complex Ginzburg–Landau equation,

C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},3

with C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},4. Here the authors emphasize an important caveat: because the dynamics are deterministic, strict forward/reverse density overlap vanishes and the true entropy-production estimate diverges logarithmically. LENS is therefore not interpreted as a calibrated stochastic entropy-production estimator in this setting. Instead it serves as an irreversibility-sensitive representation learner. Using CNN encoders on C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},5 phase-field images, LENS detects the transition from frozen or stable spiral states to defect turbulence. Low-dimensional embeddings with C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},6 show cyclic latent flows in both regimes, but the local entropy-production maps differ strongly across the transition; larger C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},7 improves performance in the chaotic regime (Ji et al., 11 Aug 2025).

Across these experiments, the common empirical message is that LENS identifies low-dimensional circulating irreversible flows better than PCA, works on partially observed image-like data, and scales to high-dimensional complex spatiotemporal patterns. The paper’s own summary is that LENS accurately estimates entropy production in analytically tractable linear and nonlinear systems while also exposing the directions that carry irreversibility (Ji et al., 11 Aug 2025).

Several adjacent lines of work clarify what LENS is and what it is not. Physics-informed graph neural networks for variational nonequilibrium optimal control learn structured internal representations of local many-body environments and use them to approximate controlled dynamics associated with rare fluctuations, but they are control-force ansätze rather than explicit latent-space models (Yan et al., 2022). Autoencoder-based unsupervised phase identification in sheared binary colloids constructs a low-dimensional latent representation of driven steady states from species-resolved Fourier amplitudes and uses a Gaussian mixture model for probabilistic phase identification, which is closer to latent manifold learning than to thermodynamic irreversibility learning (Miyahara et al., 7 Jul 2026). A variational autoencoder trained on tunnel-coupled one-dimensional Bose-gas interference data learns a minimal latent representation from equilibrium snapshots and then uses that coordinate as an out-of-distribution probe for nonequilibrium defects and post-quench anomalies, again emphasizing latent interpretability but not forward/reverse irreversibility as the training signal (Møller et al., 17 Sep 2025). By contrast, classifier-based analysis of many-body localization snapshots shows that raw projective measurements contain enough information for neural networks to diagnose thermalization behavior, yet the learned organization remains implicit and is not exposed as a latent embedding (Bohrdt et al., 2020). A different but conceptually allied direction is a latent-variable generative model whose hidden-state Markov chain reaches a nonequilibrium steady state with persistent probability currents and finite entropy production, so that directed cycles emerge inside the latent space itself (Baiesi et al., 12 Dec 2025).

The acronym is also genuinely ambiguous. In molecular simulation, “LENS” has been used to denote “Local Environments and Neighbors Shuffling,” a handcrafted descriptor that measures local neighbor-identity reshuffling over time. That method is relevant to dynamical heterogeneity, but it is not a latent embedding in the machine-learning sense and does not share the forward/reverse classifier construction of Latent Embeddings of Nonequilibrium Systems (Crippa et al., 2022).

The limitations of LENS are explicit. It is built for systems in a nonequilibrium steady state; if the process is not stationary, forward/reverse discrimination can capture transient drift rather than steady irreversibility. The formulation uses adjacent states and therefore assumes a Markovian short-lag description; hidden variables, coarse sampling, or non-Markovian observations may degrade performance. The theory relies on short-time expansions, so if the sampling interval is too large the quadratic short-time approximation may become less faithful. The empirical studies also use substantial data—C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},8 samples for bead and periodic-potential systems and C(x,x)=p(xx)p(xx)+p(xx),C^*(\mathbf{x},\mathbf{x}') = \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}\rightarrow \mathbf{x}') + p(\mathbf{x}'\rightarrow \mathbf{x})},9 images for Complex Ginzburg–Landau—so sample efficiency remains a practical concern. Low-dimensional embeddings can underfit intrinsically complex irreversible dynamics, as indicated by spurious negative patches in low-S(x,x)=log ⁣[p(xx)p(xx)].S^*(\mathbf{x},\mathbf{x}') = \log\!\left[ \frac{p(\mathbf{x}\rightarrow \mathbf{x}')}{p(\mathbf{x}'\rightarrow \mathbf{x})} \right].0 local entropy-production maps for the chaotic Ginzburg–Landau regime. Finally, the latent space is identifiable only up to rotations and permutations within irreversibility-carrying subspaces (Ji et al., 11 Aug 2025).

These comparisons suggest a broader taxonomy. Some nonequilibrium representation-learning methods organize rare-event structure through learned control forces (Yan et al., 2021), some through tractable learned distributions over tilted ensembles (Tang et al., 2022), some through phase-discriminative latent manifolds (Miyahara et al., 7 Jul 2026), and some through generative minimal coordinates for many-body snapshots (Møller et al., 17 Sep 2025). LENS is distinguished within this landscape by making time-reversal asymmetry itself the representation objective. Its latent coordinates are optimized not for reconstruction, not for equilibrium phase separation, and not for control alone, but for preserving the irreversible currents responsible for entropy production in nonequilibrium steady states (Ji et al., 11 Aug 2025).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Latent Embeddings of Nonequilibrium Systems (LENS).