---
title: Equilibrium Propagation in Energy-Based Models
url: https://www.emergentmind.com/topics/equilibrium-propagation
type: topic
---

# Equilibrium Propagation in Energy-Based Models

Equilibrium Propagation (EP) is a learning framework for energy-based models in which inference and learning are both implemented by the relaxation dynamics of the same recurrent system. In its original formulation, the network first settles to a free fixed point that encodes the prediction, then to a nearby nudged fixed point obtained by adding a small supervised perturbation, and the contrast between these two equilibria yields the gradient of a well-defined objective. The framework was introduced as a way to bridge energy-based models and backpropagation while avoiding a separate backward circuit, with error derivatives emerging implicitly from the dynamics of the nudged phase [1602.05179].

## 1. Conceptual foundations

EP starts from a convergent recurrent network whose state is driven toward a stationary point by an internal energy. The defining idea is that supervised learning can be implemented by a *local perturbation* of this equilibrium rather than by an explicit backward pass. In the free phase, the input is clamped and the network relaxes until it produces a prediction. In the nudged phase, the output units are slightly attracted toward the target, or equivalently toward a configuration of lower cost, and this perturbation propagates backward through the hidden units as the network relaxes again. The resulting change in local activities encodes the parameter gradient [1602.05179].

This formulation was proposed partly to resolve a long-standing tension between gradient-based learning and biological plausibility. Standard backpropagation requires distinct computations in the forward and backward phases and typically assumes a dedicated backward circuit. EP instead uses the same leaky-integrator neural computation in both phases. The only local difference between the two phases can be whether synaptic changes are enabled. In the original account, this makes it plausible that a mechanism similar to backpropagation could be implemented by physical or biological substrates that naturally relax to equilibria [1602.05179].

EP also positions itself relative to earlier contrastive algorithms. It shares similarities with Contrastive Hebbian Learning and Contrastive Divergence because it learns from differences between two nearby states, but it differs in that the contrast is tied to the gradient of a well-defined supervised objective. This distinction is central to the method’s theoretical identity.

## 2. Mathematical formulation

Let $s$ denote the network state, typically partitioned into hidden variables $h$ and outputs $y$, with inputs $x$ clamped. Let $\theta$ be the trainable parameters and $\hat y$ the target. EP defines an internal energy $E(s,\theta,x)$ and a supervised cost $C(s,\hat y)$, then combines them into the augmented energy

$$
F(s,\theta,x,\hat y,\beta)=E(s,\theta,x)+\beta\,C(s,\hat y),
$$

where $\beta$ is the nudging strength [1602.05179].

The free phase corresponds to $\beta=0$ and follows

$$
\dot s=-\frac{\partial E}{\partial s}(s,\theta,x).
$$

The nudged phase uses a small $\beta>0$ and follows

$$
\dot s=-\frac{\partial F}{\partial s}(s,\theta,x,\hat y,\beta)
=-\frac{\partial E}{\partial s}(s,\theta,x)-\beta\,\frac{\partial C}{\partial s}(s,\hat y).
$$

The free equilibrium $s^0$ satisfies

$$
\frac{\partial E}{\partial s}(s^0,\theta,x)=0,
$$

and the nudged equilibrium $s^\beta$ satisfies

$$
\frac{\partial F}{\partial s}(s^\beta,\theta,x,\hat y,\beta)=0.
$$

For a Hopfield-style model with symmetric interactions, the original paper uses

$$
E(u)=\frac{1}{2}\sum_i u_i^2-\frac{1}{2}\sum_{i\neq j}W_{ij}\rho(u_i)\rho(u_j)-\sum_i b_i\,\rho(u_i),
$$

with symmetric weights $W_{ij}=W_{ji}$ and supervised quadratic cost

$$
C(y,\hat y)=\frac{1}{2}\|y-\hat y\|^2.
$$

In that setting, the output nudging force is

$$
-\beta\,\frac{\partial C}{\partial y_i}=\beta\,(\hat y_i-y_i),
$$

so the output layer is only weakly attracted toward the target, and the hidden-layer perturbations arise from the recurrent dynamics rather than from an explicitly imposed backward computation [1602.05179].

The training objective is the free-phase cost

$$
J(\theta)=C\big(s^0(\theta),\hat y\big),
$$

and EP computes its gradient through the two nearby equilibria:

$$
\nabla_\theta J(\theta)
=
\lim_{\beta\to 0}
\frac{1}{\beta}
\left(
\frac{\partial F}{\partial \theta}(s^\beta,\theta,\beta)
-
\frac{\partial F}{\partial \theta}(s^0,\theta,0)
\right).
$$

The derivation uses the fixed-point dependence of $s^\beta$ on $\beta$ together with symmetry of cross-derivatives. In the deterministic formulation, exact fixed points and symmetric couplings are the main structural assumptions.

## 3. Local credit assignment and relation to backpropagation

For pairwise energies, EP yields explicitly local synaptic rules. In the symmetric Hopfield form,

$$
\frac{\partial E}{\partial W_{ij}}=-\rho(u_i)\rho(u_j),
\qquad
\frac{\partial E}{\partial b_i}=-\rho(u_i),
$$

so the parameter update becomes

$$
\Delta W_{ij}\propto
\frac{1}{\beta}
\Big(
\rho(u_i^\beta)\rho(u_j^\beta)-\rho(u_i^0)\rho(u_j^0)
\Big),
$$

and similarly

$$
\Delta b_i\propto
\frac{1}{\beta}
\Big(
\rho(u_i^\beta)-\rho(u_i^0)
\Big).
$$

The update is therefore a difference of pre-post products measured at two nearby equilibria, which gives EP its standard characterization as a local contrastive Hebbian rule [1602.05179].

The original derivation also identifies a temporal interpretation related to spike-timing dependent plasticity. Along the nudged trajectory from $s^0$ to $s^\beta$, the tied-weights rule

$$
\frac{dW_{ij}}{dt}\propto
\rho(u_i)\frac{d\rho(u_j)}{dt}
+
\rho(u_j)\frac{d\rho(u_i)}{dt}
=
\frac{d}{dt}\big(\rho(u_i)\rho(u_j)\big)
$$

integrates to the same contrastive update. This is one of the main reasons EP is repeatedly presented as biologically plausible.

Its relation to backpropagation becomes explicit after linearization around the free fixed point. In a recurrent multilayer network,

$$
s^\beta \approx s^0
-\beta
\left(
\frac{\partial^2 F}{\partial s^2}\Big|_{(s^0,\beta=0)}
\right)^{-1}
\frac{\partial C}{\partial s}\Big|_{s^0},
$$

so the small activity changes during the nudged phase correspond to backpropagated error derivatives in the linear regime [1602.05179]. A recurrent interpretation via discrete-time dynamics later made this connection operational: EP’s fixed-point estimator matches the gradient computed by Backpropagation Through Time in the limit of infinitesimal nudging for convergent recurrent networks [2005.04169].

A common misconception is that EP is simply another name for Contrastive Hebbian Learning. The original formulation explicitly distinguishes itself by computing the gradient of a supervised objective defined via local perturbations, rather than contrasting arbitrary free and clamped states. A second misconception is that finite nudging is harmless. In practice, the one-sided estimator has a systematic first-order bias $O(\beta)$, whereas a symmetric three-phase estimator using $+\beta$ and $-\beta$ reduces the bias to $O(\beta^2)$ [2101.05536]. This bias reduction became a decisive step in scaling EP beyond small benchmarks.

## 4. Implementations and architectural adaptations

The standard training loop clamps the input, relaxes the free dynamics to $s^0$, runs a nudged relaxation with small $\beta$ to obtain $s^\beta$, then updates parameters from the contrast between the two states. In digital simulations, the state is often updated by discrete-time Euler descent,

$$
s_i \leftarrow s_i-\epsilon\,\frac{\partial F}{\partial s_i},
$$

sometimes with clipping for bounded activations. The original experiments on permutation-invariant MNIST used recurrent symmetric multilayer networks with 1, 2, and 3 hidden layers of 500 units each, discrete-time leaky integrator dynamics, hard-sigmoid activations, minibatches of size 20, Glorot-Bengio initialization, persistent states to speed inference, and brief nudged phases; training error reached $0.00\%$ for all tested architectures, with test error between $2\%$ and $3\%$ [1602.05179].

A major practical issue is the long relaxation time required by deep recurrent networks. The discrete-time reformulation of EP introduced a primitive function $\Phi$ whose gradient defines the state update, simplifying implementation and extending the method to convolutional neural networks. The same work proposed Continual Equilibrium Propagation, in which weights are adjusted continually in the second phase using only local information in space and time; under slow synaptic changes and small nudging, the per-step neuron and synapse updates follow the gradients of Backpropagation Through Time [2005.04169].

Bias reduction was the next major scaling step. The three-phase symmetric estimator made it possible to train deep ConvNets on CIFAR-10, including architectures with distinct forward and backward connections. With bidirectional weights and a softmax readout trained by cross-entropy, symmetric EP reached $11.68\%$ test error and $4.98\%$ train error on CIFAR-10, close to a Backpropagation Through Time baseline at $11.12\%$ test error and $2.19\%$ train error [2101.05536].

EP has also been extended to sequence classification by combining convergent recurrent networks with modern Hopfield attention. In that construction, the full token sequence is stored as a static memory, preserving EP’s requirement of static input across phases while allowing sequence-aware retrieval. Reported accuracies were $88.9 \pm 0.3$ on IMDB and $81.4 \pm 0.2$ on SNLI [2209.09626].

In spiking settings, EP has been scaled to convolutional convergent recurrent networks by combining predictive coding with spiking communication. A key architectural result is that max pooling and its inverse introduce a mismatch in spiking EP, whereas average pooling with nearest-neighbor upsampling preserves the adjoint-like relationship needed for accurate gradient estimation. On MNIST and FashionMNIST, this yielded test errors of $0.97\%\pm 0.32\%$ and $8.89\%\pm 2.45\%$, respectively, comparable to convergent RNNs and SNNs trained by Backpropagation Through Time [2405.02546].

## 5. Generalizations of the EP principle

Several later developments relax the assumptions of the original fixed-point, infinitesimal-nudge, conservative formulation. One line of work extends EP to holomorphic networks with complex-valued states and parameters. Under holomorphicity and adiabatic time-scale separation, the gradient can be computed exactly for finite-amplitude teaching signals as the first Fourier coefficient of a local observable measured during a continuous oscillation $\beta(t)=|\beta|e^{2 i \pi t/T}$, eliminating the need for separate free and nudged phases [2209.00530].

Another line reframes EP statistically rather than deterministically. In stochastic EP, Langevin dynamics,

$$
ds=-\frac{\partial F}{\partial s}\,dt+\sqrt{2}\,dB(t),
$$

induces a Boltzmann distribution $p^\beta_\theta(s)\propto e^{-F(\theta,\beta,s)}$, and the gradient becomes a contrast between expectations under the nudged and free distributions. A closely related thermal formulation shows that finite temperature permits a covariance estimator in the free phase,

$$
-\frac{d}{d\beta}\,\mathbb{E}[\rho(z_i)\rho(z_j)]\Big|_{\beta=0}
=
\frac{1}{T}\,\mathrm{Cov}_{\beta=0}\!\left(\rho(z_i)\rho(z_j),c(z,d)\right),
$$

so thermal fluctuations allow training without output clamping [2405.08467].

Finite-nudge theory has also been strengthened. A Gibbs–Boltzmann treatment at nonzero temperature proves that the gradient of the difference in Helmholtz free energy between nudged and free phases is exactly the difference in expected local energy derivatives, validating a finite-nudge contrastive update for arbitrary nudging strength and leading to a generalized path-integral EP algorithm based on loss–energy covariances [2511.22024]. This directly addresses the small-$\beta$ limitation of classical EP.

Quantum generalizations replace the classical energy with a Hamiltonian and the free equilibrium with an eigenstate, typically the ground state. In this setting, the mean energy functional plays the role of the minimized quantity, and the gradient is estimated from differences in expectation values of $\partial \hat H/\partial \theta$ between free and nudged eigenstates. This was worked out both in a general quantum and thermal treatment and in an explicit framework for quantum systems such as the transverse-field Ising model and quantum harmonic oscillator networks [2405.08467], [2406.00879].

Perhaps the sharpest departure from the original framework concerns non-conservative systems. Classical EP assumes reciprocity, since the dynamics must derive from an energy. A later extension introduced Asymmetric EP and Dyadic EP for arbitrary differentiable vector fields, including feedforward networks, by modifying the learning-phase dynamics with a term proportional to the antisymmetric part of the Jacobian. In the $\beta\to 0$ limit this recovers the exact gradient while preserving the core EP principle that both inference and learning rely on stationary states [2602.03670].

The same conceptual move has been pushed into trajectory optimization. For Lagrangian systems, EP can be formulated over action-extremizing trajectories rather than static fixed points; with periodic boundary conditions or fixed endpoints, two nudged trajectories suffice to estimate gradients from time integrals of conjugate variables [2505.07363]. For linear damped periodic systems such as RLC networks or damped Newtonian mechanics, an effective action over periodic steady states restores an exact EP-style gradient rule based on free and nudged responses to periodic forcing [2506.20402].

## 6. Empirical record, hardware implications, and limitations

EP’s empirical record is now broader than the original Hopfield-like setting. Beyond the early MNIST results, architectural work on deeper energy-based networks introduced the Hopfield-Resnet family, where residual connections and clipped $\mathrm{ReLU}$ improve the conditioning of the energy landscape and permit substantially deeper models. Hopfield-Resnet13 achieved $93.92\%$ accuracy on CIFAR-10, approximately $3.5\%$ higher than the previous best EP result and comparable to ResNet13 trained using backpropagation at $93.78\%$ [2509.26003]. A different brain-inspired route, the Feedback-regulated REsidual recurrent neural network, uses feedback regulation to reduce the spectral radius and residual connections to alleviate vanishing gradients; on MNIST, a convolutional FRE-RNN trained with EP reached $99.14\%$ test accuracy, compared with $98.98\%$ for the cited P-EP baseline, while substantially reducing the required iteration counts [2508.11659].

Hardware-oriented studies emphasize locality and reduced data movement. In resistive networks trained in situ with EP, measurement uncertainty was modeled as additive post-activation noise at equilibrium readout. Deep multilayer architectures remained trainable up to a critical uncertainty $\sigma_{\mathrm{crit}}\approx 5\times 10^{-5}$ for a $1568$–$1024$–$10$ resistive network, independent of whether the dataset was MNIST, KMNIST, or FashionMNIST. Moderate uncertainty below this limit improved both convergence and performance, with optimal accuracies of $98.18 \pm 0.06\%$ on MNIST, $87.59 \pm 0.15\%$ on KMNIST, and $86.92 \pm 0.16\%$ on FashionMNIST; averaging over $N$ independent samples reduced effective uncertainty as $\sigma_{\mathrm{act}}=\sigma/\sqrt{N}$ [2503.22810].

Oscillator hardware provides another concrete substrate. On oscillator Ising machines, EP is implemented directly in the device dynamics, with local updates expressed in terms of cosine phase observables at free and nudged equilibria. Reported accuracies were $97.2 \pm 0.1\%$ on MNIST and $88.0 \pm 0.1\%$ on Fashion-MNIST, alongside robustness to Gaussian phase noise and to modest quantization, including $10$-bit parameters and $4$-bit phase detection [2510.12934]. Closely related work on phase-only and amplitude–phase oscillator networks showed that EP can train couplings while simultaneously promoting synchronization under realistic frequency dispersion; a synchronized Kuramoto network reached $97.77\%\pm 0.08\%$ test accuracy on MNIST, and an amplitude–phase model reached $96.85\%\pm 0.16\%$ [2504.11884].

Stability of the relaxation itself has become a technical topic. Introducing neuron-specific time steps, or heterogeneous time constants, leaves the fixed points unchanged but improves numerical stability by acting as a diagonal preconditioner. In a single-hidden-layer EP network with $1024$ hidden units trained on MNIST, KMNIST, and Fashion-MNIST, heterogeneous time constants preserved MNIST performance around $98.43$–$98.46\%$ while producing modest gains on KMNIST and Fashion-MNIST relative to a scalar time-step baseline [2603.03402].

The central limitations remain recognizable from the original proposal. Classical EP requires symmetric weights, convergence to fixed points, and sufficiently small perturbations that remain in the same energy basin. On digital hardware, the free phase can be slow, especially as depth increases. Finite $\beta$ introduces estimator bias unless symmetric or more elaborate variants are used. Some architectures, especially deep or asymmetric ones, need auxiliary design choices such as residual links, pooling constraints, feedback regulation, or modified learning dynamics to remain trainable. Later work suggests that these are not merely engineering details: they delimit the extent to which EP retains exact gradient status, local plasticity, and physical realizability across conservative, stochastic, quantum, non-conservative, and dynamical regimes.

Taken together, these developments define EP less as a single algorithm than as a family of learning principles centered on one claim: parameter gradients can be extracted from the response of a dynamical system to weak supervision, using only local contrasts between nearby operating states. In the original energy-based setting this claim is exact in the infinitesimal-nudge limit [1602.05179]; subsequent work has expanded the same principle to finite nudges, noise, oscillations, spiking communication, deep residual architectures, periodic dynamics, non-conservative flows, and quantum systems [2209.00530], [2511.22024], [2602.03670], [2406.00879].

Source: https://www.emergentmind.com/topics/equilibrium-propagation