---
title: Free Energy-Entropy Duality
url: https://www.emergentmind.com/topics/free-energy-entropy-duality
type: topic
---

# Free Energy-Entropy Duality

Searching arXiv for the cited papers to ground the article in current arXiv records.
arXiv search query: 1102.2098
Free energy–entropy duality denotes a family of exact correspondences, variational identities, and dissipation laws that relate entropy-like quantities to free energy, or free-energy excess to entropy deficits, across equilibrium statistical mechanics, information theory, stochastic thermodynamics, and quantum resource theories. The phrase is not used uniformly in the literature. In the canonical Gibbs setting, the baseline relation is \(F=U-TS\), with ordinary entropy obtained from the temperature derivative of \(-F\). Baez showed that Rényi entropy is obtained by replacing this derivative with a finite temperature difference quotient, so that entropy of order \(q\) is the secant slope of \(-F\) under the rescaling \(T=T_0/q\) [1102.2098]. Other formulations identify excess free energy with relative entropy to equilibrium [1311.3533, 1702.08473], interpret entropy and free energy as convex-conjugate potentials linked by the Fenchel–Young equality [2312.03454], extend the relation to quantum channels [2510.12790], or assign a thermodynamic meaning even to reverse relative entropy by passing to a dual ensemble in which the roles of energy and probability are exchanged [2602.15392].

## 1. Canonical thermodynamic backbone

In the canonical ensemble, the relevant state is the Gibbs distribution or Gibbs density matrix. For a quantum Hamiltonian \(H\), the equilibrium state at temperature \(T\) is
\[
\rho_T=\frac{1}{Z(T)}e^{-H/kT},
\qquad
Z(T)=\operatorname{tr}\!\left(e^{-H/kT}\right),
\]
and the Helmholtz free energy is
\[
F(T)=-kT\ln Z(T).
\]
In the classical finite-state formulation, one likewise has
\[
F_{E,T}(p)=\langle E\rangle_p-k_BT\,H(p),
\]
with \(H(p)\) the Shannon entropy in nats. In both settings, equilibrium is the free-energy minimizer, and the standard entropy–free-energy relation is recovered as
\[
S_1(T_0)=-\left.\frac{dF}{dT}\right|_{T=T_0}.
\]
This derivative identity is the ordinary Shannon/von Neumann case of the broader duality family [1102.2098, 1311.3533].

A recurrent structural point in the literature is that free energy can be read in two equivalent ways. First, it is an energetic balance, \(F=U-TS\). Second, once the reference equilibrium state is fixed, the excess free energy above equilibrium becomes an information-theoretic distance. This shifts the emphasis from absolute thermodynamic potentials to nonequilibrium deviation from the Gibbs state. A plausible implication is that much of the modern literature uses “free energy–entropy duality” to name this second viewpoint rather than the textbook identity alone [1311.3533, 1702.08473].

## 2. Rényi entropy as a free-energy secant slope

A particularly sharp equilibrium formulation is given by the Rényi family. For a probability distribution \(p=(p_i)\),
\[
S_q(p)=\frac{1}{1-q}\ln \sum_i p_i^q,
\qquad 0<q<\infty,\; q\neq 1,
\]
and for a density matrix \(\rho\),
\[
S_q(\rho)=\frac{k}{1-q}\ln \operatorname{tr}(\rho^q).
\]
As \(q\to 1\), these reduce to Shannon and von Neumann entropy. Baez proves that if the system starts in thermal equilibrium at temperature \(T_0\), and \(q=T_0/T\), then
\[
S_q(T_0)= -\frac{F(T)-F(T_0)}{T-T_0},
\qquad T=\frac{T_0}{q}.
\]
This is an exact identity, not a heuristic analogy: Rényi entropy of the initial equilibrium state is the finite-difference quotient of \(-F\) between two temperatures [1102.2098].

The same result can be rewritten in \(q\)-calculus form. If the \(q\)-derivative is
\[
\left(\frac{df}{dx}\right)_q=\frac{f(qx)-f(x)}{qx-x},
\]
then
\[
S_q=-\left(\frac{dF}{dT}\right)_{q^{-1}}.
\]
Ordinary entropy is recovered in the limit \(q\to 1\), when the secant slope becomes the tangent slope. Baez emphasizes this geometrically: ordinary entropy is the slope of the tangent line, whereas Rényi entropy is the slope of the secant line [1102.2098].

The physical interpretation is equally explicit. If the bath temperature is suddenly divided by \(q\), so that \(T=T_0/q\), then during re-equilibration the maximum extractable work is
\[
W_{\max}=F(T_0)-F(T),
\]
and therefore
\[
\frac{W_{\max}}{T_0-T}=S_q(T_0).
\]
Thus Rényi entropy measures extractable work per temperature change in a quench protocol. The paper stresses that this applies to both classical and quantum systems and does not require modifying statistical mechanics itself; the deformation is in the entropy–free-energy relation, not in the Gibbs formalism [1102.2098].

## 3. Relative entropy, excess free energy, and informational distinguishability

A second major formulation identifies excess free energy with relative entropy to equilibrium. For a classical finite-state system with Gibbs distribution \(\pi\),
\[
F_{E,T}(p)-F_{E,T}(\pi)=k_B T\,D(p\|\pi),
\]
where
\[
D(p\|q)=\sum_i p_i\log\frac{p_i}{q_i}.
\]
This is the precise form of the Szilard–Landauer correspondence: information relative to equilibrium is available free energy, up to the factor \(k_BT\) [1311.3533].

The quantum analogue is
\[
\Delta F_\beta(\rho,H):=F_\beta(\rho,H)-F_\beta(\omega_{\beta,H},H)
=\beta^{-1}D(\rho\|\omega_{\beta,H}),
\]
with
\[
D(\rho\|\sigma)=\operatorname{Tr}\!\big[\rho(\log\rho-\log\sigma)\big].
\]
In the axiomatic resource-theoretic formulation, this identity is decisive because once quantum relative entropy is singled out by continuity, data processing, additivity, and super-additivity, the free-energy difference is likewise singled out as the unique continuous extensive monotone of athermality under the corresponding Gibbs-preserving catalytic operations [1702.08473].

The literature has also pushed the asymmetry of relative entropy further. The familiar interpretation applies to \(D(p\|p^{\mathrm{eq}})\), but not directly to the reverse divergence. The 2026 dual-ensemble construction shows that
\[
D(A\|B)=\beta(F_A-F_B)
\]
for a nonequilibrium ensemble \(A\) and its equilibrium reference \(B\), while
\[
D(B\|A)=D(D\|C)=\beta(F_D-F_C)
\]
after constructing a dual pair \(C,D\) in which the original probabilities define an effective energy spectrum and the original equilibrium probabilities are retained. The reverse divergence is therefore not excess free energy of the original ensemble, but of a thermodynamically dual one [2602.15392].

Before the table below, one caution is essential: these identities all involve a Gibbs reference or a dual Gibbsized construction. They are not generic statements about arbitrary pairs of distributions.

| Setting | Entropy-like quantity | Free-energy relation |
|---|---|---|
| Canonical nonequilibrium state | \(D(p\|\pi)\) or \(D(\rho\|\omega_{\beta,H})\) | \(F-F^{\mathrm{eq}}=k_BT\,D(p\|\pi)\) or \(\beta^{-1}D(\rho\|\omega_{\beta,H})\) |
| Rényi equilibrium state | \(S_q\) | \(S_q(T_0)=-(F(T)-F(T_0))/(T-T_0)\) |
| Dual ensemble construction | \(D(B\|A)\) | \(D(B\|A)=\beta(F_D-F_C)\) |
| Quantum channels | \(S^\beta[N]\) | \(S^\beta[N]+\beta F^\beta[N]=\ln Z_A^\beta\) |

Taken together, these results suggest that “duality” often means complementarity between a reference-relative entropy and a free-energy excess, with equilibrium acting as the zero of both descriptions [1311.3533, 1702.08473, 2510.12790, 2602.15392].

## 4. Convex-analytic and variational formulations

Another line of work treats free energy–entropy duality as a theorem of convex analysis. In that framework, one starts with a convex function \(\phi\) and its Legendre–Fenchel conjugate
\[
\psi(y)=\sup_x\{xy-\phi(x)\}.
\]
The pair obeys the Fenchel–Young inequality
\[
\eta(x,y)=\phi(x)+\psi(y)-xy\ge 0,
\]
with equality when \(y=\phi'(x)\) and \(x=\psi'(y)\). The thermodynamic interpretation given in “On Thermodynamic Information” is that \(\phi\) is entropy-like, \(\psi\) is free-energy-like, the bilinear term is energy-like, and \(\eta\) is entropy production; equilibrium is precisely the Fenchel–Young equality on a “thermo-doubled” state space [2312.03454].

The same paper makes the maximum-entropy/minimum-free-energy equivalence explicit. Fixing the dual variable and maximizing \(xy-\phi(x)\) is the entropy-side problem; fixing the primal variable and minimizing \(xy-\psi(y)\) is the free-energy-side problem. In the large-deviation example,
\[
\Phi(\nu\|p)=\sum_{i=1}^K \nu_i\log\frac{\nu_i}{p_i},
\qquad
\Psi(u)=\log\sum_{i=1}^K p_i e^{u_i},
\]
so relative entropy and log-partition function appear as a convex-conjugate pair [2312.03454].

A related but distinct formulation appears in “Duality Symmetry, Two Entropy Functions, and an Eigenvalue Problem in Gibbs' Theory”. There the Massieu free entropy \(\Phi_{V,N}(\beta)=k_B\log Z\) is Legendre–Fenchel dual to \(\varphi_{V,N}(u)=-S(u)\), and the paper argues that Gibbs entropy and Shannon/Sanov entropy correspond to different laws of large numbers: arithmetic sample means in one case, empirical counting frequencies in the other. This yields a second free-energy-like object
\[
\Xi(\{u_i\})=-\log\sum_i p_i e^{-u_i},
\]
with \(u_i\) interpreted as energy parameters conjugate to empirical frequencies [2108.08948].

Approximate local versions also exist. In Bethe–Kikuchi theory, generalized belief propagation converges to critical points of local approximations of the free energy \(F(\beta)\), the Shannon entropy \(S(\mathcal U)\), and the variational free energy \(\mathcal F(\beta)=\mathcal U-\beta^{-1}S(\mathcal U)\). The paper stresses that this local Legendre duality can be degenerate on loopy hypergraphs, so the \(U\)-\(\beta\) relation may become many-valued rather than one-to-one [2207.00841].

## 5. Dynamical dissipation, entropy production, and de Bruijn-type identities

In nonequilibrium dynamics, the duality frequently appears not as a static conjugacy but as a dissipation law. For Tsallis-type stochastic thermodynamics of Markov processes, one has a generalized entropy \(S^{(q)}\) and generalized free energy \(F^{(q)}\) linked by
\[
\frac{dF^{(q)}}{dt}=-f_d^{(q)}\le 0,
\qquad
\frac{dS^{(q)}}{dt}-Q_{ex}^{(q)}=f_d^{(q)}.
\]
The same irreversible quantity \(f_d^{(q)}\) is therefore both the free-energy dissipation rate and the entropy-balance remainder after subtraction of generalized excess heat [1005.1251].

For exactly solvable Brownian motors and overdamped Brownian particles, the literature develops analogous current-based balances. In multi-bath systems, the isothermal identity \(\dot F=-T\dot e_p\) is replaced by generalized rate equations such as
\[
\dot F+\dot E_p=-fV
\]
or
\[
\dot F=-\dot W-\dot E_p,
\]
together with
\[
\frac{dS}{dt}=\dot e_p-\dot h_d.
\]
These formulas make the same structural point: entropy production measures irreversibility, and free-energy decay is its energetic counterpart once heat flow or mechanical work is accounted for. The papers are careful that, in nonisothermal settings, no single global temperature need exist, so the relevant objects are temperature-weighted entropy rates and generalized free-energy dissipation rates rather than a naive Helmholtz functional [1507.01791, 1606.08346].

A stronger infinite-volume result is the de Bruijn-type identity for reversible continuum birth-and-death dynamics. There the specific relative entropy with respect to a Gibbs measure,
\[
\mathrm{SpecEnt}(\mu|\nu),
\]
acts as the nonequilibrium free energy, and the paper proves
\[
\mathrm{SpecEnt}(\mu|\nu)-\mathrm{SpecEnt}(\mu T_t|\nu)
=
\int_0^t \mathcal J(\mu T_s|\nu)\,ds
=
\int_0^t \xi^\mu(s)\,ds.
\]
Here \(\mathcal J\) is the specific Fisher information and \(\xi^\mu(s)\) is a local entropy-production density written as a symmetrized relative entropy between a birth-weighted law and a reduced Palm law. In this setting, free-energy loss, Fisher information, and entropy production become exactly equivalent descriptions of reversible relaxation toward Gibbs equilibrium [2602.13474].

## 6. Process-level, generalized, and domain-specific extensions

The channel-level theory of quantum processes defines free energy itself as distinguishability from thermalization. With the absolutely thermal channel \(\mathcal T^\beta\), channel free energy is
\[
F^\beta[\mathcal N]=\beta^{-1}D[\mathcal N\|\mathcal T^\beta].
\]
The paper derives several channel analogues of free energy–entropy duality. One is the exact complementarity identity
\[
S^\beta[N]+\beta F^\beta[N]=\ln Z_A^\beta.
\]
Another is the Helmholtz-type bound
\[
F_c^\beta[N]\le E[N]-\beta^{-1}S[N],
\]
which becomes equality for replacer channels. Operationally, channel free energy equals maximal extractable work from partial thermalization,
\[
F^\beta[N]=W^{\rm ext}_{N\to \mathcal T^\beta},
\]
and one-shot distillation and formation rates are governed by hypothesis-testing and max-relative entropy. A common misconception is corrected explicitly in that work: the channel setting does not support a universal exact identity \(F=U-TS\) for all processes; the exact equality survives only for state-preparation channels, while the general statement is an inequality plus complementary entropy identities [2510.12790].

Rényi-generalized quantum thermodynamics preserves the formal shape of the Helmholtz relation. With
\[
F_\alpha=U_\alpha-TS_\alpha,
\]
the nonequilibrium free energy can be written as equilibrium free energy plus a correction involving traditional or sandwiched Rényi relative entropy, together with \(\Delta\)-terms that vanish as \(\alpha\to 1\). The claim there is “form invariance”: the thermodynamic laws retain their structure when entropy, internal energy, and relative entropy are all deformed consistently [1505.06980].

The same general vocabulary also appears outside standard thermodynamics. In benchmarked risk-sensitive portfolio control, free energy–entropy duality rewrites the exponential criterion
\[
J_T(H,\theta)=-\frac{1}{\theta}\ln \mathbf E[e^{-\theta(R_T-R_0)}]
\]
as a stochastic differential game under an equivalent measure with entropic regularization, producing explicit affine saddle-point controls and a quadratic value function. This suggests that, in that domain, “free energy” is the log-moment-generating functional and “entropy” is the relative-entropy penalty for adverse measure distortion [2604.15463, 2606.20903].

A final caution comes from concrete materials modeling. In skyrmion thermodynamics, the low-temperature picture is indeed one of entropic stabilization: skyrmions can be energetically unfavorable but entropically favored, so \(\Delta F_{10}=\Delta U_{10}-T\Delta S_{10}\) becomes negative. Yet the same study shows that at elevated temperature both \(\Delta F_{10}\) and \(\Delta S_{10}\) can change sign. This suggests that free energy–entropy duality is often structurally exact while its phenomenology remains strongly regime-dependent [2012.14688].

The literature therefore supports no single universal theorem under the heading “free energy–entropy duality.” Instead, it exhibits a recurrent structure with several exact realizations: entropy as derivative or finite-difference quotient of free energy; excess free energy as relative entropy to equilibrium; free energy and entropy as convex-conjugate potentials; dissipation of free energy as entropy production or Fisher information; and complementarity identities in generalized or process-level theories. The unifying theme is that entropy and free energy are not independent descriptors but paired coordinates of equilibrium, nonequilibrium deviation, and irreversible relaxation [1102.2098, 2312.03454, 2510.12790, 2602.15392].

Source: https://www.emergentmind.com/topics/free-energy-entropy-duality