Spherical Boltzmann Machine

• Spherical Boltzmann Machines are continuous energy-based models in which variables are constrained to lie on a fixed-radius sphere, enabling tractable analytical and spectral analysis.
• They include fully visible, undirected EBM, and Gaussian-spherical RBM formulations, each revealing distinctive thermodynamic and phase transition behaviors.
• The models demonstrate collective phenomena such as condensation onto spectral modes, explicit phase boundaries, and closed-form solutions via variational and replica methods.

Spherical Boltzmann machines are Boltzmann-machine models in which continuous variables are subject to a spherical constraint or spherical prior, so that configurations lie on a fixed-radius sphere or thin spherical shell rather than on a discrete hypercube. In the recent literature, the term covers several related but non-identical constructions: fully visible quadratic energy models on $\|\boldsymbol{\sigma}\|^2=N$ (Tulinski et al., 20 Apr 2026), undirected energy-based models over $$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$ with symmetric coupling matrix $W$ (Tulinski et al., 9 May 2026), and restricted architectures in which a hidden layer is spherical while visible units are Gaussian (Decelle et al., 2019). A complementary line of work studies spherical and Gaussian priors in fully visible and restricted Boltzmann machines and proves a Legendre equivalence at the level of thermodynamic free energies (Genovese et al., 2019). Across these formulations, the spherical constraint is the source of both tractability and distinctive collective phenomena, notably condensation onto dominant spectral modes, explicit spectral phase boundaries, and closed-form or asymptotically exact analyses of learning and generation.

1. Terminology and model family

The expression “spherical Boltzmann machine” does not denote a single universally fixed architecture. In the fully visible formulation developed as an analytically solvable benchmark for ensemble learning, the model consists of continuous spins $\boldsymbol{\sigma}\in\mathbb R^N$ constrained by $\|\boldsymbol{\sigma}\|^2=N$ and governed by the quadratic energy

$$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$

with $\boldsymbol J=\boldsymbol J^\top$ symmetric (Tulinski et al., 20 Apr 2026). A closely related formulation writes the visible state as $\mathbf x\in\mathcal S_N$ and the energy as

$$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$

so that the induced Gibbs law on the sphere is a Bingham distribution (Tulinski et al., 9 May 2026).

Restricted variants impose spherical structure only on part of the system. In the Gaussian-spherical restricted Boltzmann machine, visible variables $\{s_i\}$ are real-valued with Gaussian priors, while hidden variables $$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$0 are constrained by

$$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$1

and interact through a bipartite weight matrix $$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$2 (Decelle et al., 2019). Another formulation treats both fully visible Hopfield-type models and bipartite RBMs with spherical priors, uniform on spheres $$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$3 of radius $$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$4, or on thin shells used in proofs (Genovese et al., 2019).

A terminological caveat is necessary. In “Understanding Boltzmann Machine and Deep Learning via A Confident Information First Principle,” the acronym SBM is used for “single-layer Boltzmann machine without hidden units,” not for “spherical Boltzmann machine” (Zhao et al., 2013). That usage refers to a binary visible-only pairwise Boltzmann machine and belongs to a different line of work. This suggests that the acronym “SBM” is historically overloaded, and precise interpretation depends on context.

2. Canonical mathematical formulations

In the fully visible spherical model, the Gibbs distribution takes the form

$$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$5

with partition function

$$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$6

for $$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$7 (Tulinski et al., 20 Apr 2026). At large $$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$8, the model is controlled by the spectrum of $$\mathbf x\in\mathcal S_N=\{\mathbf x\in\mathbb R^N:\|\mathbf x\|^2=N\}$$9 through a Lagrange multiplier $W$0 solving

$W$1

This spectral reduction is one of the central reasons the model is analytically manageable.

The closely related EBM formulation uses

$W$2

with

$W$3

Because the support is the sphere, the law is not Gaussian even though the energy is quadratic (Tulinski et al., 9 May 2026). The paper emphasizes that the spherical constraint induces condensation transitions absent from the unconstrained Gaussian analogue.

In the Gaussian-spherical RBM, the energy is

$W$4

and the joint distribution is

$W$5

Here the visibles remain unconstrained Gaussian variables, whereas the hidden layer does not conditionally factorize because the global $W$6-constraint couples all hidden components (Decelle et al., 2019).

The spherical-prior framework of Genovese and Tantari treats a layer of size $W$7 under the uniform measure on $W$8 or, technically, the shell

$W$9

and studies both the fully visible Hopfield Hamiltonian and the restricted Hamiltonian

$\boldsymbol{\sigma}\in\mathbb R^N$0

in the thermodynamic limit (Genovese et al., 2019). In that setting, spherical constraints may be imposed on one or both layers.

3. Solvability, spectral reduction, and thermodynamic structure

A recurring feature of spherical Boltzmann machines is that the spherical constraint converts the partition function into a form dominated by spectral quantities. In the Gaussian-spherical RBM, singular value decomposition

$\boldsymbol{\sigma}\in\mathbb R^N$1

diagonalizes the interaction, and after introducing a Fourier/Laplace representation of the spherical constraint, the partition function reduces to a one-dimensional contour integral

$\boldsymbol{\sigma}\in\mathbb R^N$2

which can be analyzed by saddle-point methods (Decelle et al., 2019). The thermodynamics then depends only on the spectrum of $\boldsymbol{\sigma}\in\mathbb R^N$3, especially edge behavior, isolated top modes, and spectral degeneracy.

In the fully visible spherical-prior models, free energies become explicit convex variational problems. For the spherical Hopfield model,

$\boldsymbol{\sigma}\in\mathbb R^N$4

while for the doubly spherical RBM,

$\boldsymbol{\sigma}\in\mathbb R^N$5

is given by a convex minimization formula involving the Marchenko–Pastur law and two Lagrange multipliers (Genovese et al., 2019). The paper stresses that the doubly spherical RBM yields a fully convex minimization principle.

In the 2026 visible-only SBM theory, the evidence over coupling matrices has a Coulomb-gas structure. Writing $\boldsymbol{\sigma}\in\mathbb R^N$6, the posterior weight becomes

$\boldsymbol{\sigma}\in\mathbb R^N$7

and the leading $\boldsymbol{\sigma}\in\mathbb R^N$8 contribution yields a Wigner semicircle bulk with half-width

$\boldsymbol{\sigma}\in\mathbb R^N$9

The bulk density is

$\|\boldsymbol{\sigma}\|^2=N$0

with Stieltjes transform

$\|\boldsymbol{\sigma}\|^2=N$1

(Tulinski et al., 9 May 2026). This spectral characterization controls alignment, condensation, and evidence asymptotics.

The replica treatment of SBM ensembles reaches a parallel conclusion from a different direction. There, the replicated free entropy closes in terms of a replica overlap matrix $\|\boldsymbol{\sigma}\|^2=N$2 and magnetizations along data modes $\|\boldsymbol{\sigma}\|^2=N$3, producing a large-$\|\boldsymbol{\sigma}\|^2=N$4 action

$\|\boldsymbol{\sigma}\|^2=N$5

and the saddle-point equations can be solved analytically under a rotationally invariant ansatz (Tulinski et al., 20 Apr 2026). A plausible implication is that the spherical constraint does not merely regularize the state space; it reorganizes the entire inference problem into a tractable spectral theory.

4. Learning formulations and parameter-space inference

Learning in spherical Boltzmann machines has been formalized in several distinct ways. One is a tempered ensemble over interaction matrices. Given data $\|\boldsymbol{\sigma}\|^2=N$6 and a Gaussian/Wigner prior

$\|\boldsymbol{\sigma}\|^2=N$7

the model ensemble is

$\|\boldsymbol{\sigma}\|^2=N$8

The paper emphasizes that, unless $\|\boldsymbol{\sigma}\|^2=N$9, this is not a Bayesian posterior because $$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$0, so $$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$1 is a genuine learning temperature (Tulinski et al., 20 Apr 2026). In that framework, ensemble learning means averaging predictions over $$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$2 rather than selecting a single minimizer.

A related but differently parametrized formulation defines a tempered posterior over $$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$3 through

$$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$4

with evidence

$$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$5

Here $$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$6 corresponds to the standard Bayes posterior, $$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$7 to the MAP limit, $$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$8 to weight decay strength, and $$E(\boldsymbol{\sigma};\boldsymbol{J})=-\frac{1}{2}\boldsymbol{\sigma}^{\top}\boldsymbol{J}\boldsymbol{\sigma},$$9 to temperature in parameter space (Tulinski et al., 9 May 2026). The evidence acts as a partition function in parameter space and encodes global properties of the trained model.

The same paper also studies exact continuous-time stochastic training dynamics with exact negative phase,

$\boldsymbol J=\boldsymbol J^\top$0

and a persistent-MCMC variant,

$\boldsymbol J=\boldsymbol J^\top$1

$\boldsymbol J=\boldsymbol J^\top$2

where $\boldsymbol J=\boldsymbol J^\top$3 is the sampling rate and $\boldsymbol J=\boldsymbol J^\top$4 enforces the sphere (Tulinski et al., 9 May 2026). This yields an analytically tractable model of training coupled to a non-equilibrated negative phase.

In the Gaussian-spherical RBM, tractability changes the nature of training. Because response functions can be extracted with arbitrary precision, the learning dynamics of singular values and other mode-resolved quantities can be numerically integrated without relying on contrastive divergence or approximate mean field in the analyzed settings (Decelle et al., 2019). This supports a mode-by-mode interpretation of training as spectral emergence from a Marchenko–Pastur bulk.

5. Phase structure, condensation, and generation

The central physical phenomenon in spherical Boltzmann machines is condensation onto top spectral modes. In the visible-only SBM theory, introducing a Lagrange multiplier $\boldsymbol J=\boldsymbol J^\top$5 for the spherical partition function leads to the saddle equations

$\boldsymbol J=\boldsymbol J^\top$6

with

$\boldsymbol J=\boldsymbol J^\top$7

The threshold $\boldsymbol J=\boldsymbol J^\top$8 marks the transition between uncondensed and condensed sampling (Tulinski et al., 9 May 2026). The paper explicitly contrasts representation and generation: $\boldsymbol J=\boldsymbol J^\top$9 means a mode is represented in $\mathbf x\in\mathcal S_N$0, whereas $\mathbf x\in\mathcal S_N$1 means it is active in generated samples.

That distinction produces a multiphase equilibrium diagram. The theory identifies a fully unaligned, uncondensed regime; an aligned but uncondensed regime in which top eigenvalues detach and align to data yet remain “silent” in generation; a condensed but unaligned regime in which samples condense along a random direction; and condensed, aligned regimes with either edge-pinned or outlier top eigenvalues (Tulinski et al., 9 May 2026). The force balance on outliers clarifies the mechanism: HCIZ alignment pulls eigenvalues away from the bulk, whereas the sample-space partition function pushes them back through a condensation-dependent term.

The Gaussian-spherical RBM exhibits an analogous spectral phase structure. When the spectral edge exponent satisfies $\mathbf x\in\mathcal S_N$2, the critical variance

$\mathbf x\in\mathcal S_N$3

is finite, and for $\mathbf x\in\mathcal S_N$4 the top mode may acquire macroscopic occupation, interpreted as the analog of the ferromagnetic phase of the spherical model (Decelle et al., 2019). Degenerate top eigenspaces yield ordered phases with $\mathbf x\in\mathcal S_N$5 symmetry, and in the doubly degenerate case the partition function admits an exact finite-size treatment that makes the analogy to Bose-Einstein condensation explicit.

The replica theory of SBM ensembles reaches similar conclusions at the level of learned couplings. The number $\mathbf x\in\mathcal S_N$6 of condensed data modes is selected by

$\mathbf x\in\mathcal S_N$7

yielding phases that are paramagnetic, condensed, or marginal, together with freezing of the negative-replica branch below a critical $\mathbf x\in\mathcal S_N$8 (Tulinski et al., 20 Apr 2026). In the rank-one case, these phases map to the deformed-GOE picture with unaligned and aligned branches and edge-pinned marginal behavior.

Several generative consequences follow. Sampling-temperature tuning can rescue a learned but silent aligned mode by increasing $\mathbf x\in\mathcal S_N$9 so that generation crosses a condensation threshold, whereas lowering $$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$0 can de-condense a wrongly condensed random mode (Tulinski et al., 9 May 2026). The same paper reports double descent of the typical reverse KL as a function of regularization strength $$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$1, warm and cold posterior effects as a function of posterior temperature $$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$2, and out-of-equilibrium training biases at finite sampling rate $$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$3. This suggests that condensation is not a peripheral feature but the organizing principle behind the model’s generative behavior.

6. Relations to Gaussian models, RBMs, and broader Boltzmann-machine theory

A major theoretical result is that spherical and Gaussian or sub-Gaussian Boltzmann machines are related by Legendre transformation at the level of limiting free energy. For the fully visible model,

$$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$4

and conversely

$$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$5

(Genovese et al., 2019). Analogous formulas hold for mixed and doubly restricted models. The rigid radius $$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$6 and Gaussian variance $$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$7 are thus Legendre-conjugate variables in the thermodynamic limit.

This equivalence clarifies the role of the spherical constraint. A Gaussian prior decomposes over spherical shells, and the large-$$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$8 Laplace principle selects the dominant radius. In that sense, the Gaussian model is a superposition of spherical models over radii, while the spherical model can be viewed as a hard-constrained representative of the same free-energy landscape (Genovese et al., 2019). The 2026 solvable EBM paper sharpens the contrast by showing that condensed phases, temperature tuning, warm posterior effects, and the KL spike at the condensation boundary are specific to the spherical constraint because, in the unconstrained Gaussian model, $$E(\mathbf x;W)=-\frac12\,\mathbf x^\top W\mathbf x,\qquad W\in \mathrm{Sym}_N,$$9 contributes only $\{s_i\}$0 forces on top eigenvalues, whereas in the SBM the partition function contributes an $\{s_i\}$1 condensation force (Tulinski et al., 9 May 2026).

Restricted spherical models occupy an intermediate position. The Gaussian-spherical RBM preserves the bipartite structure of an RBM but loses hidden-unit conditional independence because the spherical hidden-layer constraint globally couples hidden coordinates (Decelle et al., 2019). By contrast, the fully visible SBM has no hidden variables and is closer in spirit to the spherical spin glass or a continuous Hopfield-type model, though the learning problem is cast in terms of inference over the coupling matrix rather than fixed Hebbian retrieval (Tulinski et al., 20 Apr 2026).

The older CIF paper underscores a different relation. Its “SBM” is a binary visible-only pairwise Boltzmann machine obtained by preserving first- and second-order expectation coordinates and setting higher-order natural coordinates to zero (Zhao et al., 2013). That model is neither spherical nor continuous. The overlap in acronym therefore reflects nomenclature rather than model continuity.

Taken together, the literature portrays spherical Boltzmann machines as a family of continuous, norm-constrained energy-based models whose analytical accessibility derives from spectral reduction, variational principles, and replica or random-matrix methods. Their main significance lies in providing solvable settings in which learning, evidence, mode alignment, condensation, and generation can all be studied explicitly (Tulinski et al., 9 May 2026).