---
title: 'Entropic Cone Closure: Geometry & Applications'
url: https://www.emergentmind.com/topics/closure-of-the-entropic-cone
type: topic
---

# Entropic Cone Closure: Geometry & Applications

Searching arXiv for recent and foundational papers on closure of the entropic cone and related boundary characterizations.
The closure of the entropic cone is the topological closure of the set of entropy vectors generated by discrete random variables. For \(n\) variables, the entropy vector records the joint entropies of all nonempty subsets, and the corresponding entropy region is denoted in the literature by symbols such as \(\Gamma_n^*\), \(\mathcal{T}_n^*\), or \(\mathcal{E}_N\). Its closure, written for example as \(\overline{\Gamma_n^*}\) or \(\overline{\mathcal{T}_n^*}\), is also called the almost entropic region or entropic cone. In the classical setting this closure is a convex cone, and it is the natural object of study because the set of entropic vectors itself need not a priori be closed; indeed, whether the full region of entropy vectors is closed is described as a major open problem in information theory [2206.02198] [1307.6059].

## 1. Definitions, outer bounds, and basic geometry

For a set of \(n\) discrete random variables \(X_{[n]}\), the entropy vector \(h\) consists of the joint entropies \(h_A\) of all nonempty subsets \(A \subseteq [n]\). The entropy region \(\mathcal{T}_n^*\) is the set of all such vectors, while its closure \(\overline{\mathcal{T}_n^*}\) is the almost entropic region. An equivalent notation widely used for the region of entropic vectors is \(\Gamma_n^*\), with closure \(\overline{\Gamma_n^*}\) [2206.02198] [1512.03324].

A universal outer bound is the polymatroidal cone, denoted \(\mathcal{I}_n\) in one notation and \(\Gamma_n\) in another. It consists of all vectors satisfying the basic Shannon-type inequalities, including nonnegativity and submodularity:
\[
h_A \geq 0 \qquad \forall A \subseteq [n]
\]
and
\[
h_{A \cup B} + h_{A \cap B} \leq h_A + h_B.
\]
For \(n \leq 3\), the closure of the entropy region coincides with this Shannon outer bound:
\[
\overline{\mathcal{T}_n^*} = \mathcal{I}_n.
\]
For \(n \geq 4\), the inclusion is strict: the almost entropic region is a proper subset of the Shannon cone [2206.02198].

The closure is convex, but for four or more variables it is not polyhedral. Multiple sources in the literature emphasize that non-Shannon inequalities are required for \(n \geq 4\), and that the boundary cannot be captured by finitely many Shannon-type inequalities alone [1512.03324] [1905.05351]. This distinction between the Shannon cone and the closure of the actual entropy region is the central geometric obstruction in the subject.

## 2. Boundary geometry for three random variables

The three-variable case is exceptional because the closure is fully described by Shannon-type inequalities, yet its boundary already exhibits the distinction between entropic and almost entropic phenomena. The proper faces of the Shannon region form the boundary, and for \(n=3\) there are eight extreme rays. All but one correspond to entropy vectors; the exceptional ray \(R_{123'}\) contains non-entropic vectors. In one explicit description, \(R_{123'}\) is proportional to \([1,1,1,2,2,2,2]\), corresponding to random variables that are pairwise independent and each a deterministic function of the other two [2005.10526].

Faces containing \(R_{123'}\) are precisely the faces that can contain non-entropic boundary points. This produces a detailed face stratification: one-dimensional, two-dimensional, and higher-dimensional faces containing \(R_{123'}\) become the natural testing ground for sharp inner and outer bounds [2005.10526].

Several boundary characterizations are known exactly in low-dimensional faces. On the face \(\mathrm{conv}(R_{23},R_{123'})\), an entropy vector is entropic if and only if
\[
r_{123'} + r_{23} \geq \log \lceil k^{r_{123'}} \rceil.
\]
On the face \(\mathrm{conv}(R_1,R_{123'})\), an entropy vector is entropic if and only if
\[
r_{123'} = \log m,\qquad m \in \mathbb{N}.
\]
The same line of work also establishes new outer bounds on larger faces. For \(\mathrm{conv}(R_1,R_{23},R_{123'})\), entropicity implies that \(Y_2\) and \(Y_3\) have the same marginal distribution, hence \(H(Y_2)=H(Y_3)\). For \(\mathrm{conv}(R_1,R_{12},R_{123'})\), entropicity implies
\[
\max_{y_1 \in \mathcal S_1} p(y_1) \leq \min_{y_3 \in \mathcal S_3} p(y_3).
\]
Explicit constructions further show that previously used inner bounds obtained from lower-dimensional faces by addition are not tight on faces such as \(\mathrm{conv}(R_{12},R_{23},R_{123'})\) and \(\mathrm{conv}(R_{12},R_{13},R_{23},R_{123},R_{123'})\) [2005.10526].

This three-variable analysis is significant because it shows that even where the closure is completely known as a cone, the entropic points on its boundary are already highly structured and not exhausted by simple conic or additive recipes.

## 3. Tight and modular decomposition of the closure

A structural reduction of the closure is obtained by decomposing polymatroids into tight and modular parts. Let \(\Gamma_N\) denote the cone of all polymatroidal rank functions, let \(\mathcal{M}\) be the cone of modular functions, and let \(\Gamma_N^{\mathrm{ti}}\) be the tight cone consisting of all \(h\) such that
\[
h(N)=h(N\setminus i)\qquad \forall i \in N.
\]
Then the closure of the entropy region admits the direct-sum decomposition
\[
\overline{\mathcal{E}_N}
=
\bigl(\overline{\mathcal{E}_N}\cap \Gamma_N^{\mathrm{ti}}\bigr)\oplus \mathcal{M}.
\]
Equivalently, every point in the closure has a unique decomposition into a tight part and a modular part [1310.5957].

For a given \(h\), these components are given explicitly by
\[
h_{\mathrm{ti}}(I)
=
h(I)-\sum_{i\in I}\bigl[h(N)-h(N\setminus i)\bigr],
\]
and
\[
h_{\mathrm{mo}}(I)
=
\sum_{i\in I}\bigl[h(N)-h(N\setminus i)\bigr].
\]
This decomposition reduces the study of the closure to the tight part, where the nontrivial geometry is concentrated [1310.5957].

A particularly useful consequence is the relative-interior statement
\[
\mathrm{ri}\!\left(\overline{\mathcal{E}_N}\cap \Gamma_N^{\mathrm{ti}}\right)\subseteq \mathcal{E}_N.
\]
Thus, the relative interior of the tight reduction is exhausted by entropic points; non-entropic closure effects occur only at the boundary. For four variables, this reduction interfaces naturally with the Ingleton inequality and with symmetrized three-dimensional sections used for visualization and computation [1310.5957].

This suggests that much of the difficulty of the closure problem lies in the fine boundary geometry of the tight component rather than in the modular directions.

## 4. Quasi-uniform random vectors and the almost entropic boundary

Quasi-uniform random vectors occupy a central position in the characterization of the closure. A random vector is quasi-uniform when its probability mass function assigns either \(0\) or a constant positive value to elements of its support; equivalently, every nonempty marginal \(X_A\) is uniformly distributed on its support. If \(\mathcal{A}_n\) denotes the set of entropy vectors achievable by quasi-uniform random vectors, then a fundamental equivalence is
\[
\overline{\mathcal{T}_n^*} = \mathrm{conv}(\mathcal{A}_n).
\]
Hence the convex closure of quasi-uniform entropy vectors coincides with the almost entropic region itself [2206.02198].

For quasi-uniform entropy vectors, a key structural condition is
\[
h_A = \log m_A,\qquad m_A\in \mathbb{N},
\]
for every nonempty \(A \subseteq [n]\). This arithmetic form makes quasi-uniformity particularly effective for boundary constructions [2206.02198].

Using this framework, the boundary of the almost entropic region for three random variables can be probed more sharply than with traditional additive inner bounds. On the four-dimensional face
\[
\Omega = \mathrm{cone}(e_1,e_2,e_3,e_{123'}),
\]
a standard inner-bound construction uses vectors of the form
\[
h=\lambda_1 e_1+\lambda_2 e_2+\lambda_3 e_3+\lambda_{123'} e_{123'},
\]
with the restriction \(\lambda_{123'}=\log m\) for some integer \(m\). The quasi-uniform approach produces entropy vectors in \(\Omega\) outside this inner bound. A concrete example is
\[
f=\log 3\, e_1+\log 3\, e_2+\log 3\, e_3+\log\!\left(\frac{4}{3}\right)e_{123'},
\]
which is realized by an explicit quasi-uniform distribution, while \(\log(4/3)\) is not of the form \(\log m\) for \(m\in\mathbb{N}\) [2206.02198].

Analogous looseness occurs on the five-dimensional face
\[
\Lambda=\mathrm{cone}(e_1,e_2,e_3,e_{12},e_{123'}).
\]
These constructions show that the boundary contains entropic points that cannot be reached by addition and convexity from lower-dimensional subfaces. In communication-theoretic terms, the one-to-one correspondence between quasi-uniform codes and quasi-uniform random vectors makes these results directly relevant to the design of network codes and to converse arguments in network information theory [2206.02198].

## 5. Computational and geometric methods for the unknown boundary

For four or more variables, the closure is not fully characterized, so much of the literature develops methods for mapping its unknown boundary. One prominent approach is support enumeration. The region of entropic vectors is explored by enumerating non-isomorphic supports of joint probability mass functions, using group actions on set partitions and canonical representatives. In this setting the “Snakes and Ladders” algorithm is used to construct a transversal of support orbits efficiently, after which numerical optimization over the nonzero probabilities yields inner bounds in the unknown part of the region [1512.03324].

This approach is especially informative in the four-variable case, where the Shannon outer bound \(\Gamma_4\) is decomposed into the Ingleton inner bound \(\mathcal{I}_4\) and six cones corresponding to violation of one of the six Ingleton inequalities. The same work reports that among 75 nonisomorphic 4-atom supports, only one can assign probabilities so as to violate Ingleton [1512.03324].

Information geometry supplies a complementary analytic description. Conditional independence constraints define e-autoparallel submanifolds in exponential coordinates, and equality in a Shannon inequality corresponds to an affine condition in \(\boldsymbol{\theta}\)-coordinates. In this way, faces of the Shannon cone and some Ingleton-violating families become geometric objects in a coordinate system adapted to statistical structure [1512.03324].

A distinct asymptotic framework is tropical probability theory. There the entropic cone is studied through quasi-linear sequences of diagrams, equipped with the asymptotic entropy distance
\[
\aikd([\mathcal X],[\mathcal Y])=\lim_{n\to\infty}\frac{1}{n}\ikd(\mathcal X(n),\mathcal Y(n)).
\]
The space of tropical diagrams forms a complete closed convex cone, and homogeneous diagrams are dense in it. Within this framework, a dimension-reduction theorem for four variables states that the boundary function \(\Phi\) describing the maximal value of the 15th entropy coordinate in terms of the first 14 satisfies
\[
\Phi(x_1,x_2,x_3,x_4,\ldots,x_{14})
=
\Phi(0,0,0,0,x_5,\ldots,x_{14}).
\]
Thus only 11 of the 15 coordinates are essential for that boundary description [1905.05351].

Taken together, these methods indicate that the unknown boundary is accessible neither by purely combinatorial enumeration nor by purely inequality-based reasoning alone; rather, it is approached through a synthesis of support geometry, information geometry, and asymptotic cone methods.

## 6. Related cones, applications, and extensions

The closure of the entropic cone is closely connected to several adjacent cones defined by operational or structural constraints. In Bell locality and Kochen-Specker noncontextuality scenarios, the joint Shannon entropies of local or noncontextual models define a convex cone whose non-trivial facets are tight entropic Bell or contextuality inequalities. The experimentally relevant object is often a projection of the full entropy cone onto observable marginals, and Fourier-Motzkin elimination is used to derive the corresponding facet inequalities [1201.3340].

In compatibility scenarios, the entropic no-disturbance cone is defined by an intersection of context-wise cones,
\[
\Gamma_{ND}=\Gamma_{\mathcal C_1}\cap\cdots\cap\Gamma_{\mathcal C_m},
\]
with the hierarchy
\[
\Gamma_{NCHV/LHV}\subseteq \Gamma_{QM}\subseteq \Gamma_{ND}.
\]
This construction parallels the probabilistic no-disturbance or nonsignaling picture and uses the convexity of the closure of entropic vectors in an essential way [1803.07925].

Another dual perspective is provided by the monotonicity cone of linear entropic formulas under local operations. For classical and quantum systems, this cone is polyhedral; its facets are derived from strong subadditivity and lower-set constraints, and the paper introducing it proves that all linear entropic monotones are implied by strong subadditivity. In the classical case, non-Shannon inequalities valid for the entropy cone do not produce new monotonic linear formulas under local operations [1811.08000]. This clarifies that the dual geometry relevant for monotonicity is narrower than the full geometry of the closure.

Extensions also appear in the theory of closure operators. There, Shannon entropy is defined as a polymatroidal relaxation, closure entropies are shown to be dense, and the work emphasizes that density of attainable entropy values does not settle the closure question for the associated entropic sets [1307.6059]. A plausible implication is that scalar entropy observables can be dense even when the full vector geometry remains unresolved.

Quantum variants complicate the classical conical picture. In the \(N\)-partite quantum setting, homogeneous inequalities such as strong subadditivity constrain the closure of the set of entropy vectors, but non-homogeneous inequalities near the apex impose strictly positive lower bounds under certain saturation conditions. In particular, the set \(\Sigma_N^*\) of realizable quantum entropy vectors is shown not to be a cone for \(N\geq 3\), because arbitrary down-scaling can fail even though integer up-scaling is always possible [2306.00199]. This does not alter the classical definition of the almost entropic region, but it shows that “entropy cone” terminology becomes more delicate outside the classical Shannon framework.

The closure of the entropic cone therefore serves simultaneously as a geometric object, an asymptotic limit, and a unifying language across network coding, contextuality, monotonicity, and combinatorial closure theory. Its most robustly established features are convexity, the Shannon outer approximation, the non-polyhedral nature of the four-variable and higher-variable case, and the special role of quasi-uniform constructions. Its least understood aspect remains the precise boundary for \(n\geq 4\), where explicit constructions, asymptotic reductions, and geometric parametrizations continue to supply partial but increasingly sharp descriptions [2206.02198] [1512.03324].

Source: https://www.emergentmind.com/topics/closure-of-the-entropic-cone