---
title: Zhang–Yeung Construction
url: https://www.emergentmind.com/topics/zhang-yeung-construction
type: topic
---

# Zhang–Yeung Construction

Searching arXiv for recent and foundational papers on the Zhang–Yeung construction, Copy Lemma, and non-Shannon information inequalities.
The Zhang–Yeung construction is the auxiliary-variable method that yielded the first genuinely non-Shannon entropy inequality in four random variables. In the modern formulation given in "Exploring the Entropic Region" [2509.12439], the construction is distilled into the Copy Lemma: one enlarges a joint distribution by adjoining a suitably constrained “copy” variable, applies Shannon-type inequalities in the extended space, and then substitutes the copy constraints to obtain a new inequality on the original variables. In "Non-Shannon Information Inequalities in Four Random Variables" [1104.3602], this technique is presented as the key idea behind the first example of a non-Shannon information inequality, and as the prototype for many later inequalities in four variables.

## 1. Origin and defining role

In 1998, Zhang and Yeung gave the first example of a "non-Shannon" information inequality in four variables [1104.3602]. The construction arose from the observation that although any unconstrained information inequality in three or fewer random variables can be written as a linear combination of instances of Shannon's inequality $I(A;B\mid C)\ge 0$, this ceases to hold for four variables [1104.3602]. The Zhang–Yeung method therefore marks the point at which Shannon’s basic inequalities were shown to be insufficient for characterizing the entropic region.

The modern tutorial treatment identifies the construction not merely with a single inequality, but with a general method for obtaining new entropy inequalities [2509.12439]. The tutorial states that the Copy Lemma was distilled from the original Zhang–Yeung construction which produced the first non-Shannon inequality, and that its iterated version, effects of symmetrizations, and connections with polyhedral vertex enumeration are central to exploring the entropic region [2509.12439].

A plausible implication is that the term “Zhang–Yeung construction” refers both to the original proof strategy for the first non-Shannon inequality and to the broader auxiliary-variable paradigm later abstracted as the Copy Lemma.

## 2. The Zhang–Yeung inequality

For four random variables $A,B,C,D$, the tutorial gives the original Zhang–Yeung inequality in an equivalent “Ingleton-style” form as [2509.12439]
$$
[A,B,C,D] +(A,B\|C)+(A,C\|B)+(B,C\|A)\ge 0,
$$
where
$$
[A,B,C,D]=H(A,B\|C)+H(A,B\|D)+H(C,D)-H(A,B).
$$
In expanded Shannon-entropic terms this becomes
$$
H(A,B\|C)+H(A,B\|D)+H(C,D)+H(A,C\|B)+H(B,C\|A)\ge H(A,B).
$$

The 2011 exposition gives two equivalent formulations of the original Zhang–Yeung non-Shannon inequality [1104.3602]. In its first published form it reads
$$
2\,I(C;D)\le I(A;B)+I\bigl(A;C,D\bigr)+3\,I(C;D\mid A)+I(C;D\mid B).
$$
Equivalently, one may write it in symmetric conditional-mutual-information form as
$$
I(A;B)\le 2\,I(A;B\mid C)+I(A;C\mid B)+I(B;C\mid A)+I(A;B\mid D)+I(C;D).
$$

These formulations encode the same underlying phenomenon: a valid entropy inequality for four variables that is not implied by Shannon’s monotonicity and submodularity alone [1104.3602]. The tutorial further emphasizes that Zhang and Yeung’s original proof exhibited a particular four-variable distribution whose entropy vector violates all inequalities implied by Shannon alone, that is, it violates Ingleton, but nonetheless satisfies the Zhang–Yeung inequality [2509.12439].

## 3. Probabilistic mechanism: the copy construction

The core probabilistic step is to enlarge an arbitrary joint distribution by adjoining a new variable with prescribed marginal and conditional-independence properties. In the tutorial presentation, one starts from an arbitrary joint distribution
$$
\xi=(A,B,C,D)
$$
of four discrete random variables, fixes a subset $D=\{C,D\}$, and forms a new random variable $C'$ which is a “copy” of $C$ over the subset $D$ in the sense that [2509.12439]:

1. the joint law of $(A,B,D)$ is unchanged;
2. $(C',D)$ has the same marginal law as $(C,D)$;
3. $C'$ is conditionally independent of $(A,B,C)$ given $D$.

The resulting five-variable distribution $(A,B,C,D,C')$ has an entropy vector that underlies the Copy Lemma, and from it one obtains the Zhang–Yeung inequality by a short Shannon-type argument [2509.12439].

The 2011 account gives the distilled four-variable form of this idea as follows: given jointly distributed random variables $(A,B,C,D)$, one can introduce a new variable $R$ such that [1104.3602]:

- the marginal $(A,B,R)$ has exactly the same joint law as $(A,B,C)$;
- $I(C,D;R\mid A,B)=0$.

One then says that $R$ is a $D$-copy of $C$ over $(A,B)$ [1104.3602]. In words, $R$ “looks like” $C$ to the pair $(A,B)$, yet $R$ brings no new information about $(C,D)$ once $(A,B)$ is known [1104.3602].

This probabilistic coupling is the defining structural move of the Zhang–Yeung construction. A plausible implication is that the construction should be understood less as a specific symbolic derivation than as a method of extending the variable set so that ordinary Shannon inequalities become strong enough to imply genuinely new bounds on the original coordinates.

## 4. The Copy Lemma as an abstract formulation

The tutorial isolates the copy operation in polymatroidal form [2509.12439]. Let $N$ be a finite set of indices, let $f$ be a polymatroid on $N$, write $N=E\cup D$, and let $A\subseteq E$. After adjoining a disjoint copy $A'$ of $A$, with involution $\pi_A$ swapping each $a\in A$ with its twin $a'\in A'$ and fixing everything in $D$ and in $E\setminus A$, one defines an **$A$-copy of $f$ over $D$** to be a polymatroid $f^*$ satisfying three conditions [2509.12439]:

- **Extension:** $f^*(J)=f(J)$ for every $J\subseteq E\cup D$.
- **Symmetry on the copy:** $f^*(\pi_A(J))=f^*(J)$ for every $J\subseteq A'\cup D$.
- **Conditional independence:** 
  $$
  f^*(A',E\|D)=0.
  $$

The Copy Lemma then states that if $f$ is entropic, almost-entropic, or linear-representable, then for every choice of $A\subseteq E$ and every partition $N=E\cup D$, the polymatroid $f$ admits an entropic, almost-entropic, or linear $A$-copy over $D$, respectively [2509.12439].

The proof sketch in the tutorial distinguishes three cases [2509.12439]. In the entropic case, one starts with a joint distribution realizing $f$ and defines a new joint law on $E\cup A'\cup D$ by
$$
\Pr\bigl(x_E,x_{A'},x_D\bigr)=\frac{\Pr\bigl(x_{\pi_A(x_{A'})},x_D\bigr)\Pr(x_E,x_D)}{\Pr(x_D)}.
$$
This leaves the marginal on $E\cup D$ unchanged, identifies the marginal on $A'\cup D$ with that on $A\cup D$, and enforces the required conditional-independence relation [2509.12439]. The linear case is described via vector spaces $V_i\subseteq\mathbb{F}^d$, a direct-sum complement of the subspace spanned by $V_D$, and a generic basis of the complement to represent $A'$ [2509.12439]. The almost-entropic case follows by continuity [2509.12439].

This abstraction is significant because it separates the structural content of the Zhang–Yeung method from the particulars of the original four-variable example. The construction thus becomes a reusable extension principle within the polymatroidal and entropy-functional setting.

## 5. Derivation of the inequality from one copy step

The tutorial gives a concise derivation of the Zhang–Yeung inequality from a single Copy Lemma application and one Shannon-type inequality [2509.12439]. One begins with $f(A,B,C,D)$ and applies the Copy Lemma with $A=\{C\}$ and $D=\{C,D\}$, obtaining an almost-entropic extension $f^*$ on $\{A,B,C,D,C'\}$ such that:

- $f^*(A,B,C,D)=f(A,B,C,D)$;
- $f^*(C',C,D)=f(C,C,D)$;
- $(C',\{A,B,C\}\|D)=0$.

In the extended polymatroid $f^*$, the following six-term Shannon-type inequality holds for any five-tuple of sets [2509.12439]:
$$
[A,B,C,D]+(A,B\|C')+(A,C'\|B)+(B,C'\|A)+3\,(C,D\|A,B)\ge 0.
$$
The tutorial labels this inequality as (MMRV) and notes that it is a Shannon-type inequality in the enlarged space [2509.12439].

Substituting the copy constraints yields
$$
(A,B\|C')=(A,B\|C),\qquad
(A,C'\|B)=(A,C\|B),\qquad
(B,C'\|A)=(B,C\|A),\qquad
(C,D\|A,B)=0,
$$
while $[A,B,C,D]$ is unchanged [2509.12439]. The result is exactly
$$
[A,B,C,D]+(A,B\|C)+(A,C\|B)+(B,C\|A)\ge 0,
$$
which is the Zhang–Yeung inequality [2509.12439].

The 2011 exposition presents a related simplified one-copy derivation using a variable $R$ that is a $D$-copy of $C$ over $(A,B)$ [1104.3602]. It proves two intermediate inequalities, combines them, cancels the $-H(C\mid R)$ terms, and obtains the symmetric form
$$
I(A;B)\le 2\,I(A;B\mid C)+I(A;C\mid B)+I(B;C\mid A)+I(A;B\mid D)+I(C;D)
$$
[1104.3602]. That paper states that the Zhang–Yeung inequality can actually be derived from just one auxiliary variable [1104.3602].

Taken together, these accounts show that the Zhang–Yeung construction is a Shannon-type argument in an extended variable space, with the novelty residing in the auxiliary-variable constraints rather than in any new primitive inequality.

## 6. Iteration, symmetrization, and relation to entropy space

The tutorial states that the Copy Lemma may be applied repeatedly [2509.12439]. Starting from $f$ on $N$, one copies a subset $A_1\subset E_1\subset N$ over $D_1\subset N$ to obtain $f_1$ on $N_1=N\cup A_1'$, then chooses $A_2\subset E_2\subset N_1$ and $D_2\subset N_1$, produces $f_2$ on $N_2=N_1\cup A_2'$, and so on [2509.12439]. Each step preserves the entropic, almost-entropic, or linear property, and a carefully chosen chain
$$
(A_1,D_1),(A_2,D_2),\dots,(A_k,D_k)
$$
can force new linear constraints among the original coordinates of $f$, that is, new non-Shannon inequalities [2509.12439].

Symmetrization plays a complementary role. At each copy step one can enforce the canonical involution $\pi_A$ to be an exact automorphism of the new polymatroid [2509.12439]. More generally, any symmetry of the original $f$ that leaves the “over” set $D$ globally invariant can be lifted to the copy by intertwining with $\pi$, and one may average over the entire symmetry group so as to reduce the number of independent variables in the final linear program that extracts inequalities [2509.12439].

The geometric interpretation given in the 2011 paper situates these constructions in entropy space [1104.3602]. Shannon inequalities alone carve out a polyhedral cone $\Gamma_4$, while the Zhang–Yeung bound slices away a “pyramid” outside the Ingleton subcone, proving that the true entropic region $\overline{\Gamma}^*_4$ is strictly smaller than the Shannon cone [1104.3602]. The same paper states that Zhang–Yeung was the first demonstration that the space of all quadruple-variable entropy vectors is not cut out by Shannon’s basic inequalities alone and that it showed $\overline{\Gamma}^*_4$ is not polyhedral [1104.3602].

A plausible implication is that the Zhang–Yeung construction is important not only for producing individual inequalities but also for providing a systematic mechanism for refining outer approximations to the entropic region.

## 7. Significance, limitations, and later perspective

The 2011 paper emphasizes several consequences of the Zhang–Yeung construction [1104.3602]. It gave the first non-Shannon inequality, spawned infinite families of inequalities, and motivated work on network coding, including improved upper bounds on coding capacity as demonstrated on specific networks [1104.3602]. It also notes that the auxiliary-variable method highlights how new conditional-independence assumptions allow one to bootstrap Shannon’s inequalities into genuinely new information laws [1104.3602].

The 2025 tutorial places the method among three known approaches for obtaining new entropy inequalities and compares their strengths and limitations [2509.12439]. It states that another method, derived from the principle of maximum entropy, has the Copy Lemma as a special case, but that none of the two presented variants is known to generate more inequalities than the iterated Copy Lemma [2509.12439]. It further states that the Ahlswede–Körner method employs a hidden application of the Copy Lemma, that the underlying lemma alone cannot generate new inequalities, and that this makes the Ahlswede–Körner method strictly weaker than the Copy Lemma [2509.12439].

The same tutorial concludes with open questions and research problems [2509.12439]. This suggests that, despite its foundational status, the Zhang–Yeung construction remains part of an active research program concerned with the structure of the entropic region, the power of iterated copying, and the comparative strength of auxiliary-variable methods.

A common misconception is that the Zhang–Yeung inequality is merely an exotic reformulation of Shannon’s inequalities. The cited accounts reject this directly: it cannot be derived from ordinary Shannon-type inequalities alone, although its proof becomes a pure Shannon-type argument after enlarging the variable set and imposing copy-lemma constraints [1104.3602]. Another misconception is that the original construction is exhausted by the single 1998 inequality. The later tutorial treatment instead presents it as the source of a general Copy Lemma framework whose iterated and symmetrized forms yield many additional non-Shannon inequalities [2509.12439].

Source: https://www.emergentmind.com/topics/zhang-yeung-construction