---
title: 'Bounded Statistical Parity: Concepts & Trade-offs'
url: https://www.emergentmind.com/topics/bounded-statistical-parity
type: topic
---

# Bounded Statistical Parity: Concepts & Trade-offs

Bounded statistical parity denotes a relaxation of demographic or statistical parity in which exact independence between an output and a sensitive attribute is replaced by an explicit upper bound on dependence or disparity. In the information-theoretic literature, two formalizations are central: a global leakage budget \(I(Y;S)\le \epsilon\), which bounds the mutual information between a representation \(Y\) and a sensitive attribute \(S\), and a local, point-wise constraint \(\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^2\) for every realized output \(y\), which bounds posterior deviation from the population prior at each output [2508.12847] [2511.22683]. In classification settings, the same theme appears as a bounded acceptance-rate disparity, typically of the form \(|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon\), with the achievable bound determined by base-rate imbalance and error-rate structure [2601.19035].

## 1. Definitions and formal variants

Classical statistical parity, also called demographic parity, requires that the algorithm’s output be independent of the sensitive attribute. In a representation-learning formulation this is written as \(Y\perp S\), equivalently \(I(Y;S)=0\), and in a binary prediction setting it is written as
\[
Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).
\]
The first form emphasizes distributional independence; the second emphasizes equality of positive prediction rates across groups [2508.12847] [2601.19035].

Bounded statistical parity replaces this exact condition by a controlled relaxation. In the mutual-information formulation,
\[
I(Y;S)\le \epsilon,
\]
where \(\epsilon\ge 0\) is a leakage or fairness budget. The case \(\epsilon=0\) recovers perfect statistical parity or perfect privacy, while \(\epsilon>0\) permits small, controlled dependence between \(Y\) and \(S\) [2508.12847]. In the point-wise formulation, fairness is enforced for each output realization:
\[
\chi^2(P_{S\mid y};P_S)\le \epsilon^2,\qquad \forall y\in\mathcal Y.
\]
This requires the posterior distribution of the sensitive attribute conditioned on a specific output \(y\) to remain close to the marginal \(P_S\) [2511.22683].

The two formulations differ in granularity. Mutual information is a global measure of leakage, whereas the point-wise \(\chi^2\) bound controls local posterior deviations for every output. The latter is therefore stronger than an average leakage constraint; the point-wise paper explicitly states that its achievable utility \(g^r_{\epsilon,\chi^2}(P_{S,X,T})\) is bounded above by the utility achievable under the mutual-information relaxation \(g^r_{\epsilon}(P_{S,X,T})\) [2511.22683].

| Formulation | Constraint | Interpretation |
|---|---|---|
| Exact statistical parity | \(Y\perp S\) or \(I(Y;S)=0\) | Perfect independence |
| Bounded statistical parity | \(I(Y;S)\le \epsilon\) | Global leakage budget |
| Bounded point-wise statistical parity | \(\chi^2(P_{S\mid y};P_S)\le \epsilon^2,\ \forall y\) | Per-output posterior control |

A broader interpretation, stated explicitly in the point-wise work, is that bounded statistical parity refers to imposing an explicit upper bound on deviations from demographic parity rather than requiring exact independence [2511.22683].

## 2. Representation-theoretic problem formulations

The information-theoretic literature studies bounded statistical parity through representation design. The canonical variables are \(S\) for the sensitive attribute or secret, \(X\) for useful data, \(T\) for the task variable, and \(Y\) for the designed representation [2508.12847] [2511.22683].

One formulation allows the encoder to depend on all variables through
\[
P_{Y\mid S,X,T},
\]
with no requirement that \((S,T)-X-Y\) hold. The optimization problem is
\[
g^{r}_{\epsilon}(P_{S,X,T})
=\sup_{P_{Y\mid S,X,T}: I(Y;S)\le \epsilon,\ I(X;Y)\le r} I(Y;T).
\]
Its three terms have fixed roles: \(I(Y;T)\) is utility, \(I(X;Y)\le r\) is a compression or encoding-rate constraint, and \(I(Y;S)\le\epsilon\) is the bounded statistical parity or bounded privacy leakage constraint [2508.12847].

A second formulation assumes the agent has no direct access to \(S\) or \(T\), only to \(X\). The encoder is then
\[
P_{Y\mid X},
\]
and the Markov chains
\[
S-X-Y,\qquad T-X-Y
\]
are imposed. The corresponding optimization problem is
\[
g^{r}_{\epsilon,\chi^2}(P_{S,X,T})
\triangleq
\sup_{\substack{P_{Y\mid X}: S-X-Y,\ T-X-Y,\\
\chi^2(P_{S\mid y};P_S)\le \epsilon^2,\ \forall y,\\
I(X;Y)\le r}}
I(Y;T).
\]
Here again, the objective is utility, the rate \(r\) controls compression, and \(\epsilon\) controls allowed deviation from demographic parity [2511.22683].

Both formulations explicitly unify fairness, privacy, and compression. The first paper also states that the problem can be interpreted as one of code design with bounded leakage and bounded rate, treating \(S\) as a secret and \(Y\) as a codeword whose leakage about \(S\) and rate with respect to \(X\) are simultaneously controlled [2508.12847].

## 3. Mutual-information bounded parity

The mutual-information formulation treats bounded statistical parity as a global information budget:
\[
I(Y;S)\le \epsilon.
\]
This is also a bounded privacy leakage condition, since \(I(Y;S)\) measures how much information the representation reveals about the sensitive attribute [2508.12847].

A central result is the general upper bound
\[
g^{r}_{\epsilon}(P_{S,X,T}) \le \min\{H(T\mid S)+\epsilon,\ H(T\mid X)+r\}.
\]
The two terms correspond to relaxing one constraint at a time: if only the fairness constraint remains, utility is bounded by \(H(T\mid S)+\epsilon\); if only the rate constraint remains, utility is bounded by \(H(T\mid X)+r\) [2508.12847].

The same paper develops lower bounds using extended versions of the Functional Representation Lemma and the Strong Functional Representation Lemma. The relevant tools are the Extended FRL, which constructs an auxiliary variable \(U\) satisfying \(I(U;X)=\epsilon\) and \(H(Y\mid U,X)=0\), and the Extended SFRL, which adds a bound on \(I(X;U\mid Y)\) with
\[
\alpha=\frac{\epsilon}{H(X)}.
\]
These extensions support constructive mechanisms based on randomization over \(X\) or \(S\) and yield regime-dependent lower bounds such as \(L_1^{r,\epsilon}\), \(L_2^{r,\epsilon}\), \(L_3^{r,\epsilon}\), and \(L_4^{r,\epsilon}\) [2508.12847].

The framework also clarifies why strict parity can be too restrictive. Under the structural conditions that \((S,T)-X-Y\) holds and \(P_{S\mid X}\) is invertible, the paper’s Example 1 shows that perfect parity \(I(Y;S)=0\) implies \(I(X;Y)=0\), and then \(I(T;Y)=0\). In that regime, exact demographic parity forces zero utility. The paper uses this example to motivate bounded rather than perfect parity [2508.12847].

Two numerical examples illustrate the resulting trade-offs. In a quantized-histogram setting derived from grayscale digit images, with a ternary sensitive attribute \(S=f(T)\), the lower bound \(L'_1{}^{r,\epsilon}=H(T\mid S)-H(S\mid T)+\epsilon\) matches the upper bound \(H(T\mid S)+\epsilon\) for \(\epsilon=0.1\), yielding a tight characterization for sufficiently large \(r\). In a noisy typewriter example with \(T\) uniform on \(\{1,\ldots,1000\}\) and a deterministic ternary \(S=f(T)\), the SFRL-based lower bound \(L_2^{r,\epsilon}\) is tighter than \(L_1^{r,\epsilon}\) in the regime \(r\le 2.52\), while \(H(T\mid X)+r\) becomes the active upper bound for \(r\le 1.08\) [2508.12847].

The main conceptual conclusion is explicit in the paper: allowing non-zero leakage enlarges the feasible region and can improve the attained utility. The trade-off curves between \(I(Y;T)\) and \(r\) shift upward as \(\epsilon\) increases [2508.12847].

## 4. Point-wise bounded parity and information geometry

The point-wise formulation imposes fairness locally:
\[
\chi^2(P_{S\mid y};P_S)\le \epsilon^2,\qquad \forall y\in\mathcal Y.
\]
The divergence is defined as a scaled squared Euclidean distance between the posterior vector \(P_{S\mid Y=y}\) and the prior \(P_S\), with scaling by \(1/P_S(s)\). If \(P_{S\mid Y=y}=P_S\), the divergence is zero; larger values indicate greater deviation from statistical parity at output \(y\) [2511.22683].

The paper studies the high-fairness regime in which \(\epsilon\) is small. It parameterizes the posterior as
\[
P_{S\mid Y=y}=P_S+\epsilon J_y,
\]
where \(J_y\) satisfies normalization, marginal consistency, and a unit \(\chi^2\)-norm constraint after scaling. Writing
\[
L_y=[\sqrt{P_S}^{-1}]J_y,
\]
the fairness constraint becomes \(\|L_y\|^2\le 1\), while feasibility also requires \(L_y\perp \sqrt{P_S}\) and \(\sum_y P_yL_y=0\) [2511.22683].

Using local information-geometric approximations, the paper shows that, for small \(\epsilon\), mutual informations can be approximated by quadratic forms. With
\[
W^{T;Y}=[\sqrt{P_T}^{-1}]P_{T\mid X}P_{S\mid X}^{-1}[\sqrt{P_S}],\qquad
W^{X;Y}=[\sqrt{P_X}^{-1}]P_{S\mid X}^{-1}[\sqrt{P_S}],
\]
the approximations are
\[
I(T;Y)\simeq \frac{1}{2}\epsilon^2\sum_y P_y\|W^{T;Y}L_y\|^2,
\qquad
I(X;Y)\simeq \frac{1}{2}\epsilon^2\sum_y P_y\|W^{X;Y}L_y\|^2.
\]
This rewrites the fairness-design problem as a quadratic optimization problem \(P_2\) over the perturbation directions \(L_y\) and output probabilities \(P_y\) [2511.22683].

The spectral structure of the matrices yields closed-form characterizations in important cases. Proposition 3 states that both \(W^{T;Y}\) and \(W^{X;Y}\) have singular value \(1\) with corresponding right singular vector \(\sqrt{P_S}\), and feasibility requires working in the orthogonal complement of that trivial direction. Theorem 2 then gives an explicit SVD-based construction: choose a binary representation \(Y\) with \(P_Y(1)=P_Y(2)=1/2\), select perturbations along the principal feasible singular vector of \(W^{T;Y}\), and scale by a factor \(K\ge 1\) to satisfy the rate constraint. If the unscaled vector satisfies the compression budget, then \(K=1\); otherwise the scaling is
\[
K=\sqrt{\frac{\frac12\epsilon^2\|W^{X;Y}L_\sigma\|^2}{r}}.
\]
For \(|\mathcal S|=2\), the resulting lower bound is tight for the approximated problem [2511.22683].

A numerical example uses \(X,T,S\in\{1,2\}\) with
\[
P_X=\begin{bmatrix}1/4\\ 3/4\end{bmatrix},\quad
P_{S\mid X}=
\begin{bmatrix}
0.275 & 0.32\\
0.725 & 0.68
\end{bmatrix},\quad
P_{T\mid X}=
\begin{bmatrix}
1/4 & 2/5\\
3/4 & 3/5
\end{bmatrix}.
\]
The paper computes
\[
W^{T;Y}=
\begin{bmatrix}
2.4610 & -0.9206\\
-1.1599 & 1.7355
\end{bmatrix},\qquad
W^{X;Y}=
\begin{bmatrix}
-16.7931 & 11.8246\\
-10.3371 & -5.8669
\end{bmatrix},
\]
with singular values \(3.2034\) and \(1\) for \(W^{T;Y}\), and \(23.7087\) and \(1\) for \(W^{X;Y}\). For \(\epsilon\in[0.005,0.05]\) and \(r=0.75\), the paper reports that the quadratic approximation \(P_2\) is very close to the exact optimum \(g^r_{\epsilon,\chi^2}(P_{S,X,T})\) in the high-fairness regime, while the mutual-information formulation \(g^r_\epsilon(P_{S,X,T})\) dominates \(g^r_{\epsilon,\chi^2}(P_{S,X,T})\), as expected from the stronger point-wise constraint [2511.22683].

## 5. Base rates, Equalized Odds, and bounded disparity

In binary classification, statistical parity is usually expressed as
\[
q_1=q_0,\qquad q_s=Pr(\hat Y=1\mid S=s),
\]
while Equalized Odds requires
\[
Pr(\hat Y=1\mid Y=y,S=1)=Pr(\hat Y=1\mid Y=y,S=0),\qquad y\in\{0,1\},
\]
equivalently
\[
FPR_1=FPR_0,\qquad TPR_1=TPR_0.
\]
Base rates are
\[
p_s=Pr(Y=1\mid S=s),
\]
and the relation tying these quantities together is
\[
q_s=p_s\,TPR_s+(1-p_s)\,FPR_s.
\]
This equation is the backbone of the compatibility analysis in the 2026 paper [2601.19035].

Assuming Equalized Odds with common rates \(TPR_\ast\) and \(FPR_\ast\), statistical parity requires
\[
(p_0-p_1)(TPR_\ast-FPR_\ast)=0.
\]
The paper’s Theorem 1 therefore states that EO and SP are simultaneously satisfied either when base rates are balanced, \(p_0=p_1\), or when \(TPR_\ast=FPR_\ast\), which is the ROC chance line associated with a random classifier. Under unequal base rates, exact EO and exact SP are thus jointly feasible only at random-classifier operating points [2601.19035].

The converse direction is geometrically symmetric. If SP is enforced with
\[
q_0=q_1=q_\ast,
\]
then for each group
\[
TPR_s=\Bigl(1-\frac{1}{p_s}\Bigr)FPR_s+\frac{q_\ast}{p_s}.
\]
These are descending lines \(L_0\) and \(L_1\) in the \((FPR,TPR)\) plane. When \(p_0\neq p_1\), the paper’s Theorem 2 states that the lines intersect at \((q_\ast,q_\ast)\), which lies on \(TPR=FPR\). Again, the only exact EO-compatible point under base-rate imbalance is a random classifier [2601.19035].

Although the paper notes that the term “bounded statistical parity” does not appear explicitly, it derives the quantitative structure needed for it. Under EO,
\[
q_1-q_0=(p_1-p_0)(TPR_\ast-FPR_\ast),
\]
so
\[
|q_1-q_0|=|p_1-p_0|\,|TPR_\ast-FPR_\ast|.
\]
Using the paper’s notation, a natural bounded-SP definition is
\[
|q_1-q_0|\le \varepsilon.
\]
In that case, achieving a given \(\varepsilon\) under EO requires
\[
|TPR_\ast-FPR_\ast|\le \frac{\varepsilon}{|p_1-p_0|}.
\]
This makes the trade-off explicit: for fixed base-rate imbalance, tightening the SP bound forces the classifier toward the random line [2601.19035].

The practical guidance in the paper follows directly from these equations. Before enforcing or relying on SP, practitioners should estimate base rates \(p_0,p_1\); if they differ substantially, exact SP and exact EO together imply random guessing. The paper explicitly pleads for examining base-rate imbalance before enforcing or relying on the statistical-parity criterion [2601.19035].

## 6. Interpretation, significance, and limitations

Across these works, bounded statistical parity functions simultaneously as a fairness guarantee and a privacy guarantee. In the mutual-information formulation, it bounds how many bits of information the representation reveals about the sensitive attribute. In the point-wise formulation, it ensures that for every released output, the posterior distribution of sensitive attributes remains close to the population prior. The point-wise paper states this dual interpretation directly: the constraint can be viewed both as a fairness guarantee and as a privacy guarantee [2508.12847] [2511.22683].

The main distinction between the formulations is therefore between global and local control. A mutual-information constraint permits small average leakage, whereas a point-wise \(\chi^2\) constraint rules out mechanisms in which average leakage is small but some outputs are highly revealing. This suggests a hierarchy: global bounded parity is more permissive, while local bounded parity provides a worst-case guarantee over outputs [2511.22683].

The constructive methods also differ. The mutual-information work uses extended FRL and SFRL together with randomized mechanisms to derive upper and lower bounds and to show that non-zero leakage can improve utility [2508.12847]. The point-wise work uses local information geometry to reduce the design problem to a quadratic program and, in important cases, to a low-complexity SVD calculation [2511.22683]. A plausible implication is that the appropriate formalism depends on whether the design goal is average leakage control, per-output robustness, or explicit analysis of trade-offs with base rates and error parity.

Several limitations are stated explicitly. The mutual-information paper assumes discrete random variables \(X,S,T,Y\), although it notes that the results extend to continuous variables via continuous versions of SFRL. It also states that no explicit learning algorithm is provided; the work is information-theoretic and focuses on fundamental limits and constructions rather than neural-network training procedures [2508.12847]. The point-wise paper works in the small-\(\epsilon\) regime, where local approximations of KL divergence and mutual information are valid, and its quadratic approximation is justified under constants depending on \(P_{S\mid X},P_{T\mid X},P_S,P_X,P_T\) [2511.22683]. The EO-compatibility paper works with exact equalities and binary sensitive attributes, labels, and predictions, although its equations motivate approximate or bounded variants [2601.19035].

Taken together, the literature treats bounded statistical parity not as a single metric but as a family of controlled relaxations of demographic parity. In one direction, the relaxation is global and information-theoretic, expressed by \(I(Y;S)\le \epsilon\). In another, it is local and point-wise, expressed by \(\chi^2(P_{S\mid y};P_S)\le \epsilon^2\) for every output. In classification analysis, it also appears as a bounded disparity whose feasible value is constrained by base-rate imbalance and Equalized Odds. The common theme is the replacement of exact independence by a quantitatively specified tolerance that can be analyzed in tandem with utility, compression, and error-rate structure [2508.12847] [2511.22683] [2601.19035].

Source: https://www.emergentmind.com/topics/bounded-statistical-parity