Papers
Topics
Authors
Recent
Search
2000 character limit reached

Bounded Statistical Parity: Concepts & Trade-offs

Updated 8 July 2026
  • Bounded statistical parity is a relaxation of demographic parity that limits the dependence between outputs and sensitive attributes via global (mutual information) or local (χ² divergence) constraints.
  • It unifies fairness, privacy, and compression by balancing utility trade-offs through controlled leakage bounds in representation learning and classification settings.
  • Key methodologies include using extended Functional Representation Lemmas and quadratic approximations to analyze trade-offs with base-rate imbalances and equalized odds.

Bounded statistical parity denotes a relaxation of demographic or statistical parity in which exact independence between an output and a sensitive attribute is replaced by an explicit upper bound on dependence or disparity. In the information-theoretic literature, two formalizations are central: a global leakage budget I(Y;S)ϵI(Y;S)\le \epsilon, which bounds the mutual information between a representation YY and a sensitive attribute SS, and a local, point-wise constraint χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^2 for every realized output yy, which bounds posterior deviation from the population prior at each output (Zamani et al., 18 Aug 2025, Zamani et al., 27 Nov 2025). In classification settings, the same theme appears as a bounded acceptance-rate disparity, typically of the form Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon, with the achievable bound determined by base-rate imbalance and error-rate structure (Bargh et al., 26 Jan 2026).

1. Definitions and formal variants

Classical statistical parity, also called demographic parity, requires that the algorithm’s output be independent of the sensitive attribute. In a representation-learning formulation this is written as YSY\perp S, equivalently I(Y;S)=0I(Y;S)=0, and in a binary prediction setting it is written as

Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).

The first form emphasizes distributional independence; the second emphasizes equality of positive prediction rates across groups (Zamani et al., 18 Aug 2025, Bargh et al., 26 Jan 2026).

Bounded statistical parity replaces this exact condition by a controlled relaxation. In the mutual-information formulation,

I(Y;S)ϵ,I(Y;S)\le \epsilon,

where YY0 is a leakage or fairness budget. The case YY1 recovers perfect statistical parity or perfect privacy, while YY2 permits small, controlled dependence between YY3 and YY4 (Zamani et al., 18 Aug 2025). In the point-wise formulation, fairness is enforced for each output realization: YY5 This requires the posterior distribution of the sensitive attribute conditioned on a specific output YY6 to remain close to the marginal YY7 (Zamani et al., 27 Nov 2025).

The two formulations differ in granularity. Mutual information is a global measure of leakage, whereas the point-wise YY8 bound controls local posterior deviations for every output. The latter is therefore stronger than an average leakage constraint; the point-wise paper explicitly states that its achievable utility YY9 is bounded above by the utility achievable under the mutual-information relaxation SS0 (Zamani et al., 27 Nov 2025).

Formulation Constraint Interpretation
Exact statistical parity SS1 or SS2 Perfect independence
Bounded statistical parity SS3 Global leakage budget
Bounded point-wise statistical parity SS4 Per-output posterior control

A broader interpretation, stated explicitly in the point-wise work, is that bounded statistical parity refers to imposing an explicit upper bound on deviations from demographic parity rather than requiring exact independence (Zamani et al., 27 Nov 2025).

2. Representation-theoretic problem formulations

The information-theoretic literature studies bounded statistical parity through representation design. The canonical variables are SS5 for the sensitive attribute or secret, SS6 for useful data, SS7 for the task variable, and SS8 for the designed representation (Zamani et al., 18 Aug 2025, Zamani et al., 27 Nov 2025).

One formulation allows the encoder to depend on all variables through

SS9

with no requirement that χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^20 hold. The optimization problem is

χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^21

Its three terms have fixed roles: χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^22 is utility, χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^23 is a compression or encoding-rate constraint, and χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^24 is the bounded statistical parity or bounded privacy leakage constraint (Zamani et al., 18 Aug 2025).

A second formulation assumes the agent has no direct access to χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^25 or χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^26, only to χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^27. The encoder is then

χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^28

and the Markov chains

χ2(PSY=y;PS)ϵ2\chi^2(P_{S\mid Y=y};P_S)\le \epsilon^29

are imposed. The corresponding optimization problem is

yy0

Here again, the objective is utility, the rate yy1 controls compression, and yy2 controls allowed deviation from demographic parity (Zamani et al., 27 Nov 2025).

Both formulations explicitly unify fairness, privacy, and compression. The first paper also states that the problem can be interpreted as one of code design with bounded leakage and bounded rate, treating yy3 as a secret and yy4 as a codeword whose leakage about yy5 and rate with respect to yy6 are simultaneously controlled (Zamani et al., 18 Aug 2025).

3. Mutual-information bounded parity

The mutual-information formulation treats bounded statistical parity as a global information budget: yy7 This is also a bounded privacy leakage condition, since yy8 measures how much information the representation reveals about the sensitive attribute (Zamani et al., 18 Aug 2025).

A central result is the general upper bound

yy9

The two terms correspond to relaxing one constraint at a time: if only the fairness constraint remains, utility is bounded by Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon0; if only the rate constraint remains, utility is bounded by Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon1 (Zamani et al., 18 Aug 2025).

The same paper develops lower bounds using extended versions of the Functional Representation Lemma and the Strong Functional Representation Lemma. The relevant tools are the Extended FRL, which constructs an auxiliary variable Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon2 satisfying Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon3 and Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon4, and the Extended SFRL, which adds a bound on Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon5 with

Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon6

These extensions support constructive mechanisms based on randomization over Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon7 or Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon8 and yield regime-dependent lower bounds such as Pr(Y^=1S=1)Pr(Y^=1S=0)ε|Pr(\hat Y=1\mid S=1)-Pr(\hat Y=1\mid S=0)|\le \varepsilon9, YSY\perp S0, YSY\perp S1, and YSY\perp S2 (Zamani et al., 18 Aug 2025).

The framework also clarifies why strict parity can be too restrictive. Under the structural conditions that YSY\perp S3 holds and YSY\perp S4 is invertible, the paper’s Example 1 shows that perfect parity YSY\perp S5 implies YSY\perp S6, and then YSY\perp S7. In that regime, exact demographic parity forces zero utility. The paper uses this example to motivate bounded rather than perfect parity (Zamani et al., 18 Aug 2025).

Two numerical examples illustrate the resulting trade-offs. In a quantized-histogram setting derived from grayscale digit images, with a ternary sensitive attribute YSY\perp S8, the lower bound YSY\perp S9 matches the upper bound I(Y;S)=0I(Y;S)=00 for I(Y;S)=0I(Y;S)=01, yielding a tight characterization for sufficiently large I(Y;S)=0I(Y;S)=02. In a noisy typewriter example with I(Y;S)=0I(Y;S)=03 uniform on I(Y;S)=0I(Y;S)=04 and a deterministic ternary I(Y;S)=0I(Y;S)=05, the SFRL-based lower bound I(Y;S)=0I(Y;S)=06 is tighter than I(Y;S)=0I(Y;S)=07 in the regime I(Y;S)=0I(Y;S)=08, while I(Y;S)=0I(Y;S)=09 becomes the active upper bound for Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).0 (Zamani et al., 18 Aug 2025).

The main conceptual conclusion is explicit in the paper: allowing non-zero leakage enlarges the feasible region and can improve the attained utility. The trade-off curves between Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).1 and Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).2 shift upward as Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).3 increases (Zamani et al., 18 Aug 2025).

4. Point-wise bounded parity and information geometry

The point-wise formulation imposes fairness locally: Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).4 The divergence is defined as a scaled squared Euclidean distance between the posterior vector Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).5 and the prior Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).6, with scaling by Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).7. If Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).8, the divergence is zero; larger values indicate greater deviation from statistical parity at output Pr(Y^=1S=1)=Pr(Y^=1S=0).Pr(\hat Y=1\mid S=1)=Pr(\hat Y=1\mid S=0).9 (Zamani et al., 27 Nov 2025).

The paper studies the high-fairness regime in which I(Y;S)ϵ,I(Y;S)\le \epsilon,0 is small. It parameterizes the posterior as

I(Y;S)ϵ,I(Y;S)\le \epsilon,1

where I(Y;S)ϵ,I(Y;S)\le \epsilon,2 satisfies normalization, marginal consistency, and a unit I(Y;S)ϵ,I(Y;S)\le \epsilon,3-norm constraint after scaling. Writing

I(Y;S)ϵ,I(Y;S)\le \epsilon,4

the fairness constraint becomes I(Y;S)ϵ,I(Y;S)\le \epsilon,5, while feasibility also requires I(Y;S)ϵ,I(Y;S)\le \epsilon,6 and I(Y;S)ϵ,I(Y;S)\le \epsilon,7 (Zamani et al., 27 Nov 2025).

Using local information-geometric approximations, the paper shows that, for small I(Y;S)ϵ,I(Y;S)\le \epsilon,8, mutual informations can be approximated by quadratic forms. With

I(Y;S)ϵ,I(Y;S)\le \epsilon,9

the approximations are

YY00

This rewrites the fairness-design problem as a quadratic optimization problem YY01 over the perturbation directions YY02 and output probabilities YY03 (Zamani et al., 27 Nov 2025).

The spectral structure of the matrices yields closed-form characterizations in important cases. Proposition 3 states that both YY04 and YY05 have singular value YY06 with corresponding right singular vector YY07, and feasibility requires working in the orthogonal complement of that trivial direction. Theorem 2 then gives an explicit SVD-based construction: choose a binary representation YY08 with YY09, select perturbations along the principal feasible singular vector of YY10, and scale by a factor YY11 to satisfy the rate constraint. If the unscaled vector satisfies the compression budget, then YY12; otherwise the scaling is

YY13

For YY14, the resulting lower bound is tight for the approximated problem (Zamani et al., 27 Nov 2025).

A numerical example uses YY15 with

YY16

The paper computes

YY17

with singular values YY18 and YY19 for YY20, and YY21 and YY22 for YY23. For YY24 and YY25, the paper reports that the quadratic approximation YY26 is very close to the exact optimum YY27 in the high-fairness regime, while the mutual-information formulation YY28 dominates YY29, as expected from the stronger point-wise constraint (Zamani et al., 27 Nov 2025).

5. Base rates, Equalized Odds, and bounded disparity

In binary classification, statistical parity is usually expressed as

YY30

while Equalized Odds requires

YY31

equivalently

YY32

Base rates are

YY33

and the relation tying these quantities together is

YY34

This equation is the backbone of the compatibility analysis in the 2026 paper (Bargh et al., 26 Jan 2026).

Assuming Equalized Odds with common rates YY35 and YY36, statistical parity requires

YY37

The paper’s Theorem 1 therefore states that EO and SP are simultaneously satisfied either when base rates are balanced, YY38, or when YY39, which is the ROC chance line associated with a random classifier. Under unequal base rates, exact EO and exact SP are thus jointly feasible only at random-classifier operating points (Bargh et al., 26 Jan 2026).

The converse direction is geometrically symmetric. If SP is enforced with

YY40

then for each group

YY41

These are descending lines YY42 and YY43 in the YY44 plane. When YY45, the paper’s Theorem 2 states that the lines intersect at YY46, which lies on YY47. Again, the only exact EO-compatible point under base-rate imbalance is a random classifier (Bargh et al., 26 Jan 2026).

Although the paper notes that the term “bounded statistical parity” does not appear explicitly, it derives the quantitative structure needed for it. Under EO,

YY48

so

YY49

Using the paper’s notation, a natural bounded-SP definition is

YY50

In that case, achieving a given YY51 under EO requires

YY52

This makes the trade-off explicit: for fixed base-rate imbalance, tightening the SP bound forces the classifier toward the random line (Bargh et al., 26 Jan 2026).

The practical guidance in the paper follows directly from these equations. Before enforcing or relying on SP, practitioners should estimate base rates YY53; if they differ substantially, exact SP and exact EO together imply random guessing. The paper explicitly pleads for examining base-rate imbalance before enforcing or relying on the statistical-parity criterion (Bargh et al., 26 Jan 2026).

6. Interpretation, significance, and limitations

Across these works, bounded statistical parity functions simultaneously as a fairness guarantee and a privacy guarantee. In the mutual-information formulation, it bounds how many bits of information the representation reveals about the sensitive attribute. In the point-wise formulation, it ensures that for every released output, the posterior distribution of sensitive attributes remains close to the population prior. The point-wise paper states this dual interpretation directly: the constraint can be viewed both as a fairness guarantee and as a privacy guarantee (Zamani et al., 18 Aug 2025, Zamani et al., 27 Nov 2025).

The main distinction between the formulations is therefore between global and local control. A mutual-information constraint permits small average leakage, whereas a point-wise YY54 constraint rules out mechanisms in which average leakage is small but some outputs are highly revealing. This suggests a hierarchy: global bounded parity is more permissive, while local bounded parity provides a worst-case guarantee over outputs (Zamani et al., 27 Nov 2025).

The constructive methods also differ. The mutual-information work uses extended FRL and SFRL together with randomized mechanisms to derive upper and lower bounds and to show that non-zero leakage can improve utility (Zamani et al., 18 Aug 2025). The point-wise work uses local information geometry to reduce the design problem to a quadratic program and, in important cases, to a low-complexity SVD calculation (Zamani et al., 27 Nov 2025). A plausible implication is that the appropriate formalism depends on whether the design goal is average leakage control, per-output robustness, or explicit analysis of trade-offs with base rates and error parity.

Several limitations are stated explicitly. The mutual-information paper assumes discrete random variables YY55, although it notes that the results extend to continuous variables via continuous versions of SFRL. It also states that no explicit learning algorithm is provided; the work is information-theoretic and focuses on fundamental limits and constructions rather than neural-network training procedures (Zamani et al., 18 Aug 2025). The point-wise paper works in the small-YY56 regime, where local approximations of KL divergence and mutual information are valid, and its quadratic approximation is justified under constants depending on YY57 (Zamani et al., 27 Nov 2025). The EO-compatibility paper works with exact equalities and binary sensitive attributes, labels, and predictions, although its equations motivate approximate or bounded variants (Bargh et al., 26 Jan 2026).

Taken together, the literature treats bounded statistical parity not as a single metric but as a family of controlled relaxations of demographic parity. In one direction, the relaxation is global and information-theoretic, expressed by YY58. In another, it is local and point-wise, expressed by YY59 for every output. In classification analysis, it also appears as a bounded disparity whose feasible value is constrained by base-rate imbalance and Equalized Odds. The common theme is the replacement of exact independence by a quantitatively specified tolerance that can be analyzed in tandem with utility, compression, and error-rate structure (Zamani et al., 18 Aug 2025, Zamani et al., 27 Nov 2025, Bargh et al., 26 Jan 2026).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Bounded Statistical Parity.