Bounded Statistical Parity: Concepts & Trade-offs
- Bounded statistical parity is a relaxation of demographic parity that limits the dependence between outputs and sensitive attributes via global (mutual information) or local (χ² divergence) constraints.
- It unifies fairness, privacy, and compression by balancing utility trade-offs through controlled leakage bounds in representation learning and classification settings.
- Key methodologies include using extended Functional Representation Lemmas and quadratic approximations to analyze trade-offs with base-rate imbalances and equalized odds.
Bounded statistical parity denotes a relaxation of demographic or statistical parity in which exact independence between an output and a sensitive attribute is replaced by an explicit upper bound on dependence or disparity. In the information-theoretic literature, two formalizations are central: a global leakage budget , which bounds the mutual information between a representation and a sensitive attribute , and a local, point-wise constraint for every realized output , which bounds posterior deviation from the population prior at each output (Zamani et al., 18 Aug 2025, Zamani et al., 27 Nov 2025). In classification settings, the same theme appears as a bounded acceptance-rate disparity, typically of the form , with the achievable bound determined by base-rate imbalance and error-rate structure (Bargh et al., 26 Jan 2026).
1. Definitions and formal variants
Classical statistical parity, also called demographic parity, requires that the algorithm’s output be independent of the sensitive attribute. In a representation-learning formulation this is written as , equivalently , and in a binary prediction setting it is written as
The first form emphasizes distributional independence; the second emphasizes equality of positive prediction rates across groups (Zamani et al., 18 Aug 2025, Bargh et al., 26 Jan 2026).
Bounded statistical parity replaces this exact condition by a controlled relaxation. In the mutual-information formulation,
where 0 is a leakage or fairness budget. The case 1 recovers perfect statistical parity or perfect privacy, while 2 permits small, controlled dependence between 3 and 4 (Zamani et al., 18 Aug 2025). In the point-wise formulation, fairness is enforced for each output realization: 5 This requires the posterior distribution of the sensitive attribute conditioned on a specific output 6 to remain close to the marginal 7 (Zamani et al., 27 Nov 2025).
The two formulations differ in granularity. Mutual information is a global measure of leakage, whereas the point-wise 8 bound controls local posterior deviations for every output. The latter is therefore stronger than an average leakage constraint; the point-wise paper explicitly states that its achievable utility 9 is bounded above by the utility achievable under the mutual-information relaxation 0 (Zamani et al., 27 Nov 2025).
| Formulation | Constraint | Interpretation |
|---|---|---|
| Exact statistical parity | 1 or 2 | Perfect independence |
| Bounded statistical parity | 3 | Global leakage budget |
| Bounded point-wise statistical parity | 4 | Per-output posterior control |
A broader interpretation, stated explicitly in the point-wise work, is that bounded statistical parity refers to imposing an explicit upper bound on deviations from demographic parity rather than requiring exact independence (Zamani et al., 27 Nov 2025).
2. Representation-theoretic problem formulations
The information-theoretic literature studies bounded statistical parity through representation design. The canonical variables are 5 for the sensitive attribute or secret, 6 for useful data, 7 for the task variable, and 8 for the designed representation (Zamani et al., 18 Aug 2025, Zamani et al., 27 Nov 2025).
One formulation allows the encoder to depend on all variables through
9
with no requirement that 0 hold. The optimization problem is
1
Its three terms have fixed roles: 2 is utility, 3 is a compression or encoding-rate constraint, and 4 is the bounded statistical parity or bounded privacy leakage constraint (Zamani et al., 18 Aug 2025).
A second formulation assumes the agent has no direct access to 5 or 6, only to 7. The encoder is then
8
and the Markov chains
9
are imposed. The corresponding optimization problem is
0
Here again, the objective is utility, the rate 1 controls compression, and 2 controls allowed deviation from demographic parity (Zamani et al., 27 Nov 2025).
Both formulations explicitly unify fairness, privacy, and compression. The first paper also states that the problem can be interpreted as one of code design with bounded leakage and bounded rate, treating 3 as a secret and 4 as a codeword whose leakage about 5 and rate with respect to 6 are simultaneously controlled (Zamani et al., 18 Aug 2025).
3. Mutual-information bounded parity
The mutual-information formulation treats bounded statistical parity as a global information budget: 7 This is also a bounded privacy leakage condition, since 8 measures how much information the representation reveals about the sensitive attribute (Zamani et al., 18 Aug 2025).
A central result is the general upper bound
9
The two terms correspond to relaxing one constraint at a time: if only the fairness constraint remains, utility is bounded by 0; if only the rate constraint remains, utility is bounded by 1 (Zamani et al., 18 Aug 2025).
The same paper develops lower bounds using extended versions of the Functional Representation Lemma and the Strong Functional Representation Lemma. The relevant tools are the Extended FRL, which constructs an auxiliary variable 2 satisfying 3 and 4, and the Extended SFRL, which adds a bound on 5 with
6
These extensions support constructive mechanisms based on randomization over 7 or 8 and yield regime-dependent lower bounds such as 9, 0, 1, and 2 (Zamani et al., 18 Aug 2025).
The framework also clarifies why strict parity can be too restrictive. Under the structural conditions that 3 holds and 4 is invertible, the paper’s Example 1 shows that perfect parity 5 implies 6, and then 7. In that regime, exact demographic parity forces zero utility. The paper uses this example to motivate bounded rather than perfect parity (Zamani et al., 18 Aug 2025).
Two numerical examples illustrate the resulting trade-offs. In a quantized-histogram setting derived from grayscale digit images, with a ternary sensitive attribute 8, the lower bound 9 matches the upper bound 0 for 1, yielding a tight characterization for sufficiently large 2. In a noisy typewriter example with 3 uniform on 4 and a deterministic ternary 5, the SFRL-based lower bound 6 is tighter than 7 in the regime 8, while 9 becomes the active upper bound for 0 (Zamani et al., 18 Aug 2025).
The main conceptual conclusion is explicit in the paper: allowing non-zero leakage enlarges the feasible region and can improve the attained utility. The trade-off curves between 1 and 2 shift upward as 3 increases (Zamani et al., 18 Aug 2025).
4. Point-wise bounded parity and information geometry
The point-wise formulation imposes fairness locally: 4 The divergence is defined as a scaled squared Euclidean distance between the posterior vector 5 and the prior 6, with scaling by 7. If 8, the divergence is zero; larger values indicate greater deviation from statistical parity at output 9 (Zamani et al., 27 Nov 2025).
The paper studies the high-fairness regime in which 0 is small. It parameterizes the posterior as
1
where 2 satisfies normalization, marginal consistency, and a unit 3-norm constraint after scaling. Writing
4
the fairness constraint becomes 5, while feasibility also requires 6 and 7 (Zamani et al., 27 Nov 2025).
Using local information-geometric approximations, the paper shows that, for small 8, mutual informations can be approximated by quadratic forms. With
9
the approximations are
00
This rewrites the fairness-design problem as a quadratic optimization problem 01 over the perturbation directions 02 and output probabilities 03 (Zamani et al., 27 Nov 2025).
The spectral structure of the matrices yields closed-form characterizations in important cases. Proposition 3 states that both 04 and 05 have singular value 06 with corresponding right singular vector 07, and feasibility requires working in the orthogonal complement of that trivial direction. Theorem 2 then gives an explicit SVD-based construction: choose a binary representation 08 with 09, select perturbations along the principal feasible singular vector of 10, and scale by a factor 11 to satisfy the rate constraint. If the unscaled vector satisfies the compression budget, then 12; otherwise the scaling is
13
For 14, the resulting lower bound is tight for the approximated problem (Zamani et al., 27 Nov 2025).
A numerical example uses 15 with
16
The paper computes
17
with singular values 18 and 19 for 20, and 21 and 22 for 23. For 24 and 25, the paper reports that the quadratic approximation 26 is very close to the exact optimum 27 in the high-fairness regime, while the mutual-information formulation 28 dominates 29, as expected from the stronger point-wise constraint (Zamani et al., 27 Nov 2025).
5. Base rates, Equalized Odds, and bounded disparity
In binary classification, statistical parity is usually expressed as
30
while Equalized Odds requires
31
equivalently
32
Base rates are
33
and the relation tying these quantities together is
34
This equation is the backbone of the compatibility analysis in the 2026 paper (Bargh et al., 26 Jan 2026).
Assuming Equalized Odds with common rates 35 and 36, statistical parity requires
37
The paper’s Theorem 1 therefore states that EO and SP are simultaneously satisfied either when base rates are balanced, 38, or when 39, which is the ROC chance line associated with a random classifier. Under unequal base rates, exact EO and exact SP are thus jointly feasible only at random-classifier operating points (Bargh et al., 26 Jan 2026).
The converse direction is geometrically symmetric. If SP is enforced with
40
then for each group
41
These are descending lines 42 and 43 in the 44 plane. When 45, the paper’s Theorem 2 states that the lines intersect at 46, which lies on 47. Again, the only exact EO-compatible point under base-rate imbalance is a random classifier (Bargh et al., 26 Jan 2026).
Although the paper notes that the term “bounded statistical parity” does not appear explicitly, it derives the quantitative structure needed for it. Under EO,
48
so
49
Using the paper’s notation, a natural bounded-SP definition is
50
In that case, achieving a given 51 under EO requires
52
This makes the trade-off explicit: for fixed base-rate imbalance, tightening the SP bound forces the classifier toward the random line (Bargh et al., 26 Jan 2026).
The practical guidance in the paper follows directly from these equations. Before enforcing or relying on SP, practitioners should estimate base rates 53; if they differ substantially, exact SP and exact EO together imply random guessing. The paper explicitly pleads for examining base-rate imbalance before enforcing or relying on the statistical-parity criterion (Bargh et al., 26 Jan 2026).
6. Interpretation, significance, and limitations
Across these works, bounded statistical parity functions simultaneously as a fairness guarantee and a privacy guarantee. In the mutual-information formulation, it bounds how many bits of information the representation reveals about the sensitive attribute. In the point-wise formulation, it ensures that for every released output, the posterior distribution of sensitive attributes remains close to the population prior. The point-wise paper states this dual interpretation directly: the constraint can be viewed both as a fairness guarantee and as a privacy guarantee (Zamani et al., 18 Aug 2025, Zamani et al., 27 Nov 2025).
The main distinction between the formulations is therefore between global and local control. A mutual-information constraint permits small average leakage, whereas a point-wise 54 constraint rules out mechanisms in which average leakage is small but some outputs are highly revealing. This suggests a hierarchy: global bounded parity is more permissive, while local bounded parity provides a worst-case guarantee over outputs (Zamani et al., 27 Nov 2025).
The constructive methods also differ. The mutual-information work uses extended FRL and SFRL together with randomized mechanisms to derive upper and lower bounds and to show that non-zero leakage can improve utility (Zamani et al., 18 Aug 2025). The point-wise work uses local information geometry to reduce the design problem to a quadratic program and, in important cases, to a low-complexity SVD calculation (Zamani et al., 27 Nov 2025). A plausible implication is that the appropriate formalism depends on whether the design goal is average leakage control, per-output robustness, or explicit analysis of trade-offs with base rates and error parity.
Several limitations are stated explicitly. The mutual-information paper assumes discrete random variables 55, although it notes that the results extend to continuous variables via continuous versions of SFRL. It also states that no explicit learning algorithm is provided; the work is information-theoretic and focuses on fundamental limits and constructions rather than neural-network training procedures (Zamani et al., 18 Aug 2025). The point-wise paper works in the small-56 regime, where local approximations of KL divergence and mutual information are valid, and its quadratic approximation is justified under constants depending on 57 (Zamani et al., 27 Nov 2025). The EO-compatibility paper works with exact equalities and binary sensitive attributes, labels, and predictions, although its equations motivate approximate or bounded variants (Bargh et al., 26 Jan 2026).
Taken together, the literature treats bounded statistical parity not as a single metric but as a family of controlled relaxations of demographic parity. In one direction, the relaxation is global and information-theoretic, expressed by 58. In another, it is local and point-wise, expressed by 59 for every output. In classification analysis, it also appears as a bounded disparity whose feasible value is constrained by base-rate imbalance and Equalized Odds. The common theme is the replacement of exact independence by a quantitatively specified tolerance that can be analyzed in tandem with utility, compression, and error-rate structure (Zamani et al., 18 Aug 2025, Zamani et al., 27 Nov 2025, Bargh et al., 26 Jan 2026).