---
title: Bias-Aware Training Techniques
url: https://www.emergentmind.com/topics/bias-aware-training
type: topic
---

# Bias-Aware Training Techniques

Bias aware training is a family of learning procedures in which model fitting is modified to account for systematic distortions in data, labels, annotations, or evaluation targets rather than treating them as ordinary stochastic noise. In the literature covered here, those distortions include unequal true-positive rates across protected groups, label bias and selection bias in historical decision datasets, dataset-specific shifts in Mean Opinion Scores (MOS), presentation bias in recommendation logs, spurious class–attribute correlations in visual data, prior shift between training and deployment prevalence, and systematic error in low-fidelity scientific labels [2203.06317] [2102.03054] [2104.10217] [2104.07360] [2006.13798] [2306.03109]. The resulting methods span objective design, adversarial learning, contrastive representation shaping, sample reweighting, pseudo-label selection, data editing, and multi-stage fine-tuning.

## 1. Sources of bias and formal problem settings

A central distinction in this literature is between biases defined at the level of model error rates and biases defined at the level of data generation. In fairness-oriented classification, the concern is often group-conditional performance disparity: a model may be accurate on average while exhibiting substantially different true-positive rates across protected groups. In historical decision data, bias may originate from biased labels or from biased selection into the observed dataset. Verma et al. explicitly distinguish **label bias** and **selection bias**, and evaluate both **individual discrimination** and **Statistical Parity Difference (SPD)**; under their formulation, similar individuals are defined via a distance $d_x(\cdot,\cdot)$ that ignores the sensitive attribute, and individual discrimination is the fraction of similar pairs assigned different predictions [2102.03054].

A second class of formulations treats bias as distribution shift. Under sampling bias or prior shift, the class prior in the training set, $p_{\mathrm{train}}(y)$, differs from the deployment prior, $p_{\mathrm{test}}(y)$, so a standard cross-entropy model converges to the Bayes-optimal classifier for the training distribution rather than for the test distribution [2006.13798]. Du and Wu instead formulate **sample selection bias** through a selection indicator $s \in \{0,1\}$ and a Missing-At-Random assumption $P(s=1 \mid x,a,y)=P(s=1 \mid x,a)$, which induces instancewise density-ratio corrections and a worst-case fairness problem under uncertainty in those ratios [2105.11570].

A third class concerns structured nuisance factors that systematically alter labels or clicks. In blind quality prediction from multiple subjective datasets, the same file may receive different MOS values across experiments because of **rating noise**, **order-effect**, **corpus-effect**, and **long-term dependencies**; the paper models these as dataset-specific offset and gain distortions [2104.10217]. In personalized news recommendation, click logs are biased by presentation variables such as position and size, so historical clicks are not treated as a direct proxy for user preference [2104.07360]. In Web-sourced image classification, bias may appear as a class-specific attribute that is over-represented for one class; BiasEdit formalizes this through statistical dependence and mutual information between labels and attributes extracted by a pretrained vision–language model [2605.28450].

These formulations imply different intervention points. Some methods alter the loss so that the training objective matches a fairness criterion or deployment distribution. Others alter the representation so protected attributes or nuisance factors are harder to recover. Still others alter the data itself by reweighting, subsampling, editing, or pseudo-label selection. This suggests that “bias aware” is not a single algorithmic template but a design principle tied to the causal or statistical form of the bias under study.

## 2. Objectives aligned with fairness criteria

A recurrent theme is the mismatch between fairness motivations and standard training objectives. For equal opportunity, the criterion is class-conditional equality of true-positive rates. Given inputs $X$, labels $Y \in \{1,\dots,|C|\}$, protected attribute $G \in \mathcal G$, and prediction $\hat Y$, Han et al. define
$$
TPR_{g,y} = Pr[\hat Y = y \mid Y = y, G = g], \qquad
TPR_y = Pr[\hat Y = y \mid Y = y].
$$
They then set $\Delta_{g,y} = |TPR_{g,y}-TPR_y|$, aggregate over groups as $GAP^{TPR}_{G,y} = \sum_{g \in \mathcal G} \Delta_{g,y}$, and define
$$
GAP = \sqrt{\frac{1}{|C|}\sum_{y=1}^{|C|} \left(GAP^{TPR}_{G,y}\right)^2 }.
$$
A perfectly equal-opportunity model satisfies $GAP=0$, and the paper reports “fairness” as $1-GAP$ [2203.06317].

A more direct objective-level treatment is given by Savani et al., who define subgroup- and class-specific cross-entropies $L_{ce}^{y,a}$ and $L_{ce}^{y}$ and augment the ordinary batch loss with penalties that encourage those terms to align. Their class-wise equal-opportunity objective is
$$
L_{eo}^{class}(\theta)
= L_{ce}
+ \lambda \sum_{y=1}^C \sum_{a \in \{0,1\}} |L_{ce}^{y,a} - L_{ce}^{y}|,
$$
while $EO_{global}$ adds an inter-class alignment term based on $|L_{ce}^{y_1}-L_{ce}^{y_2}|$. The paper’s theoretical justification is that, in the binary case, $|L_{ce}^{1,0}-L_{ce}^{1,1}|$ approximates $|-\log TPR_{1,0} - (-\log TPR_{1,1})|$, so minimizing it drives $TPR_{1,0} \approx TPR_{1,1}$ [2205.02393].

Balanced training offers a different proxy. In “Balancing out Bias,” the equal-opportunity objective is implemented by reweighting examples according to the joint distribution of class and protected attribute. In the multi-class case,
$$
L^{EO} = \sum_{y \in Y}\sum_{g \in G} \frac{n_{y,*}}{|G|\,n_{y,g}}\,L_{y,g},
$$
and, at the instance level, each example receives
$$
w_i = \frac{n_{y_i,*}}{|G|\,n_{y_i,g_i}}.
$$
This makes the learning procedure explicitly aware of which $(Y,G)$ cells are under- or over-represented, and the paper also studies down-sampling to a balanced dataset as an alternative realization of the same objective [2109.08253].

Across these approaches, the common move is to replace generic empirical risk minimization by a criterion whose terms can be interpreted in the same conditional regime as the fairness target. This is especially important for equal opportunity, where unconditional invariance can misalign with the intended notion of fairness.

## 3. Adversarial, contrastive, and architecture-level mechanisms

Adversarial training remains one of the standard templates for debiasing, but its target depends on what the discriminator is asked to recover. In the standard encoder–classifier–discriminator setup, the task loss is
$$
L_{task}(\theta_m,\theta_f) = E_{(x,y)}[CE(y, f(m(x;\theta_m);\theta_f))],
$$
the discriminator loss is
$$
L_{disc}(\theta_m,\theta_d) = E_{(x,g)}[CE(g, d(m(x;\theta_m);\theta_d))],
$$
and the minimax problem is
$$
\min_{\theta_m,\theta_f}\max_{\theta_d}\; L_{task}(\theta_m,\theta_f)-\lambda L_{disc}(\theta_m,\theta_d).
$$
Han et al. argue that this standard form enforces $h \perp G$, which corresponds to demographic parity, whereas equal opportunity requires $h \perp G \mid Y$. Their augmented discriminator therefore conditions on the true class via an augmentation layer
$$
h^a = h^s + \sum_{j=1}^{|C|} y_j \cdot h'^j,
$$
with shared and class-specific projectors. The discriminator then approximates $Pr(G \mid h,Y)$, so adversarial unlearning explicitly targets class-conditional bias [2203.06317].

Contrastive learning provides a non-adversarial representation-level alternative. In “Contrastive Learning for Fair Representations,” representations of examples sharing the same task label are pulled together, while representations of examples sharing the same protected attribute are pushed apart. The combined objective is
$$
\mathcal{L}_* = \alpha\,\mathcal{L}_{ce} + \beta\left(\mathcal{L}_{label}-\mathcal{L}_{fcl}\right),
$$
where $\mathcal{L}_{label}$ is a supervised contrastive term over the main label and $\mathcal{L}_{fcl}$ is the analogous term over the protected attribute. The stated effect is to keep label information in focused regions while ensuring the protected attribute has a diverse spread. The paper reports compute overhead of $1.0\times$–$1.9\times$ relative to vanilla cross-entropy, compared with $4\times$–$7\times$ slower adversarial baselines [2109.10645].

Other mechanisms alter the architecture so nuisance factors are explicitly modeled rather than merely suppressed. The Distraction module defines a two-player minimax game in which a submodule is trained through a fairness loss that predicts the sensitive attribute from the model’s own score, while the classifier is optimized for the main task. The final objective is
$$
\min_{\theta_c}\max_{\theta_d}\left\{
L_{\rm cls}(\theta_c,\theta_d)
+\lambda_{\rm bias}L_{\rm dis}(\theta_c,\theta_d)
\right\},
$$
and the method is instantiated on tabular, graph, and vision models [2203.07593]. DebiasRec, in turn, decomposes click score into a preference score $s_p=\mathbf u^\top \mathbf c$ and a bias score $s_b=W_{pb}b+b_{pb}$, and uses only the preference component for ranking at inference time, while user modeling itself is calibrated by bias embeddings derived from position and size [2104.07360].

A related but more localized intervention appears in NER. To mitigate Name Regularity Bias, Ghaddar et al. add learnable adversarial noise to entity mentions through a noise-embedding table indexed by corrupted entity types, train an auxiliary head on noisy labels, and combine this with masking and parameter freezing. The perturbation is injected at the input-embedding level, so the method is model-agnostic across BERT-based and LSTM-CRF NER systems [2107.11610].

## 4. Reweighting, resampling, and data-centric correction

One major branch of bias-aware training estimates which samples, labels, or subsets are unreliable and adjusts their influence accordingly. In ASTEROID, the setting is a large inaccurate dataset $\mathcal D_I$ and a small accurate dataset $\mathcal D_A$. A temporary model trained on $\mathcal D_A$ produces a per-example bias surrogate
$$
B(x_i^n)=\|\nabla_x E(x_i^n;\theta_0)-f_i^n\|_1,
$$
which is converted into a weight
$$
w_i=\exp(-B(x_i^n)/\gamma).
$$
The inaccurate dataset is then used through a weighted loss $\mathcal L_w(\mathcal D_I,\theta)$, after which the model is fine-tuned on $\mathcal D_A$. The paper also provides a score-matching variant for unlabeled inaccurate data [2306.03109].

Under prior shift, a simpler weighting rule suffices. Bayesian Sampling Bias Correction derives a bias-corrected loss from Bayesian risk minimization by setting
$$
w(y)=\frac{p_{\mathrm{test}}(y)}{p_{\mathrm{train}}(y)}
$$
and minimizing the weighted cross-entropy
$$
L_{\mathrm{bias\_corrected}}(\theta)
=
-\mathbb E_{(x,y)\sim p_{\mathrm{train}}}
\left[w(y)\log p(y\mid x;\theta)\right].
$$
The paper emphasizes that minimizing this objective is equivalent to minimizing the KL divergence between the true test-conditional distribution and the model prediction under the test prior, and the same replacement can be made inside the ELBO of a Bayesian neural network [2006.13798].

When selection bias is instance-dependent and density-ratio estimates are uncertain, Du and Wu propose a minimax robust formulation. They define instance weights via $w(x,a)=P(s=1)/\theta(x,a)$ and optimize a worst-case reweighted risk over an $\epsilon$-ball around the estimated selection probabilities, with fairness enforced through a weighted boundary-fairness surrogate. Two algorithms are given: RFLearn¹, when unlabeled test data are available for direct density-ratio estimation, and RFLearn², when they are not and cluster-level ratios are used instead [2105.11570].

Other methods intervene directly on the training set. Verma et al. rank training points by their average influence on “victim” predictions extracted from discriminatory similar pairs, then remove the highest-ranked points until the first local minimum of individual discrimination is reached [2102.03054]. TAB trains a helper ERM model, records per-sample loss histories $h^{(i)} \in \mathbb R^T$, clusters them per class with $k$-means($k=2$), treats the smaller cluster as enriched in bias-conflicting samples, and upsamples it to construct a group-balanced training multiset without group labels or model selection [2409.17691]. DCAST extends self-training by selecting pseudo-labeled samples per class with a diversity constraint based on distances in embedding space, thereby countering confirmation bias while addressing class-aware selection bias [2409.20126]. BiasEdit goes further upstream: it automatically detects unknown bias attributes via statistical dependence and mutual information, edits those attributes with text-guided image editing to generate bias-conflict samples, and then retrains a standard classifier by ordinary empirical risk minimization on the augmented dataset [2605.28450].

These methods differ in whether they require protected attributes, an auxiliary accurate dataset, unlabeled data from the target population, or only the original biased dataset. Their shared principle is that the effective training distribution should be altered to better represent either the intended deployment population or the bias-conflict slices that ordinary ERM underutilizes.

## 5. Domain-specific instantiations

Bias-aware training is not confined to protected-attribute fairness. In image and speech quality prediction, dataset-specific bias is modeled as an affine map applied to the network output for each dataset:
$$
\widetilde y_i = b_0^j + b_1^j \hat y_i,
$$
leading to a bias-aware loss
$$
\mathcal L_{\rm bias}
=
\frac{1}{N}\sum_{i=1}^N
\left(y_i-(b_0^j+b_1^j\hat y_i)\right)^2.
$$
The network weights are optimized by back-propagation, while the per-dataset bias parameters are updated after each epoch by closed-form least squares once the model exceeds a Pearson correlation threshold $r_{\rm th}$ on the training set [2104.10217].

In recommendation, DebiasRec decomposes the problem into a **Bias Representation Module**, a **Bias-Aware User Modeling** module, and a **Bias-Aware Click Prediction** module. Position and size are embedded, their interaction is modeled by element-wise product, and the resulting bias embedding both modulates historical click attention and contributes an additive bias score at training time. At inference, ranking is performed with the content-preference score only, so the deployed ranking signal is explicitly debiased with respect to the logged presentation bias [2104.07360].

In low-data adaptation from a potentially biased pretrained model, “Addressing Bias Through Ensemble Learning and Regularized Fine-Tuning” uses a counter-bias regularizer
$$
R_{\rm bias}(\theta)=\|\theta-\theta^*\|_2^2
$$
inside
$$
L_{\rm total}(\theta;D)=L_{ce}(\theta;D)+\lambda R_{\rm bias}(\theta)+\beta R_2(\theta).
$$
The small dataset is split into biased subsets emphasizing under-represented classes, local models are fine-tuned from $\theta^*$ on those subsets, predictions are aggregated by an ensemble, and the ensemble may be distilled into a single student with a KL-based distillation loss [2402.00910].

Scientific machine learning shows a distinct use of the same principle. ASTEROID treats cheap inaccurate labels as structurally informative but systematically biased, so bias is not removed by filtering them out entirely; instead, their contribution is smoothly down-weighted and then corrected by a small accurate set. This suggests that bias-aware training can be understood not only as fairness mitigation but also as fidelity-aware optimization under heterogeneous supervision [2306.03109].

## 6. Empirical behavior, evaluation practice, and open problems

The empirical literature evaluates bias-aware training with highly heterogeneous metrics. Fairness-oriented NLP and vision papers commonly report accuracy together with equal-opportunity gap $GAP$, true-positive-rate gaps, worst-group accuracy, or leakage of protected attributes from hidden representations or logits [2203.06317] [2109.10645] [2409.17691]. Historical-decision and selection-bias settings often add individual discrimination and SPD [2102.03054]. Quality prediction papers use Pearson correlation coefficient, while force-field papers use MAE and MD stability [2104.10217] [2306.03109]. This measurement diversity reflects different operational definitions of “bias,” and it limits direct cross-paper comparison.

Within equal-opportunity optimization, conditioning the debiasing mechanism on the target class yields consistent gains over unconditional adversarial removal. On Moji under a $\leq 5\%$ accuracy slack, A-Adv improves fairness from $92.92\pm4.08$ to $95.19\pm1.17$ and reduces GAP from $0.327$ to $0.301$ relative to standard adversarial debiasing; on Bios, A-Adv improves fairness from $61.99\pm2.22$ to $63.71\pm2.60$ and reduces GAP from $0.443$ to $0.426$ [2203.06317]. Direct EO objectives also perform strongly: on Moji, $EO_{class}$ attains macro-$F_1=75.0$ with $GAP=10.8$, the best GAP in Table 1, and $EO_{global}$ achieves $75.2/11.5$ [2205.02393]. Contrastive fair representation learning reports on Moji an improvement from CE $(72.1,\ 40.2)$ to $(75.8,\ 13.9)$ in $(\mathrm{Acc},\mathrm{GAP})$, together with lower hidden and logit leakage [2109.10645].

Data-centric approaches also show large empirical effects. Verma et al. report, for $\epsilon=0$, average individual discrimination dropping from $4.7\%$ to $0\%$, test accuracy rising from $81\%$ to $87\%$, and SPD falling from $21\%$ to $13\%$ when training on the debiased subset rather than the full historical data [2102.03054]. TAB improves worst-group accuracy selected by validation accuracy on all listed tasks, for example from $47.0$ to $63.3$ on cMNIST and from $44.9$ to $55.9$ on Waterbirds, while preserving or improving mean accuracy [2409.17691]. DCAST-10 significantly outperforms supervised-biased baselines on all $11$ datasets with neural networks, with average $+6\%$ accuracy, and DCAST-100 adds a $+10\%$ improvement over supervised-biased training on MNIST [2409.20126]. BiasEdit reports Avg accuracy of approximately $94\%$ on Colored MNIST, $81\%$ on BFFHQ, $78\%$ on Dogs & Cats, and $75\%$ on Waterbirds under a fully biased training setting with $0\%$ bias-conflict samples in the original data [2605.28450].

Outside fairness, the same pattern holds. Bias-aware MOS training raises synthetic-set Pearson CC from approximately $0.77$ to approximately $0.93$ when training on biased data, close to the approximately $0.95$ obtained on an unbiased training set, and improves four of five image-quality datasets and five of six speech-quality datasets in leave-one-out evaluation [2104.10217]. ASTEROID, at a cost ratio of $20\times$ cheap:gold, cuts test MAE by approximately $39\%$ for GemNet and approximately $56\%$ for EGNN relative to standard training with the same total budget; with empirical force-field data, bias-aware training reduces GemNet error by $36\%$ and EGNN by $17\%$ [2306.03109]. These results indicate that bias-aware training can improve both robustness and sample efficiency when bias arises from low-fidelity supervision rather than from protected attributes.

Several limitations recur. Some methods are restricted to binary protected attributes, notably the EO objectives of Savani et al. [2205.02393]. Some retain fixed encoders, leaving open whether joint fine-tuning would reduce or reintroduce bias [2205.02393]. Methods based on protected attributes or logged bias variables require those signals to be available and correctly specified, which excludes unknown or unlogged biases [2104.07360] [2109.08253]. DCAST requires unlabeled data that contain the missing support, while TAB trades hyperparameter-free deployment for two full training runs and $O(N\cdot T)$ loss-history storage [2409.20126] [2409.17691]. More broadly, debiasing with respect to one attribute does not guarantee the absence of bias on other attributes or intersections [2205.02393].

Taken together, the literature indicates that bias-aware training is most effective when the intervention matches the structure of the bias: class-conditional objectives for equal opportunity, dataset-specific calibration for annotation shifts, density-ratio weighting for prior or selection shift, representation conditioning for nuisance-feature suppression, and data-centric augmentation or editing when the biased support itself must be changed. This suggests that the main technical question is not whether to perform bias-aware training, but which bias model is sufficiently faithful to justify the resulting optimization.

Source: https://www.emergentmind.com/topics/bias-aware-training