---
title: Tie-Augmented Bradley–Terry Model
url: https://www.emergentmind.com/topics/tie-augmented-bradley-terry-model
type: topic
---

# Tie-Augmented Bradley–Terry Model

The tie-augmented Bradley–Terry model generalizes the classical paired-comparison framework to account for the empirically observed phenomenon that some comparisons are legitimately ambiguous or indistinguishable, resulting in ties. This framework extends the two-outcome (win/loss) Bradley–Terry model to three (win, loss, tie), providing a more accurate and information-preserving probabilistic model for pairwise data arising in sports, psychometrics, policy evaluation, machine learning preference aggregation, and other domains. Multiple parameterizations exist—including the Rao–Kupper and Davidson models—each specifying different mechanisms for tie-propensity, and diverse estimation strategies ranging from MM/EM algorithms and Bayesian inference to quasi-likelihood U-statistic approaches.

## 1. Mathematical Formulation and Tie-Probability Parameterizations

The classical Bradley–Terry model posits for items $i$ and $j$ with strengths $\lambda_i$, $\lambda_j > 0$:
$$
P(i \succ j) = \frac{\lambda_i}{\lambda_i + \lambda_j}
$$
Admitting ties, several parameterizations are used:

**Rao–Kupper model:** Introduces a tie-parameter $\theta > 1$ governing discrimination:
\[
\begin{align*}
P(i \succ j) &= \frac{\lambda_i}{\lambda_i + \theta\lambda_j} \\
P(j \succ i) &= \frac{\lambda_j}{\theta\lambda_i + \lambda_j} \\
P(i \equiv j) &= \frac{(\theta^2-1) \lambda_i\lambda_j}{(\lambda_i+\theta\lambda_j)(\theta\lambda_i+\lambda_j)}
\end{align*}
\]
[2405.13399, 1411.1168, 1011.1761, 1901.00150]

**Davidson model:** Uses a geometric mean for tie propensity, with tie-parameter $\nu \geq 0$:
\[
\begin{align*}
P(i \succ j) &= \frac{\lambda_i}{\lambda_i + \lambda_j + \nu\sqrt{\lambda_i\lambda_j}} \\
P(j \succ i) &= \frac{\lambda_j}{\lambda_i + \lambda_j + \nu\sqrt{\lambda_i\lambda_j}} \\
P(i \equiv j) &= \frac{\nu\sqrt{\lambda_i\lambda_j}}{\lambda_i+\lambda_j+\nu\sqrt{\lambda_i\lambda_j}}
\end{align*}
\]
[1411.1168, 2409.17431]

**BTT “symmetric tie” form (used in RLHF):** Three unnormalized potentials, where tie propensity is parameterized via $2e^{(\theta_i+\theta_j)/2}$:
\[
\begin{align*}
P(i \succ j) &= \frac{e^{\theta_i}}{e^{\theta_i} + e^{\theta_j} + 2e^{(\theta_i+\theta_j)/2}} \\
P(i = j) &= \frac{2e^{(\theta_i+\theta_j)/2}}{e^{\theta_i} + e^{\theta_j} + 2e^{(\theta_i+\theta_j)/2}} \\
P(i \prec j) &= \frac{e^{\theta_j}}{e^{\theta_i} + e^{\theta_j} + 2e^{(\theta_i+\theta_j)/2}}
\end{align*}
\]
[2410.05328]

Further generalizations include strength-dependent tie-propensities and explicit modeling of order effects (such as home-field advantage), as in extensions for chess or sports [2505.24783, 2112.01267].

## 2. Likelihoods, Identifiability, and Existence of Estimates

Given counts of wins, losses, and ties $(a_{ij}, a_{ji}, t_{ij})$ for unordered pairs, the log-likelihood (Rao–Kupper) is
\[
\ell(\lambda, \theta) = \sum_{i<j} \left[ a_{ij} \log P(i \succ j) + a_{ji} \log P(j \succ i) + t_{ij} \log P(i \equiv j) \right]
\]
Identifiability is ensured by constraints such as $\sum_i \log \lambda_i=0$ or fixing one $\lambda_i$. For Davidson-type models, $\nu$ must be determined from at least one observed tie; otherwise, the tie parameter remains unconstrained [1411.1168].

Problems of nonuniqueness or nonexistence in sparse data are mitigated by $\varepsilon$-perturbation (adding small positive counts to existing pairwise outcomes), replacing the strong connectivity requirement of the win-loss digraph by weak connectivity of the undirected comparison graph. Under this, and with at least one tie, strict log-likelihood concavity ensures unique MLEs for both principal tie models [1411.1168].

## 3. Estimation Algorithms: MM, EM, and Bayesian Methods

**Minorization-Maximization (MM) and Expectation-Maximization (EM):** For Rao–Kupper and Davidson models, MM and EM coincide; the surrogate likelihood is constructed by exploiting convexity, allowing closed-form or one-dimensional updates for strengths and tie parameters [1011.1761, 1901.00150].

**Accelerated MM:** Parameter rescaling ensures uniform PL (Polyak–Łojasiewicz) condition even when the tie parameter or prior becomes small, resulting in provably linear convergence, outperforming basic MM in ill-conditioned cases [1901.00150].

**Bayesian inference:** Gibbs samplers are constructed via latent variable augmentation, e.g., Gamma or Pólya–Gamma variables, allowing efficient updates for strengths and ties. The full posterior (with proper priors) facilitates credible intervals and uncertainty quantification. For high-dimensional or structured problems (e.g., spatial priors), block Gibbs sampling and latent variable augmentation remain scalable [2405.13399, 1011.1761].

**Sampling Details Table:** (Algorithms for Rao–Kupper/Davidson models)

| Step                     | Method                 | Notes                                          |
|--------------------------|------------------------|------------------------------------------------|
| Strength update          | Closed-form/Gibbs      | EM/MM (analytic), Bayesian (Gaussian/Gamma)    |
| Tie-parameter update     | 1D root-finding, MH/Gibbs | Surrogate maximization or latent variable      |
| Scaling/centering        | Affine normalization   | Ensures identifiability                        |

## 4. Model Generalizations and Extensions

**Order effects and strength-dependent ties:** In chess and some sports, tie rates and first-mover or home advantage are empirically found to be higher among stronger players. Models thus generalize tie propensities as $\tau_{ij} = \exp(\beta_0 + (1+\beta_1)(\theta_i + \theta_j)/2)$, and order-effects with $\alpha_0 + \alpha_1(\theta_i+\theta_j)/2$ [2505.24783].

**Multiple outcomes:** Extension to more than three outcomes (e.g., regulation, overtime, shootout in hockey) is accomplished by modeling outcome probabilities as multinomial softmaxes, with fractional points as exponents, calibrated to reproduce league standings and observed margins [2112.01267].

**Preference learning (RLHF/DPO):** In RLHF and Direct Preference Optimization, integrating tie-aware models (Rao–Kupper, Davidson, BTT) into loss functions allows the learning signal from tied (ambiguous) pairs to regularize model behavior, improve calibration, and reduce bias in reward estimates [2410.05328, 2409.17431].

## 5. Theoretical Properties and Implications

Omitting ties and treating them as random results biases preference-strength estimates toward zero; this attenuation grows with the tie-parameter [2410.05328]. Analytic expressions quantify this shrinkage. Tie-augmented models are theoretically guaranteed to assign KL-regularized, less-extreme margins to ambiguous pairs, preventing overfitting and improving out-of-sample consistency—critical for preference learning where ambiguous or adversarial comparisons are common [2409.17431].

Quasi-likelihood frameworks embed ties within unbiased U-statistics for the Kemeny correlation, offering strictly unbiased, analytic estimators, Edgeworth corrections, and concentration bounds independent of parametric assumptions [2512.24009].

## 6. Computational Scalability and Practical Implementation

Pólya–Gamma augmentation yields block-conjugate updates for strength vectors, allowing $O(N^3)$ (or less, with sparsity/exploiting structure) solves per MCMC iteration [2405.13399]. EM/MM and Gibbs schemes for moderate $N$ (dozens to thousands) are tractable in practice, with acceleration stratagems applicable for slow-mixing or high-dimensional settings [1011.1761, 1901.00150].

Out-of-the-box Hamiltonian Monte Carlo (e.g., via Stan) is effective for joint strength-tie inference, given the twice-differentiable, strictly concave posterior [2112.01267]. In practical use cases (e.g., hundreds of entities, thousands of comparisons), convergence diagnostics and effective sample size per second favor Pólya–Gamma over naive random walk Metropolis samplers [2405.13399].

## 7. Empirical Performance, Application Domains, and Guidelines

Tie-augmented Bradley–Terry models have shown improved fit and calibration in competitive sports (NFL, chess, hockey), psychometrics, and RLHF reward modeling. For instance, in community-level abuse mapping, tie probabilities around 0.14–0.19 (for equal-strength units) were inferred, with efficient, scalable MCMC sampling demonstrated in real field data [2405.13399].

In preference optimization, inclusion of ties with proper modeling yields stronger regularization and improved generalization; empirical metrics (summarization, translation) confirm that vanilla preference models degrade with ties, while tie-augmented variants regain or exceed baseline performance, matching real-world ambiguity [2409.17431, 2410.05328].

**Practical recommendations:**
- Do not discard tied comparisons; use tie-parameterized models and optimize both strength and tie parameters.
- Set the tie-sensitivity parameter (e.g., $\nu=3$ so that tie-probability at zero margin is 50%) for robust, interpretable results [2409.17431].
- Enforce identifiability via centering or affine constraints at each iteration.

**Conclusion:**  
The tie-augmented Bradley–Terry model, via principled parameterizations (Rao–Kupper, Davidson, BTT, and their generalizations), robust estimation strategies, and scalable inference procedures, provides a statistically rigorous and practically indispensable framework for modern applications in ranking, preference learning, and paired-comparison studies where ties are an intrinsic phenomenon.

Source: https://www.emergentmind.com/topics/tie-augmented-bradley-terry-model