---
title: Binary Quadratic Problems (BQP)
url: https://www.emergentmind.com/topics/binary-quadratic-problems-bqp
type: topic
---

# Binary Quadratic Problems (BQP)

A Binary Quadratic Problem (BQP) is a discrete optimization problem whose variables are binary and whose objective includes quadratic (i.e., bilinear) terms. BQPs provide a powerful modeling backbone for a wide array of NP-hard combinatorial optimization problems, including assignment, partitioning, graph-based tasks, and emerging applications in machine learning and quantum computing. The core challenge is the intersection of binary combinatorics with nonconvex quadratic structure, which induces both theoretical hardness and distinctive algorithmic phenomena.

## 1. Formal Definition and General Modeling Structure

A general BQP can be expressed as:

\[
\min_{x \in \{0,1\}^n} \; x^\top Q x + c^\top x, \quad \text{subject to} \quad A x = b, \quad C x + D y \geq e, \quad y_{ij} = x_i x_j \;\forall (i,j) \in P,
\]

where $Q\in\mathbb{R}^{n\times n}$ is symmetric, $c\in\mathbb{R}^n$, constraints can include linear equations and inequalities, and $y_{ij}$ represent bilinear products introduced through linearization. This framework subsumes classical unconstrained BQPs ($A, C, D$ absent), as well as linearly constrained (mixed-integer) variants. Nonlinearity is entirely driven by the $x_i x_j$ terms, with binary $x_i$ enforcing combinatorial structure [1712.05872].

Specific instances such as the unconstrained binary quadratic problem (UBQP):

\[
\max_{x \in \{0,1\}^n} x^\top Q x
\]

or the bipartite and multi-quadratic generalizations, are recurring formulations in combinatorial optimization and machine learning [1709.07511, 1210.3684].

## 2. Classical and Modern Linearization Schemes

Quadratic terms in BQP prevent direct usage of linear integer programming techniques. Linearization, the process of replacing products $x_i x_j$ with continuous variables $y_{ij}$ along with linking constraints, is essential.

### 2.1 Glover–Woolsey (McCormick) Linearization

For each $(i,j)$:

\[
y_{ij} \leq x_i, \quad y_{ij} \leq x_j, \quad y_{ij} \geq x_i + x_j - 1, \quad y_{ij} \geq 0.
\]

Applied naively, this requires $3|P|$ constraints, leading to substantial growth in model size and often weak relaxations [1712.05872].

### 2.2 Compact Linearization

Compact linearization leverages existing linear equations with positive coefficients to eliminate redundant constraints. For an equation $\sum_{i \in A_k} a^k_i x_i = b^k$ and multipliers $B_k \subseteq N$, multiplying both sides by $x_j, j \in B_k,$ gives tailored equality constraints on $y_{ij}$:

\[
\sum_{i\in A_k} a^k_i y_{ij} = b^k x_j,
\]

collectively ensuring $y_{ij} = x_i x_j$ under appropriate covering conditions (C1–C2) [1712.05872]. In assignment-structured problems and certain combinatorial designs, this scheme yields provably at-least-as-strong relaxations as the standard McCormick approach, with dramatically fewer constraints:

| Linearization       | # Variables | # Constraints         | LP Strength (Special Cases)            |
|---------------------|-------------|-----------------------|----------------------------------------|
| Glover–Woolsey      | $|P|$       | $3|P|$                | Baseline                              |
| Compact             | $|Q|$ ($Q\supseteq P$) | $\sum_k |B_k|$ | Provably as strong for $b_k=1$ or $2$ |

[1712.05872]

## 3. Continuous Relaxations and Relaxation Hierarchies

Classical continuous relaxations substitute binary constraints $x_i \in \{0,1\}$ with $x_i \in [0,1]$, and either encode bilinear terms directly or via linearization. Multiple relaxation regimes exist:

- **Linear Programming (LP) Relaxation**: Linearizes all quadratic terms, relaxes binary constraints.
- **Spectral Relaxation**: Replaces $x \in \{\pm 1\}^n$ with $\|x\|^2 = n$, reduces to an eigenvalue problem. Computationally simple but yields loose bounds [1304.0840].
- **Semidefinite Programming (SDP) Relaxation**: Lifts to $X = x x^\top$, enforces $X \succeq 0$, $\mathrm{diag}(X) = 1$, and (optionally) $X - x x^\top \succeq 0$. SDP gives tight bounds (e.g., $0.878$-approximation for Max-Cut) but is expensive for large $n$.

Modern developments include "SDCut", a scalable SDP variant that attains comparable bounds to interior-point SDP, but at spectral method-like cost per iteration [1304.0840]. Equivalence results show that doubly nonnegative relaxations and tight Shor-type SDP relaxations are fundamentally the same for BQP, including in the presence of constraints [1211.5406].

For special matrices (e.g., low completely positive rank), PTAS and QPTAS schemes exist for constrained BQPs [1411.5050].

## 4. Algorithmic Frameworks and Metaheuristics

Due to NP-hardness, practical BQP solvers incorporate a portfolio of exact and heuristic techniques:

- **Branch-and-Bound with SDP and Hypermetric Cuts**: BiqBin transforms linearly-constrained BQP into Max-Cut through exact penalization, applies strengthened SDP relaxations with triangle, pentagonal, and higher-order inequalities, and uses bundle methods for bounding [2009.06240]. Advanced branching (most-fractional variable selection, best-first search) and MPI-based parallel tree exploration are standard at scale.
- **Column Generation with Quantum or Simulated Annealing**: Pricing subproblems (i.e., finding entering binary columns) are handled by quantum or classical annealers, dramatically accelerating certain classes of constrained BQPs. Empirical studies show 2.7–1000$\times$ speedup versus standard solvers for mid-sized problems [2307.05966].
- **Metaheuristics for Specialized Structures**: Path Relinking combined with Tabu Search for unconstrained and smooth penalty-embedded BQPs (e.g., for minimum sum coloring) achieves best-known results on challenging benchmarks [1304.5876]. Markov chain-based operator mixing, as in Conditional Markov Chain Search (CMCS), unifies and outperforms traditional neighborhood heuristics on bipartite BQP extensions [1605.02038].
- **Cover–Relax–Search Primal Heuristics**: Vertex cover-based reduction methods, coupled with fractional-relaxation-guided variable fixing, yield rapid high-quality feasible solutions for large-scale BQP instances and outperform BnB and local-search baselines in primal integral metrics [2501.05052].

## 5. Robustness, Applications, and Extensions

### 5.1 Robust BQP and Uncertainty

For UBQP where $Q$ is perturbed within a box, robust solutions are computed via scenario generation (fractional factorial design) and aggregation. Robustness is quantified both at the solution-level (frequency and average performance across $Q^{(r)}$ instances) and variable-level (dominance criteria, diagonal dominance) [1709.07511]. Fast regression-based upper bound approximations enable near-instant performance bounds for new $Q$ realizations.

### 5.2 Application Domains

BQPs model core combinatorial optimization instances:

- Quadratic Assignment Problem (QAP): Assignments, solved with compact linearizations exploiting problem structure. The Frieze–Yadegar scheme is an instance of this compact model [1712.05872].
- Quadratic Traveling Salesman Problem (QTSP): Edge-incident quadratic terms handled with compact linearization, matching the Fischer–Helmberg approach [1712.05872].
- Data mining tasks: Matrix factorization, discrete pattern mining, maximum biclique, cut-norm calculations are reducible to bipartite/unconstrained BQPs [1210.3684, 1605.02038].
- Machine learning: Supervised/unsupervised hashing, binary classifier code learning, classification model compression—here, BQP subproblems are attacked by SDP relaxations, augmented Lagrangian methods, and specialized local search (e.g., sequential bit-flip with local-optimality guarantees) [1607.05396, 1603.04116].

### 5.3 BQP and Quantum Computing

Quantum annealing directly implements unconstrained BQP solutions by mapping to Ising Hamiltonians, and emerging hybrid methods integrate quantum subroutines into classical column generation or BnB frameworks. Quantum approaches are competitive for certain classes, especially when the bottleneck is unconstrained QUBO extraction [2307.05966, 1509.05001].

## 6. Theoretical Challenges and Approximation Results

- **Complexity**: General BQP remains NP-hard; even quadratic cover/packing with a single constraint is intractable. Current theoretical pathways exploit properties of the constraint matrices: low completely positive rank (cp-rank), positive semidefiniteness, or problem sparsity [1411.5050].
- **Approximation Schemes**:
  - Submodular $f(x)$ and cp-rank-bounded $Q_i$: $(1/4 - \epsilon)$-approximation, PTAS for linear $f$ [1411.5050].
  - SDP relaxation yields $0.878$-approximation for Max-Cut, $2/\pi$-approximation for binary code inference per randomized rounding analysis [1607.05396].
- **Relaxation Tightness**: Compact linearizations outperform or match classical McCormick bounds for several structured instances (assignment, right-hand-side-2 constraints). Hypermetric strengthened SDP relaxations further close integrality gaps for Max-Cut derived BQPs [1712.05872, 2009.06240].
- **Scalability**: Novel formulations such as SDCut and bundle-SDP with adaptive strengthening yield scalable relaxations without material bound sacrifice, enabling exact or near-exact solution of instances with $n$ up to 10,000 in specific settings [1304.0840, 2009.06240].

## 7. Outlook and Open Directions

- **Automated Linearization**: Optimization-driven selection of multiplier sets $B_k$ (cover sets) in compact linearization can be cast as a MIP, yielding provably most-compact and tight LP relaxations, suitable for automatic integration into MIP solvers [1808.08806].
- **Algorithmic Integration of Quantum Hardware**: Hybrid quantum-classical workflows (branch-and-price, Lagrangian dual subproblem solvers) are becoming practical with current quantum devices; ongoing research benchmarks these against combinatorial and branch-and-cut alternatives [2307.05966, 1509.05001].
- **Primal-Dual Integration and Bounding**: Recent primal heuristics, such as the Cover–Relax–Search algorithm, show drastic improvements in the primal integral relative to classical BnB and local search on large randomized and structured BQP benchmarks [2501.05052].

Direct equivalence between stronger SDP and doubly nonnegative relaxations shows relaxation strength can be preserved across convexification schemes, allowing flexibility in solver choice and model encoding [1211.5406].

BQP remains both a central challenge and a proving ground for advances in optimization theory, high-performance algorithmics, and quantum annealing systems. Continuing research focuses on scalable relaxations, automated problem reformulation, robust/uncertain BQP, tight approximation schemes, and the integration of emerging hardware for problem classes at the intersection of combinatorics and nonconvexity.

Source: https://www.emergentmind.com/topics/binary-quadratic-problems-bqp