---
title: Compact Linearization in Optimization Models
url: https://www.emergentmind.com/topics/compact-linearization
type: topic
---

# Compact Linearization in Optimization Models

Searching arXiv for relevant papers on compact linearization across control BMIs, binary quadratic optimization, and recent linearization formulations.
Compact linearization is a structured reformulation technique for bilinear and quadratic optimization models in which existing algebraic structure is used to replace nonlinear terms by smaller linear, convex, or LMI-representable constraints. In the papers considered here, the term appears principally in two settings. In binary quadratic optimization, compact linearization replaces the standard “one product, three inequalities” construction by equations or inequalities obtained from multiplying existing linear constraints by selected binary variables, often yielding fewer constraints and, in important special cases, an LP relaxation that is provably at least as strong as the classical linearization [1610.05375; 1712.05872; 1808.08806]. In BMI-constrained control design, bilinear matrix mappings are decomposed as differences of positive semidefinite convex mappings, after which the concave part is linearized at each iterate, producing a sequence of convex SDP or LMI subproblems [1109.3320].

## 1. Fundamental idea and canonical formulations

In binary quadratic problems, the starting point is a model with binary variables $x_i\in\{0,1\}$ and product variables $y_{ij}=x_i x_j$. The classical Glover-Woolsey, or standard, linearization introduces $y_{ij}\in[0,1]$ and imposes
\[
y_{ij}\le x_i,\qquad y_{ij}\le x_j,\qquad y_{ij}\ge x_i+x_j-1.
\]
This construction is always applicable, but it adds three constraints per product and treats each product separately [1610.05375; 1808.08806].

Compact linearization replaces that local treatment by a structure-exploiting one. For assignment constraints of the form
\[
\sum_{i\in A_k} x_i = 1,
\]
Liberti’s idea, as formalized and corrected later, is to choose sets $B_k\subseteq N$, multiply each assignment equation by $x_j$ for $j\in B_k$, and then substitute $x_i x_j$ by $y_{ij}$. This yields equations of the form
\[
\sum_{i\in A_k} x_i x_j = x_j
\qquad \forall j\in B_k,\ \forall k\in K,
\]
and, after ordering product indices,
\[
\sum_{i \in A_k,\,(i,j)\in F} y_{ij} \;+\; \sum_{i \in A_k,\,(j,i)\in F} y_{ji} = x_j
\qquad \forall j\in B_k,\ \forall k\in K.
\]
The set $F$ collects the product pairs actually induced by the construction. The method is compact because one multiplied assignment equation can simultaneously control many products [1610.05375].

The same principle extends beyond assignment constraints. For arbitrary linear equations with positive coefficients,
\[
\sum_{i\in A_k} a_i^k x_i=b^k,
\]
one multiplies by selected variables $x_j$, obtaining
\[
\sum_{i \in A_k} a_i^k x_i x_j = b^k x_j.
\]
After replacing products by $y_{ij}$, the resulting equations encode the linkage between original variables and bilinear terms more economically than the standard formulation [1712.05872]. A further extension also permits linear inequalities with positive coefficients and positive right-hand sides, and multiplies them either by $x_j$ or by $1-x_j$ [1808.08806].

## 2. Assignment-constrained binary quadratic programs

The 2016 treatment considers binary quadratic programs of the form
\[
\min \quad c^T x + b^T y
\]
subject to assignment constraints
\[
\sum_{i\in A_k} x_i = 1 \qquad \forall k\in K,
\]
additional linear constraints $Cx+Dy\ge b$, and bilinear identities $y_{ij}=x_i x_j$ for $(i,j)\in E$ [1610.05375].

A central contribution is the correction of an inconsistency in Liberti’s 2007 condition. Liberti required $E\subseteq F$ and $A_k\subseteq B_k$ for all $k\in K$. The later analysis shows that while $E\subseteq F$ is necessary, the condition $A_k\subseteq B_k$ is not sufficient to guarantee a correct linearization in all cases, because it may enforce $y_{ij}\le x_j$ without also enforcing $y_{ij}\le x_i$. The revised criterion is bidirectional coverage: for each $(i,j)\in F$, there must exist a $k\in K$ such that
\[
i\in A_k \quad \text{and} \quad j\in B_k,
\]
and an $\ell\in K$ such that
\[
j\in A_\ell \quad \text{and} \quad i\in B_\ell.
\]
Under these two conditions, the compact equations imply
\[
y_{ij}\le x_i,\qquad y_{ij}\le x_j,\qquad y_{ij}\ge x_i+x_j-1
\]
for each $(i,j)\in F$ [1610.05375].

The paper also emphasizes two conceptual consequences. First, $A_k\subseteq B_k$ is not necessary. Second, the true validity requirement is not set inclusion but the existence of equations in both directions for every induced product. This turns compact linearization from a heuristic recipe into a theorem-backed reformulation scheme [1610.05375].

For constructing a small valid formulation, the paper introduces a mixed-integer linear program with binary variables $z_{ik}$, indicating whether $i\in B_k$, and continuous variables $f_{ij}\in[0,1]$, indicating whether $(i,j)\in F$. The objective minimizes a weighted sum of the number of added equations and the number of additional linearization variables. When the assignment supports are pairwise disjoint,
\[
A_k \cap A_l = \emptyset \qquad \forall k\ne l,
\]
the constraint matrix is totally unimodular, so the LP relaxation already yields integer solutions. In that case, the minimally-sized linearization can be computed in polynomial time, and the associated combinatorial closure algorithm is exact with an $O(n^3)$ bound. When supports overlap, the same procedure remains available as a heuristic [1610.05375].

## 3. Generalization to positive equations and inequalities

The 2017 generalization enlarges the scope from assignment constraints to arbitrary linear equations with positive coefficients,
\[
\sum_{i\in A_k} a_i^k x_i=b^k,\qquad a_i^k>0,\ b^k>0,
\]
in binary quadratic problems with additional linear constraints $Cx+Dy\ge e$. An important structural assumption is that every variable appearing in a bilinear term must appear in at least one of the linear equations [1712.05872].

The construction again multiplies each equation by selected variables $x_j$, for $j\in B_k$, producing
\[
\sum_{i \in A_k} a_i^k x_i x_j = b^k x_j,
\]
and after substitution
\[
\sum_{i \in A_k, (i,j) \in Q} a_i^k y_{ij}\ + \sum_{i \in A_k, (j,i) \in Q} a_i^k y_{ji}
=\; b^k x_{j}.
\]
Here $Q$ is the set of bilinear terms induced by the multiplication process. The same two consistency conditions reappear: for each $(i,j)\in Q$, there must be one equation with $i\in A_k,\ j\in B_k$ and another with $j\in A_\ell,\ i\in B_\ell$. Theorem 1 then states that for any integer solution $x\in\{0,1\}^N$, the standard product inequalities hold for all $(i,j)\in Q$ [1712.05872].

The strong LP-relaxation guarantee is not universal in this more general setting. For arbitrary positive coefficients and right-hand sides, the theorem guarantees the standard inequalities for integer solutions, not fractional ones. Two special cases recover the stronger statement for all $x\in[0,1]^N$. The first is the assignment case
\[
a_i^k=1 \quad \forall i\in A_k,\qquad b^k=1,
\]
where the compact linearization is provably at least as strong as ordinary linearization. The second is the case
\[
a_i^k=1,\qquad b^k=2,\qquad B_k=A_k,
\]
for which the same inequalities hold for all $(i,j)\in Q$, $i\neq j$ [1712.05872].

The 2018 paper extends the framework further to arbitrary linear equations and inequalities with positive coefficients and positive right-hand sides:
\[
\sum_{i \in A_k} \alpha_i^k x_{i} = \beta^k \quad (k\in K_E),\qquad
\sum_{i \in A_k} \alpha_i^k x_{i} \le \beta^k \quad (k\in K_I).
\]
For equations it uses sets $B_k^E$, and for inequalities two multiplier sets,
\[
B_k^{I_+}\subseteq N,\qquad B_k^{I_-}\subseteq N.
\]
Variables in $B_k^E\cup B_k^{I_+}$ multiply the constraint by $x_j$, while variables in $B_k^{I_-}$ multiply it by $1-x_j$. After substitution, the formulation includes equalities, upper-bounding inequalities, and complementary inequalities of the form
\[
\sum_{i \in A_k,\,(i,j)\in Q} \alpha_i^k (x_i-y_{ij}) + \sum_{i \in A_k,\,(j,i)\in Q} \alpha_i^k (x_i-y_{ji}) \le \beta^k (1-x_j).
\]
Consistency is characterized by three conditions. Conditions 1 and 2 guarantee the zero-product cases, while Condition 3 covers the complementary case needed to force $y_{ij}=1$ when both $x_i=x_j=1$. The paper states that, for any integer $x\in\{0,1\}^n$, the linearization constraints imply $y_{ij}=x_i x_j$ for all $(i,j)\in Q$ if and only if Conditions 1–3 are satisfied [1808.08806].

## 4. Relaxation strength, size minimization, and representative applications

A recurring question is when compact linearization is not merely valid on integer points but also at least as strong as the classical relaxation. The assignment case is the canonical answer: when every equation is
\[
\sum_{i\in A_k} x_i = 1,
\]
the induced constraints imply
\[
y_{ij}\le x_i,\qquad y_{ij}\le x_j,\qquad y_{ij}\ge x_i+x_j-1
\]
even for fractional $x\in[0,1]^n$, provided the bidirectional coverage conditions hold [1610.05375; 1712.05872; 1808.08806].

The 2018 extension identifies further strong cases. For knapsack inequalities
\[
\sum_{i\in A_k} x_i \le 1,
\]
Conditions 1–3 again imply the three classical inequalities for the relaxation. For double-selection equations
\[
\sum_{i\in A_k} x_i = 2
\]
with products among variables in $A_k\times A_k$ and $B_k=A_k$, the compact linearization also yields a relaxation at least as strong as classical linearization [1808.08806].

Automatic size minimization is handled through mixed-integer models. In the assignment and positive-equation settings, variables $z_{ik}$ indicate whether variable $i$ is placed in $B_k$, while variables $f_{ij}$ indicate whether a bilinear term belongs to the induced set. The objective minimizes both the number of added equations and, secondarily, the number of additional variables. The constraints enforce inclusion of all original products and the coverage conditions needed for validity. When the supports $A_k$ are pairwise disjoint, this model reduces to a linear program with a totally unimodular matrix [1610.05375; 1712.05872].

The framework also unifies several classical formulations from combinatorial optimization. For the quadratic assignment problem, the well-known linearization by Frieze and Yadegar for the Koopmans-Beckmann formulation is exactly a compact linearization instance; the 2018 paper also notes that Adams-Johnson formulations arise in the same manner [1712.05872; 1808.08806]. For the symmetric quadratic traveling salesman problem, degree equations
\[
\sum_{\{i,j\}\in E} x_{ij}=2
\]
generate exactly the products $x_{ij}x_{jk}$ when one chooses $B_k=A_k$, and after removing diagonal square terms one obtains the linearization used by Fischer and Helmberg [1712.05872; 1808.08806]. These examples are significant because they show that compact linearization is not merely a new reformulation device; it also supplies a unifying explanation for several models that had previously appeared problem by problem.

## 5. Convex-concave compact linearization for bilinear matrix inequalities

In BMI-constrained control design, compact linearization takes a different but related form. The 2011 paper studies optimization problems
\[
\min_{x \in \Omega} \; f(x)
\quad \text{s.t.} \quad
G_i(x)-H_i(x)\le 0,\qquad i=1,\dots,l,
\]
where $f$ is convex, $\Omega$ is a closed convex set, and $G_i,H_i$ are psd-convex matrix-valued mappings. The feasible set is assumed to satisfy
\[
\operatorname{ri}(D)\neq \emptyset,
\]
so there exists a strictly feasible starting point [1109.3320].

The core device is to rewrite bilinear matrix terms as differences of positive semidefinite convex mappings. For the bilinear form
\[
F(X,Y)=X^T Y + Y^T X,
\]
Lemma 3.1 gives explicit decompositions:
\[
X^T Y + Y^T X = (X+Y)^T(X+Y) - (X^T X + Y^T Y),
\]
\[
X^T Y + Y^T X = X^T X + Y^T Y - (X-Y)^T(X-Y),
\]
and
\[
X^T Y + Y^T X
= \frac{1}{2}\Big[(X+Y)^T(X+Y) - (X-Y)^T(X-Y)\Big].
\]
Thus the bilinear mapping is written as
\[
F(x)=G(x)-H(x),
\]
with both $G$ and $H$ psd-convex [1109.3320].

At iteration $x^k$, the concave part is replaced by its first-order upper bound,
\[
-H_i(x)\le -H_i(x^k)-DH_i(x^k)(x-x^k),
\]
so the original constraint
\[
G_i(x)-H_i(x)\le 0
\]
is conservatively approximated by
\[
G_i(x)-H_i(x^k)-DH_i(x^k)(x-x^k)\le 0.
\]
This yields the convex subproblem
\[
\min_{x\in\Omega}\; f(x)+\frac{1}{2p_k}\|Q_k(x-x^k)\|^2
\quad\text{s.t.}\quad
G_i(x)-H_i(x^k)-DH_i(x^k)(x-x^k)\le 0.
\]
The quadratic regularization term is used to stabilize the iteration and help ensure descent [1109.3320].

A major advantage is that, in the static output feedback applications considered, many of the resulting constraints can be converted to LMIs by Schur complements. The plant is
\[
\dot x = Ax + B_1 w + Bu,\qquad
z = C_1x + D_{11}w + D_{12}u,\qquad
y = Cx + D_{21}w,
\]
with static controller $u=Fy$, giving closed-loop matrix
\[
A_F = A + BFC.
\]
Problems including stabilization, spectral abscissa, $H_2$, $H_\infty$, and mixed $H_2/H_\infty$ synthesis become BMI-constrained optimization problems. For sparse static output feedback, the BMI constraint
\[
(A+BFC)^TP + P(A+BFC) + 2\alpha P < 0,\qquad P=P^T>0
\]
is rewritten using
\[
(BF)^TP + P(BF)
=
\frac12\Big[(BF+P)^T(BF+P)-(BF-P)^T(BF-P)\Big].
\]
After linearizing the concave term, the constraint becomes
\[
(A+BFC+\alpha I + P)^T(A+BFC+\alpha I + P) - H_k(F,P,\alpha) < 0,
\]
which is then rewritten as an LMI via the Schur complement [1109.3320].

The method is local. If the starting point is feasible and strict feasibility holds, every iterate remains feasible, and no line search is required. Under assumptions A1–A3, accumulation points are KKT points of the original BMI problem. The convergence theorem states that if $f$ is strongly convex or the regularization is fixed and $Q_k$ has full row rank, then every accumulation point is a KKT point; if KKT points are finite, the whole sequence converges. The monotonicity relation
\[
f(x^{k+1})-f(x^\star)
\le
-\frac{\rho_f}{2}\|x^{k+1}-x^k\|^2
-\frac{p_k}{2}\|Q_k(x^{k+1}-x^k)\|^2
\]
shows descent [1109.3320].

Numerically, the paper benchmarks the algorithm on COMPleib for sparse static output feedback, spectral abscissa minimization, $H_2$ synthesis, $H_\infty$ synthesis, and mixed $H_2/H_\infty$ synthesis. The comparisons include HIFOO, PENBMI, and, in some cases, LMIRank. The reported outcomes indicate that the method often finds feasible controllers with competitive or better objective values, and in the sparse output-feedback case the paper reports a decay rate $\alpha=1.17316$, much better than the comparison in [14] [1109.3320].

## 6. Related structured linearization frameworks

Two later works show that the broader research program around compactness and linearization extends beyond product reformulation. In fully composite optimization,
\[
\min_{x\in X}\; \varphi(x)=F(f(x),x),
\]
the 2023 paper proposes first-order methods that linearize only the differentiable inner map $f$ while keeping the outer function $F$ exact in the subproblem:
\[
x_{k+1}\in\arg\min_{x\in X} F\Bigl(f(y_k)+\nabla f(y_k)(x-y_k),\,x\Bigr),
\qquad
y_{k+1}=(1-\gamma_k)y_k+\gamma_k x_{k+1}.
\]
The framework generalizes Frank-Wolfe and Conditional Gradient Sliding, uses a stronger linear minimization oracle of the form
\[
\min_{x\in X} F(Ax+b,x)+\langle u,x\rangle,
\]
and provides affine-invariant analysis with global convergence rates for both convex and non-convex objectives [2302.12808].

A different line of work studies compact linear programs generated from algorithmic descriptions. The 2025 paper introduces Hierarchical Synchronization Barriers, which decompose a program into nested Synchronization Blocks equipped with execution time intervals. The compiler then generates control-flow and memory-update constraints only on the relevant intervals, creates variable versions only for blocks that access a given variable, and uses the Union Execution Time Interval Generator to localize carry-forward constraints. On benchmark makespan and weighted minimum spanning tree instances, the paper reports up to a $25$-fold reduction in LP size, reductions of about $94\%$ and $98\%$ in nonzeros and constraints on the largest tested makespan and MST instances, and substantial improvements in solver performance across cplex, gurobi, and scip [2509.13006].

These adjacent developments suggest a broader interpretation of compact linearization as a family of structure-exploiting transformations. In one branch, the structure is algebraic and comes from assignment equations, positive linear constraints, or psd-convex decompositions; in another, it is algorithmic and comes from execution regions, synchronization barriers, or composite objective structure. Across these branches, the common objective is the same: to replace an unwieldy nonlinear or overly large formulation by a smaller representation that preserves the intended optimization semantics [2302.12808; 2509.13006].

Source: https://www.emergentmind.com/topics/compact-linearization