---
title: 'Sherali–Adams Hierarchy: LP Relaxations'
url: https://www.emergentmind.com/topics/sherali-adams-hierarchy
type: topic
---

# Sherali–Adams Hierarchy: LP Relaxations

The Sherali–Adams hierarchy is a lift-and-project hierarchy of linear programming relaxations for \(0/1\) optimization, graph and relational homomorphism, and constraint satisfaction formulations. At level \(t\), it augments a base LP by introducing variables for monomials or, equivalently, by specifying consistent local distributions on subsets of variables of size at most \(t\); the resulting relaxations form a nested sequence that reaches the convex hull of integral solutions at full level [1405.0945][1312.0722]. Across recent work, the hierarchy has been characterized through local consistency, fractional isomorphism, higher-dimensional Weisfeiler–Leman equivalence, and tensorisation [2107.02956][2203.02478].

## 1. Formal construction and equivalent viewpoints

For a \(0/1\)-polytope \(P\subseteq[0,1]^d\) given by linear constraints \(\pi(x)\equiv a^T x-b\le 0\), the level-\(t\) Sherali–Adams tightening \(SA^t(P)\) is obtained by multiplying each original constraint by all monomials
\[
\prod_{i\in U\setminus W}x_i\prod_{i\in W}(1-x_i)
\]
with \(|U|\le t\), then linearizing every monomial \(\prod_{i\in I}x_i\) to a new variable \(x_I\) and replacing \(x_i^2\) by \(x_i\) [1312.0722]. In the standard lift-and-project notation, level \(t\) introduces variables \(y_S\) for all subsets \(S\) with \(|S|\le t+1\), with \(y_\emptyset=1\), and one obtains a descending chain
\[
\widehat P = SA^0(\widehat P)\supseteq SA^1(\widehat P)\supseteq \cdots \supseteq SA^n(\widehat P)=\mathrm{conv}(\{0,1\}^n\cap \widehat P)
\]
for a \(0/1\) relaxation \(\widehat P\subseteq[0,1]^n\) [1405.0945].

A second, equivalent presentation uses local marginals. For MAX \(k\)-CSP and related formulations, level \(t\) introduces variables \(y_{S,\alpha}\), interpreted as \(\Pr[x_S=\alpha]\), for all \(S\subseteq[n]\) of size at most \(t\), with normalization, nonnegativity, and marginal-consistency constraints [1608.00497]. For Max-Cut and general \(2\)-CSPs, this takes the form of local marginals \(\mu_S(\sigma)\) on assignments \(\sigma\in\{-1,1\}^S\), subject only to normalization, nonnegativity, and consistency; no semidefiniteness is imposed [1911.10304]. In CSP language, the same object is a consistent collection of local distributions over all subsets of size at most \(t\) [2203.02478].

For relational templates, the level-\(\ell\) relaxation can be written explicitly. Let \(X\) be an instance structure and \(A\) a template with the same signature. Then level \(\ell\) introduces a variable \(y_{S,x_S}\) for every subset \(S\subseteq X\) with \(1\le |S|\le \ell\) and every partial assignment \(x_S:S\to A\), with constraints
\[
\sum_{x_S:S\to A} y_{S,x_S}=1,
\qquad
\sum_{x_S|_U=f} y_{S,x_S}=y_{U,f},
\]
together with relation-consistency and feasibility conditions that force zero mass on locally forbidden tuples [2203.02478]. This is the standard “local distributions” view of Sherali–Adams on CSPs and homomorphism problems.

## 2. Constraint satisfaction, valued CSPs, and exactness criteria

For CSP homomorphism, the integer program uses variables \(x_{a,b}\in\{0,1\}\) encoding whether \(a\in A\) is mapped to \(b\in B\), with row-sum constraints and local forbidden-assignment inequalities; the Sherali–Adams level-\(k\) relaxation introduces variables \(p_V(f)\) for \(V\subseteq A\), \(|V|\le k\), and assignments \(f:V\to B\), together with normalization, marginalization, relation-consistency, and forbidden-tuple constraints [2107.02956]. A feasible solution is equivalently a “fractional \(k\)-consistency” witness: a global distribution over partial homomorphisms of domain size at most \(k\) whose marginals agree on overlaps [2107.02956].

At level \(1\), Sherali–Adams coincides with the basic LP for CSP. One exactness theorem states that \(SA^1(A,B)\) is the basic LP and that \(SA^1\) decides \(CSP(B)\) exactly if and only if \(B\) admits symmetric polymorphisms of all arities [2107.02956]. In the reformulation through Weisfeiler–Leman invariance, the families of CSPs solvable by this linear program are precisely those closed under the corresponding equivalence relation [2401.16998].

For valued CSPs, the hierarchy is commonly indexed as \(SA(t,k)\), with local distributions \(\lambda_S\) on scopes \(S\), consistency on all projections of size at most \(t\), and an objective minimizing the expected weighted relation cost [1502.05301]. The principal exactness result is that if \(\mathrm{supp}(\Gamma)\) satisfies the bounded width condition, then \(\Gamma\) has valued relational width \((2,3)\); equivalently, the level-\((2,3)\) Sherali–Adams relaxation is exact on \(\mathrm{VCSP}(\Gamma)\) [1502.05301]. The proof strategy passes through support closure under fractional polymorphisms, a derived ordinary CSP on support relations, and the \((2,3)\)-minimality characterization of bounded relational width [1502.05301].

The 2024 extension to Promise Valued CSPs preserves the same pattern. In that setting, \(SA^1\) exactly captures the class of Weisfeiler–Leman invariant templates, and the decomposition \(X\to Y \equiv_{WL}^1 Y' \to A\) is used to describe feasibility and objective preservation [2401.16998].

## 3. Graph isomorphism, Weisfeiler–Leman, and pebble-game characterizations

Applied to graph isomorphism, Sherali–Adams acts on the graph-isomorphism polytope
\[
P(G,H)=\mathrm{conv}\{X\in\{0,1\}^{n\times n}\mid XA_G=A_HX,\ Xe=X^Te=e\},
\]
or on related semi-algebraic formulations whose integer points encode isomorphisms [1107.0632]. The lifted variables correspond to partial matchings \((u_1,v_1),\dots,(u_t,v_t)\), and the resulting constraints generalize the Birkhoff equations and the adjacency-compatibility equations [1107.0632].

A central conclusion is that Sherali–Adams characterizes higher-dimensional color-refinement procedures. On graph isomorphism polytopes, the hierarchy characterizes a generalized vertex classification algorithm, and \(SA^{k+1}(Q_{G,H})\) exactly captures the \(k\)-dimensional Weisfeiler–Lehman partition of \(V^k\) [1107.0632]. The same work proves an \(\Omega(n)\) lower bound on the number of rounds needed in the worst case, via Cai–Fürer–Immerman constructions [1107.0632].

The correspondence sharpens further in the pebble-game formulation. For graphs \(G,H\), the intermediate systems \(\mathrm{ISO}(k-\tfrac12)\) and \(\mathrm{ISO}(k)\) match, respectively, bijective \(k\)-pebble counting equivalence and the weak \(k\)-pebble game; the two hierarchies interleave strictly, and Boolean-semiring analogues recover the non-counting \(L^k\) pebble games [1204.1990]. This identifies Sherali–Adams not merely as a hierarchy of LPs, but as a hierarchy of logical indistinguishability tests.

For arbitrary relational structures, the same picture persists. One theorem states that
\[
SA^k(A,B)\text{ is feasible } \Longleftrightarrow A\equiv_{WL}^k B,
\]
and equivalent characterizations are given in terms of counting homomorphisms from relational trees of treewidth \(<k\), \(C^k\) counting logic, and doubly-stochastic witnesses of fractional isomorphism [2107.02956]. A later refinement lifts the level-\(1\) decomposition to all \(k\): \(SA^k(X,A)\) is feasible if and only if there exists a chain \(X=Y_0\to Y_1\equiv_{WL}^k Y_2\to\cdots\to Y_m=A\) [2401.16998].

## 4. Tensorisation, minions, and promise CSPs

A recent multilinear characterization recasts Sherali–Adams for Promise CSPs through tensor powers. For \(k\ge2\) and \(k\)-enhanced structures \(X,A\), the main theorem states
\[
\mathrm{SA}^k(X,A)\text{ accepts } \Longleftrightarrow X^k \to \mathbb F(A^k),
\]
where \(X^k\) and \(A^k\) are tensor powers of the original structures and \(\mathbb F(A^k)\) is the free structure of stochastic tensors [2203.02478]. The universe of \(\mathbb F(A^k)\) consists of nonnegative real tensors \(T\in T^{k;|A|}(\mathbb Q)\) satisfying \(\sum_{a\in A^k}T_a=1\), and the theorem is equivalently stated as: the \(k\)-th Sherali–Adams relaxation on \((X,A)\) is exactly the basic LP applied to the tensorised pair \((X^k,A^k)\) [2203.02478].

This tensor viewpoint yields concrete lower bounds for promise coloring. For any loopless digraph \(X\) and any \(k\ge2\), \(\mathrm{SA}^k(X,K_k)\) accepts, and by combining this with the line-digraph construction one obtains that no constant level of Sherali–Adams solves \(\mathrm{PCSP}(K_c,K_d)\) for any \(3\le c\le d\) [2203.02478]. The construction is driven by the geometry of \(\mathbb F(K_k^k)\), whose tensors are highly symmetric under coordinate permutations but still admit homomorphisms from arbitrary \(X^k\) [2203.02478].

The tensor framework was then generalized into a minion-and-tensorisation program. In that formulation, the base minion for Sherali–Adams is the minion of all finite-ary stochastic vectors over \(\mathbb Q\), minor maps are row-summing maps, and the hierarchy arises by repeated tensor-power construction [2207.02277]. The same framework captures bounded width, Sherali–Adams LP, affine IP, Sum-of-Squares SDP, and combined “LP + affine IP” hierarchies [2207.02277]. In that sense, Sherali–Adams becomes one specific linear minion test inside a broader algebraic taxonomy.

## 5. Relations to other hierarchies in polynomial optimization

On the Boolean hypercube, Sherali–Adams admits a certificate interpretation through nonnegative \(d\)-juntas. A degree-\(d\) SA certificate writes \(f-\lambda\) as a sum \(\sum_i s_i g_i\), where each multiplier \(s_i\) is a nonnegative \(d\)-junta and \(\deg(s_i g_i)\le 2d\) [1903.04996]. The Schmüdgen-type variant \(SA^*\) allows arbitrary products of Boolean constraints, and on \(\{0,1\}^n\) it has a Positivstellensatz degree bound \(O(n)\) [1903.04996].

The comparative results are unusually sharp. Over the Boolean hypercube, the hierarchies \(SA^*\), \(SDSOS^*\), and \(SONC^*\) are polynomially equivalent, and any Schmüdgen-type hierarchy with an \(O(n)\) degree bound contains \(SA^*\) up to constant-factor degree blow-up [1903.04996]. The same source states that \(SOS^*\), \(SDSOS^*\), and \(SONC^*\) each admit an \(O(n)\)-degree Positivstellensatz on \(\{0,1\}^n\), which implies containment of \(SA^*\) and, together with the equivalence theorem, gives full polynomial equivalence among \(SA^*\), \(SDSOS^*\), and \(SONC^*\) [1903.04996].

This Boolean-hypercube result is distinct from the tensor-minion comparison. The former is a certificate-complexity equivalence among LP, SOCP, and relative-entropy based systems on \(\{0,1\}^n\); the latter is a structural framework in which Sherali–Adams, affine IP, and SDP hierarchies appear as different choices of base minion and tensorisation scheme [2207.02277].

## 6. Algorithmic consequences and positive results

Low and medium levels of Sherali–Adams yield exact algorithms and approximation schemes on several structured problem classes. For Sparsest Cut with general demands in graphs of treewidth \(r\), the level-\((r+3)\) relaxation provides local distributions on all bags needed by the rounding, leading to the first constant-factor approximation on bounded-treewidth graphs [1006.3970]. For Graph Vertex Pricing, if \(G\) has treewidth \(k\), then solving \(LP-(k+1)\) exactly gives integrality gap \(1\), while for genus-\(g\) graphs, \(r=O(g/\epsilon)\) rounds yield a \((1+\epsilon)\)-approximation [1203.1940].

The hierarchy also supports quasi-polynomial approximation in scheduling. For unit-size jobs with precedence constraints on \(m\) identical machines, \((\log n)^{O(1)}\) rounds of Sherali–Adams applied to the natural time-indexed LP provide a \((1+\epsilon)\)-approximation algorithm running in quasi-polynomial time for fixed \(m\) and \(\epsilon\) [1708.04369]. The proof uses repeated conditioning in the lifted space and a laminar decomposition of the time horizon [1708.04369].

In clustering, Sherali–Adams improves on the standard triangle LP. For Correlation Clustering on complete graphs, \(O(1/\epsilon^2)\) rounds, combined with correlated rounding and a global charging scheme, yield a \((1.994+\epsilon)\)-approximation algorithm; equivalently, the \(O(1/\epsilon^2)\)-round relaxation has integrality gap at most \(1.994+\epsilon\) [2207.10889].

For Max-Cut, the hierarchy exhibits both certification and approximation phenomena. If an \(n\)-vertex graph has random-walk matrix with all nontrivial eigenvalues bounded in magnitude by \(1/\sqrt{\Delta}\), then \(\exp\!\bigl(c\,\frac{\log n}{\log \Delta}\bigr)\) rounds of Sherali–Adams certify that the maximum cut is at most \(\tfrac12+2^{-\Omega(c)}\) [1812.09967]. More generally, for every \(\alpha>0\) there is \(\delta(\alpha)>0\) such that the degree-\(n^\alpha\) Sherali–Adams LP approximates Max-Cut within a factor \(\tfrac12+\delta(\alpha)\) on every \(n\)-vertex graph, and the same paper extends this subexponential-time LP approach to Unique Games [1911.10304].

## 7. Lower bounds, integrality gaps, and limitations

A broad meta-result for CSP approximation states that any integrality-gap instance for the basic LP lifts to an integrality-gap instance for
\[
t=c_\varepsilon \frac{\log N}{\log\log N}
\]
levels of Sherali–Adams on instances of size \(N\) [1608.00497]. This shows that, for every predicate, \(\Omega\!\bigl(\frac{\log N}{\log\log N}\bigr)\) levels may still be no stronger than the basic LP, and it implies that polynomial-size LP extended formulations cannot beat the basic LP for CSPs [1608.00497].

Problem-specific lower bounds are equally strong. For decoding random \((d_v,d_c)\)-regular LDPC codes, even \(\Omega(n)\) rounds of Sherali–Adams cannot correct more than an \(O(1/d_c)\) fraction of errors [1410.4241]. For uniform capacitated facility location, there exist instances for which the level-\(t\) relaxation of the natural LP has integrality gap \(\Omega(n)\) for all \(t\le cn\), and the same family remains hard even after adding generalized flow-cover inequalities [1312.0722].

For ATSP, level-\(t\) Sherali–Adams applied to the standard DFJ LP has integrality ratio at least
\[
1+\frac{1-\epsilon}{2t+3},
\]
while for the balanced LP the ratio is at least
\[
1+\frac{1-\epsilon}{t+1}
\]
on the Charikar–Goemans–Karloff digraph family [1405.0945]. These constructions identify structural properties of digraphs that preserve fractional feasibility through many lift-and-project rounds [1405.0945].

The hierarchy can also fail sharply at very low levels. In the MaxMinDegree Arborescence problem, a depth-\(3\) instance has an \(n^{\Omega(1)}\) integrality gap that survives one round of Sherali–Adams, and the paper lifts this construction to all depths \(\ell\in \Omega(1)\cap o(\log n/\log\log n)\) [2406.18273]. For Bounded Color Matching, the natural LP can retain large gaps after multiple rounds on several instance families, although the second round already implies all bi-chromatic-4-cycle inequalities and yields upper bounds \(3/2\) in bipartite graphs and \(5/3\) in general graphs [1801.07937].

These results delimit the hierarchy’s power rather than negating it. They show that Sherali–Adams can be exact on bounded-width and bounded-treewidth regimes, can produce nontrivial subexponential-time approximations and certificates, and can nevertheless remain far from the integer hull on canonical hard instances, even after many rounds [1502.05301][1911.10304].

Source: https://www.emergentmind.com/topics/sherali-adams-hierarchy