---
title: Moment-SOS Hierarchies Overview
url: https://www.emergentmind.com/topics/moment-sos-hierarchies
type: topic
---

# Moment-SOS Hierarchies Overview

A Moment-SOS (Sum-of-Squares) hierarchy is a sequence of increasingly tight semidefinite programming (SDP) relaxations for polynomial optimization problems, grounded in the theory of the K-moment problem and dual algebraic certificates for positivity on semialgebraic sets. It delivers convergent upper and lower bounds for a broad class of problems, including static optimization, pathwise properties of stochastic processes, generalized moment problems, and polynomial optimal control. Moment-SOS hierarchies exploit both polynomial algebra and convex analysis, and serve as the mathematical backbone for measure-LP duality, occupation measures in dynamical systems, and many scalable algorithms in systems control, combinatorial optimization, signal processing, and PDEs.

## 1. Mathematical Foundations and Basic Construction

The archetypal problem addressed by the Moment-SOS hierarchy is global polynomial optimization over a compact basic semialgebraic set,
\[
K = \{ x \in \mathbb{R}^n : g_j(x) \geq 0,\ j=1,\dots,m \}
\]
with $f \in \mathbb{R}[x]$. The minimum is equivalently cast as
\[
f^* = \inf_{x \in K} f(x) = \inf_{\mu \in P(K)} \int f(x)\, d\mu(x)
\]
where $\mu$ is a Borel probability measure on $K$ ($P(K)$), or dually as
\[
f^* = \sup\{ \lambda : f(x) - \lambda \geq 0 \quad \forall x \in K \}.
\]
Moment sequences $y = (y_\alpha)_{|\alpha| \leq 2d}$ with $y_\alpha = \int x^\alpha\, d\mu(x)$ are introduced. The moment matrix $M_d(y)$ and, for each constraint, the localizing matrix $M_{d-d_j}(g_j y)$ encode the Gram–type positivity constraints associated to measures supported on $K$:
\[
M_d(y)[\alpha,\beta] = y_{\alpha+\beta}, \quad
M_{d-d_j}(g_j y)[\alpha,\beta] = \sum_\gamma (g_j)_\gamma\, y_{\alpha+\beta+\gamma}.
\]
The $d$-th order relaxation is the SDP:
\[
\min_{y}\ \sum_{|\alpha| \leq 2d} f_\alpha y_\alpha,\qquad
\text{s.t.}\ M_d(y) \succeq 0,\ M_{d-d_j}(g_j y) \succeq 0,\ y_0=1.
\]
This is the primal moment relaxation. The dual (SOS) relaxation seeks certificates
\[
f(x) - \lambda = \sigma_0(x) + \sum_j \sigma_j(x) g_j(x),\qquad
\sigma_j \in \Sigma[x],
\]
where $\Sigma[x]$ denotes the cone of sum-of-squares polynomials.

The standard setting for convergence is the Archimedean property,
\[
\exists\ M \;:\; M - \|x\|^2 \in Q(g) := \{\sigma_0 + \sum_j \sigma_j g_j : \sigma_j \in \Sigma[x]\},
\]
ensuring $K$ is compact and Putinar’s Positivstellensatz applies [1808.03446].

## 2. Duality, Certificates, and Flat Extension

Primal-dual strong duality holds under the Archimedean condition: the primal moment relaxation and the dual SOS relaxation attain the same value for large enough $d$, and the sequence of relaxations is non-decreasing and convergent to $f^*$ [1808.03446]. Practical extraction of minimizers leverages the "flat extension" criterion: if the optimal $y^*$ at level $d$ satisfies
\[
\operatorname{rank} M_d(y^*) = \operatorname{rank} M_{d-1}(y^*),
\]
then $y^*$ arises from a finitely supported measure on $K$, i.e., the global optimizers are recovered [1808.03446]. This algebraic-geometric finite convergence is generically achieved under nondegeneracy conditions such as strict complementarity and second-order sufficiency [2403.17241].

## 3. Structure, Variants, and Extensions

Several significant extensions and variants exist:

- **Generalized Problems of Moments (GPM):** Application to optimal control and PDEs interprets the dynamic or infinite-dimensional constraints as linear constraints on occupation measures, yielding measure-LP formulations and associated hierarchies [1808.03446, 2412.07361, 2503.12987].
- **Polynomial Matrix and Matrix Inequality Problems:** The matrix moment-SOS hierarchy generalizes the scalar case to polynomial matrix constraints, introducing matrix-valued moment and localizing matrices; finite convergence under matrix analogues of KKT and second-order conditions has been established [2304.12628, 2403.17241, 2509.02849].
- **Complex and Sparse Hierarchies:** The theory supports efficient real moment-HSOS hierarchies for complex polynomial problems and highly scalable sparse variants exploiting term and/or correlative sparsity (TSSOS, chordal-TSSOS, CS-TSSOS), often yielding orders-of-magnitude reductions in SDP block sizes [2308.14631, 1912.08899, 2003.03210, 2402.05444, 2005.02828].
- **Regularized Hierarchies for Non-compact Sets:** Using the Carleman condition, density theorems guarantee convergence of a regularized moment-SOS hierarchy on non-Archimedean domains or unbounded sets [2512.05612].

## 4. Convergence: Rates, Finite Convergence, Exactness

Convergence behavior exhibits fine analytic structure:

- **Asymptotic Convergence:** Under Putinar’s condition, the moment-SOS hierarchy yields a monotonic sequence converging to the exact minimum (or solution to the associated generalized problem) [1808.03446, 2101.06009, 2412.07361].
- **Finite Convergence via Hidden Convexity:** Strong convexity or SOS-convexity of the objective (sometimes only locally) or of constraint data can ensure finite convergence at a relaxation order dictated by the degree of convexity certificates, even in globally non-convex settings [2603.00284].
- **Rate Analysis:** The convergence rate is governed by the geometry of the feasible set, described by its Łojasiewicz exponent $L$. The error at order $r$ is $O(1/r^L)$: for the ball, $O(1/r^2)$; for general polytopes, $O(1/r)$; for locally strongly convex sets, $O(1/\sqrt{r})$; for general sets, the rate is dictated by the exponent $L$ [2507.00572, 2402.00436]. Effective bounds are obtained using explicit degree estimates for Putinar’s Positivstellensatz and polynomial approximation theory. 
- **Exactness Cones:** The set of objective polynomials for which the relaxation is exact at finite $d$ forms a union of spectrahedral cones, directly tied to the geometry of the moment spectrahedron and the faces exposed by Dirac measures at global minimizers [2310.17229].

## 5. Computational Complexity and Scalability

While the dimension of the corresponding SDP at order $t$ is polynomial in the number of variables ($O(n^t)$ for most problems), the bit complexity of certificates may be exponential in $n$ and/or $t$ in pathological cases, as demonstrated for Boolean problems [2305.14944]. Polynomial-time solvability is guaranteed under explicit algebraic and geometric strict feasibility and spectral-gap conditions, providing inner-ball and outer-ball certificates for the feasible set of the SDP [2305.14944]. In practical settings, these conditions are often achieved via explicit bounding constraints or verified numerically.

Advanced implementations scale to hundreds or thousands of variables leveraging modern sparsity-exploiting frameworks (TSSOS, chordal-TSSOS, CS-TSSOS, refined TSSOS), which block-diagonalize the moment and localizing matrices according to a hierarchy of monomial and variable interaction graphs. Benchmarks illustrate dramatic speedup and scalability for large sparse combinatorial, power system, and control instances [1912.08899, 2003.03210, 2005.02828, 2402.05444].

## 6. Applications Across Domains

Moment-SOS hierarchies are foundational in a wide range of applications:

- **Control and PDEs:** Computation of reachable sets, region of attraction, value functions, occupation measures for optimal control, and Liouville-driven measure relaxations for nonlinear and stochastic PDEs, always with rigorously convergent monotonic lower/upper bounds [2412.07361, 2503.12987, 2101.06009].
- **Stochastic Processes:** Quantitative bounding of exit time and location distributions for polynomial SDEs, via the measure-LP and sum-of-squares duality with direct convergence guarantee [2101.06009].
- **Combinatorial and Large-Scale Optimization:** Tight convex relaxations for Max-Cut, mixed-integer quadratic programs, AC-OPF, robust design, and code design; partial or fully sparse hierarchies target scalable bounds in memory and time [1912.08899, 2005.02828, 2402.05444].
- **Signal and System Recovery:** Sparse superresolution, system identification, optimal experimental design, sparse polynomial interpolation, and matrix-valued extensions for robust optimization [1808.03446, 2304.12628].
- **Theoretical Insights:** Analysis of exactness geometry, structure of spectrahedral cones of objective functionals, and links to Christoffel-Darboux kernels for the interpretation of finite convergence [2011.08566, 2310.17229].

## 7. Interpretations, Limitations, and Future Directions

Current research elucidates the algebraic and geometric underpinnings of finite/infinite convergence, the tight connections to real algebraic geometry via Putinar’s and Scheiderer’s theorems, and the analytic rate proxy via the Łojasiewicz exponent. Challenges remain in quantifying effective rates for higher-dimensional and non-smooth domains, extending finite convergence certificates, and optimizing solver architectures for the largest instances. Regularized hierarchies using Carleman determinacy and penalization extend the reach to non-compact or non-Archimedean feasible sets [2512.05612]. Applications to infinite-dimensional problems (PDEs, control, measure-driven evolution) are rapidly expanding in both theory and computation.

The Moment-SOS hierarchy constitutes a rigorous, versatile analytic-computational framework for polynomial optimization and measure-driven analysis with rapidly maturing scalability and depth across mathematical disciplines [1808.03446, 2101.06009, 2305.14944, 1912.08899, 2412.07361, 2507.00572, 2603.00284].

Source: https://www.emergentmind.com/topics/moment-sos-hierarchies