Polynomial Optimization via Lasserre's SDP Hierarchy
- Polynomial optimization via Lasserre's SDP hierarchy is a method that systematically approximates the global minimum of a polynomial using convex semidefinite programming relaxations.
- It leverages moment matrices and sum-of-squares certificates to provide explicit degree bounds that guarantee finite convergence under generic regularity conditions.
- The approach enables efficient extraction of optimizers via flat truncation and extends to various cases including gradient, grid, and binary optimization problems.
Polynomial optimization via Lasserre's semidefinite programming (SDP) hierarchy refers to the systematic approximation of the global minimum of a real polynomial, possibly constrained by polynomial equalities and/or inequalities, by a sequence of convex SDP relaxations based on truncated moment sequences and sum-of-squares (SOS) certificates. The correctness, rate of convergence, and explicit degree bounds for finite convergence of this hierarchy are governed by deep interrelations between algebraic geometry, real algebraic optimization, and nonlinear programming optimality theory.
1. Foundations of Lasserre's SDP (Moment–SOS) Hierarchy
Given a polynomial optimization problem over :
with , the solution set (i.e., real zero locus of the constraints) is assumed to be finite. The Lasserre hierarchy introduces a sequence of truncated moment variables corresponding to the multi-indices , and defines the linear Riesz functional for polynomials .
The th-level relaxation replaces nonconvex feasible sets with convex constraints:
- Moment matrix (where , 0),
- Localizing matrix constraints 1 for each 2 (3),
- Normalization 4.
The relaxation value is
5
which satisfies 6 (where 7 is the true global minimum).
2. Finite Convergence and Effective Degree Bounds
Finite convergence refers to the termination of the hierarchy at some finite level 8 such that 9. The work "Exactness and Effective Degree Bound of Lasserre's Relaxation for Polynomial Optimization over Finite Variety" establishes explicit degree bounds for this phenomenon under generic geometric conditions:
- (A1) No Solution at Infinity: The homogeneous system defined by the leading (highest degree) parts 0 must have no common (nontrivial) complex root at infinity. Formally, for each constraint 1, consider its homogenization 2 and require the system 3 for all 4 has only the trivial solution.
- (A2) Nonsingularity at Real Minimizers: All real optimal solutions 5 must be nonsingular for the constraint Jacobian 6 (i.e., 7 is of full rank 8).
Main Theorem (Explicit Bound):
Under (A1)-(A2), the Lasserre hierarchy attains the exact minimum at
9
meaning 0 for all 1 (Hua et al., 2021).
In SOS dual form, the optimality certificate is: 2 where 3 is an SOS (sum of at most two squares), and the degrees of 4 and 5 are both bounded by 6.
3. Algebraic–Geometric and Positivity Mechanisms
The proof utilizes projective algebraic geometry:
- The absence of solutions at infinity implies the constraints define a complete intersection zero-dimensional variety, giving rise to precise Hilbert series and basis properties ("H-basis") for the constraint ideal.
- For any 7 in the constraint ideal 8, there exist 9 of appropriate degree so that 0 with 1.
- Over the real points, nonsingularity at minimizers allows the construction of a sum-of-squares positivity certificate on the variety.
Using these facts, the difference 2 is shown, modulo the ideal, to be a sum of squares (at most two squares) and constraints, allowing the explicit degree bound above.
4. Specialized Cases: Unconstrained, Gradient, and Binary Optimization
- Unconstrained minimization reduces to the case of 3 equality constraints 4, i.e., vanishing gradient. The explicit degree bound for finite convergence of the "gradient-type" Lasserre (SOS) relaxation is
5
yielding exact recovery of the global minimum for all 6 under genericity and Hessian nonsingularity (Hua et al., 2021).
- Grid case (7) retrieves earlier degree bounds such as Laurent's 8.
- Binary optimization problems over 9 (e.g., quadratic or higher-order pseudo-Boolean problems) fit into this framework; for quadratic objectives, the degree bound becomes 0, generalizable to higher degree (Hua et al., 2021).
5. Importance of Flat Truncation, Extraction, and Practicality
For finite convergence, it is necessary and sufficient (under suitable genericity) that the moment matrix 1 exhibits "flat truncation," i.e., rank stability in 2 and 3 for some 4, where 5 (Nie, 2011). This property enables numerical extraction of all optimizers via spectral decomposition of 6.
From an implementation viewpoint, no relaxation order above 7 is required: SDPs of order 8 are sufficient to recover 9 and minimizers, dramatically reducing computational complexity in finite-variety regimes.
6. Broader Context: Varieties, Certificates, and Generalizations
The finite convergence and explicit degree bound results extend prior theory:
- For real varieties with finite solution sets, Lasserre's hierarchy converges in finitely many steps, independently of whether the complex variety is finite (Nie, 2012).
- Certificates based on genericity and critical point exactness can be generated for radical and non-radical ideal cases, and for both gradient-ideal and classical grid or binary settings.
- In the convex setting, under a saddle-point and strict Hessian condition (not strict convexity of 0 itself), the hierarchy also enjoys finite convergence (Jeyakumar et al., 2013). More generally, convergence (possibly only asymptotic) is guaranteed under Archimedean or compactness conditions (Tacchi, 2020).
These results provide theoretical and practical guidelines for when semidefinite-based polynomial optimization yields exact answers after finitely many SDP steps.
7. Implications, Limitations, and Scope
- The explicit bounds apply generically in the coefficient space: the “no solution at infinity” and “nonsingularity” hypotheses are satisfied on a Zariski-open set of constraint tuples of fixed degrees.
- Non-generic or singular cases (e.g., solutions at infinity, singular minimizers, or non-reduced varieties) may exhibit only asymptotic convergence or may require more advanced Positivstellensatz certificates.
- The theoretical results apply to a substantial class of structured polynomial optimization problems, such as those arising in discrete, binary, grid, or generic gradient-vanishing contexts, and now provide sharp degree bounds absent in the previous literature.
The finite convergence at an explicit and computable relaxation order enables efficient global optimization in all scenarios where the variety defined by the constraints is finite and sufficiently regular [(Hua et al., 2021); (Nie, 2012); (Nie, 2011)].