---
title: 'Sequential Linear Programming: Methods & Applications'
url: https://www.emergentmind.com/topics/sequential-linear-programming-slp
type: topic
---

# Sequential Linear Programming: Methods & Applications

Sequential Linear Programming (SLP) is a class of iterative algorithms for solving nonlinear programs (NLPs) and mathematical programs with equilibrium or complementarity constraints (MPECs or MPCCs), in which a sequence of linear programming subproblems approximates the nonlinear constraints and objective, subject to trust-region globalization mechanisms and active-set updates. SLP is characterized by its reliance on local linearization, its low per-iteration computational complexity, and its flexibility in enforcing feasibility and handling non-smooth or degenerate structures.

## 1. Core Algorithmic Framework

At each iteration, SLP constructs a linear program (LP) by Taylor expansion of the objective and constraints around the current iterate. The generic subproblem takes the form
\[
\min_{d} \nabla f(x^k)^T d \quad \text{s.t.} \quad \text{linearized constraints},\quad \|d\|_\infty \leq \Delta
\]
with $\Delta$ the trust-region radius. The solution $d^k$ determines the next iterate $x^{k+1} = x^k + d^k$ if sufficient model decrease is achieved, according to a ratio test between predicted and actual decrease. Trust-region update strategies serve to ensure global convergence, while maintaining constraint satisfaction and bounding step lengths.

For bound-constrained MPCCs, each iteration solves an LPCC (linear program with complementarity constraints) whose feasible set is the product of box constraints and 2D “crosses” enforcing $0 \le x_1 \perp x_2 \ge 0$; efficient enumeration of corner points yields $O(n)$ complexity per subproblem [2009.14047]. In classical SLP for smooth NLPs, both equality and inequality constraints are linearized, leading to a trust-region LP that is solved for descent directions [2212.02718], [2205.00754].

## 2. Trust-Region Globalization and Active-Set Estimation

SLP employs trust-region constraints ($\|d\|_\infty \leq \Delta$) to stabilize steps, prevent divergence, and ensure robust progress. The two main globalization paradigms are:

- **Merit-function ratio test**: Accept step $d^k$ if the actual reduction $f(x^k)-f(x^k+d^k)$ exceeds a fraction $\sigma$ of the predicted reduction $-\nabla f(x^k)^T d^k$.
- **Active-set estimation**: The structure of the LP solution identifies active bounds or complementarity pairs, informing the selection of which constraints to treat as equality in subsequent subproblems.

For MPCCs, after each LPCC step, the partitioned sets of active inequalities and complementarity components are updated [2009.14047]. In robust SLP frameworks, feasibility-refinement inner loops project infeasible steps back into the feasible set, either exactly (FSLP) or within a tolerance-tube (afSLP), via sequences of parametric LPs operating on zero-order constraint information [2212.02718], [2401.13840], [2205.00754].

## 3. Convergence Theory and Stationarity

Standard SLP under regularity assumptions converges locally linearly to KKT points in smooth NLPs [2212.02718]. For bound-constrained MPCCs, the relevant notion of stationarity is B-stationarity: a point $x^*$ is B-stationary if $d=0$ minimizes the linearized objective subject to both bounds and linearized complementarity constraints [2009.14047]. Global convergence to B-stationary points is guaranteed under Lipschitz continuity.

When active-set identification is correct, SLP algorithms equipped with a quadratic-programming refinement stage (BQP/SQP) can achieve local superlinear convergence [2009.14047]. Feasible SLP methods attain global convergence via trust-region contraction, projection-ratio criteria, and filter-type switches [2205.00754], [2401.13840]. Anderson acceleration applied to the feasibility-inner fixed-point process yields improved contraction rates and locally linear convergence [2212.02718].

## 4. SLP Variants and Extensions

Several prominent SLP variants address specific challenges:

- **Feasible SLP (FSLP)**: Ensures strict feasibility of all outer iterates via inner loop feasibility restoration, based on zero-order constraint evaluations [2212.02718], [2205.00754]. This enables early termination with feasible, suboptimal solutions—vital in real-time and safety-critical applications.
- **Almost Feasible SLP (afSLP)**: Permits iterates within a relaxed tube around the feasible set, reducing per-iteration feasibility cost and enabling infeasible initialization [2401.13840]. Tolerance-tube width is adaptively shrunk as feasibility is approached, controlled via a dual merit-filter and restoration LPs.
- **Anderson Accelerated FSLP**: Applies Anderson acceleration of arbitrary depth to the inner feasibility iterations, improving contraction and reducing total constraint evaluations, with significant speed-ups in robotics/NMPC benchmarks [2212.02718].
- **SLP for Complementarity and MPECs**: Coordinate-decomposed LPCC subproblems exploit the inherent 2D “cross” structure, yielding $O(n)$ solution time [2009.14047].

## 5. Application Domains and Benchmark Results

SLP methodologies are employed in diverse application areas:

- **Time-optimal control and trajectory planning (robotics, mechatronics, vehicles)**: FSLP, afSLP, and Anderson-accelerated FSLP have demonstrated superior efficiency, scaling linearly with problem size and outperforming interior-point solvers such as IPOPT in constraint evaluations and wall time when applied to discretized SCARA robot models [2212.02718], [2401.13840].
- **Pooling problem (process engineering)**: Multi-start SLP, especially when paired with the qq-formulation (proportional variables only), is empirically more efficient than SQP and IPOPT for finding high-quality solutions within practical time budgets, with hundreds-fold reductions in expected time to solution in industrial benchmarks [2002.10899].
- **AC optimal power flow (energy markets)**: An SLP algorithm solving a sequence of LPs with supporting hyperplane and halfspace cuts achieves AC-feasible solutions on large test cases (up to 3,375 buses), matching NLP solver accuracy (optimality gaps ≈$10^{-3}$%, constraint violation ≈$10^{-7}$) and exhibiting robust convergence from arbitrary initializations [2107.05164].
- **Trajectory optimization for compliant robotics**: Actuator-centered SLP with separation of linear actuator dynamics and nonlinear robot impedance dynamics, equipped with pseudo-mass tuning for discretization accuracy, enables fast convex subproblem solves and leverages compliance for higher performance [1802.10190].
- **Data-driven computational mechanics**: SLP algorithms with adaptive convex-hull trust-regions reliably quantify uncertainty in structural response bounds via efficient LPs, robust to noise and outliers, with convergence demonstrated on large truss and FE models [2211.04109].

### Table: Representative SLP Algorithmic Variants

| Variant                       | Feasibility Guarantee   | Stationarity Target     |
|-------------------------------|------------------------|------------------------|
| Classical SLP (NLP)           | No (outer steps may be infeasible) | KKT                   |
| FSLP                          | Yes (all iterates feasible)        | KKT                   |
| afSLP                         | Yes (within user ε)                | KKT                   |
| SLPCC (Complementarity)       | Yes (strict bounds, complementarity) | B-Stationarity       |
| SLP (Uncertainty Analysis)    | Yes (response bounds)              | None (interval bound) |

## 6. Complexity, Implementation, and Practical Considerations

SLP subproblems are LPs with trust-regions, leading to low per-iteration complexity. For large-scale problems, the dominant cost shifts to LP solve time and constraint evaluation (inner/outer loops). Efficient enumeration or parametric LPs in feasibility restoration can limit overhead [2212.02718], [2205.00754]. Adaptive tube-tolerances and filter-switching mechanisms preclude cycling and enable robust progress [2401.13840].

Critical implementation concerns include:

- Selection of initial trust-region radii, inner-loop contraction factors, and cut update rules.
- Management of accumulated cuts (hyperplanes/halfspaces) for nonconvex applications (e.g., OPF), to avoid bloated LP size [2107.05164].
- Interface with commercial LP solvers (CPLEX, Gurobi) to exploit modern simplex/interior-point implementations.

Parameter choices (e.g., hull size $N_c$, shrinkage factor $p$, tolerances $\sigma$) influence convergence rate, solution tightness, and LP size in data-driven SLP variants [2211.04109].

## 7. Connections, Impact, and Outlook

SLP generalizes the philosophy of sequential quadratic programming (SQP) to LP-only subproblems, offering distinct advantages for large, degenerate, or combinatorial NLPs. Its inherent modularity allows incorporation of advanced techniques such as:

- Active-set refinement via secondary QP subproblems for superlinear convergence [2009.14047].
- Feasibility restoration via LP projections ensuring all iterates can be early-stopped with feasibility [2205.00754].
- Acceleration via Anderson summation, dramatically reducing total iterations [2212.02718].
- Model-free uncertainty quantification for data-driven mechanics [2211.04109].

Empirical studies confirm SLP’s reliability, scalability, and computational efficiency across diverse benchmarks. The method’s strict feasibility enforcement and LP foundation make it attractive for embedded, real-time, and safety-critical optimization settings, as well as for emerging areas in industrial, energy, and robotic applications.

A plausible implication is continued expansion into hybrid and mixed-integer programs, domain-specific variance reduction strategies, and distributed or parallel SLP variants leveraging modern LP solver architectures.

Source: https://www.emergentmind.com/topics/sequential-linear-programming-slp