---
title: Control-Invariant Sets
url: https://www.emergentmind.com/topics/control-invariant-sets
type: topic
---

# Control-Invariant Sets

Control-invariant sets are subsets of the state space, or more generally of a constrained configuration space, from which a controlled dynamical system can be kept indefinitely inside prescribed constraints by suitable admissible inputs. In discrete time, for \(x^{+}=f(x,u)\) with state constraints \(X\) and input constraints \(U(x)\), a set \(X\subseteq \mathbb{R}^n\) is control invariant if \(\forall x\in X,\ \exists u\in U(x)\) such that \(f(x,u)\in X\) [2604.06776]. In continuous time, the same idea appears in controlled invariant sets and control sets, and in constrained control it is closely tied to viability, recursive feasibility, and safety-critical control [1805.11858][1810.10372][2411.04833].

## 1. Foundational definitions and variants

The basic discrete-time notion is accompanied by several standard variants. The **maximal control invariant set** \(X_{\mathrm{MCI}}\subseteq X\) is the largest control-invariant subset of the constraint set \(X\): it is control invariant, and every other control-invariant subset of \(X\) is contained in it [2604.06776]. Closely related notions differ only in the quantifiers or in the underlying dynamics. **Robust control invariant sets** require \(f(x,u,w)\in X\) for all disturbances \(w\) in a disturbance set. **Positive invariance** removes the existential control choice and concerns autonomous dynamics. **Viability kernels** characterize states from which constraints can be kept indefinitely and often coincide with the maximal control invariant set under deterministic control constraints [2604.06776].

In continuous-time nonlinear control systems \(\dot x=F(x,\omega)\), the literature distinguishes controlled invariant sets from **control sets**. A control set is a maximal controlled invariant region with approximate controllability, and for a control set with nonvoid interior both the control set and its interior satisfy the **no-return property**: if a trajectory returns to the set at time \(\tau\), then it must have remained in the set throughout \([0,\tau]\) [1805.11858]. This embeds invariance into a broader geometric theory of reachable regions.

Several domain-specific extensions redefine invariance around the timing or uncertainty structure of the control problem. For stochastic systems, **probabilistic controlled invariant sets** (PCISs) replace worst-case guarantees by trajectory-level probability thresholds over finite or infinite horizons; the infinite-horizon \(p=1\) case reduces to robust controlled invariance in the kernel formulation [1905.04117]. For impulsively controlled systems, where the state evolves freely between impulse times and control acts only at \(t=\tau_k\), the paper on impulsive systems defines **impulsive controlled invariant sets** relative to a target zone \(\mathcal Z\): every state in the set must evolve within \(\mathcal Z\) over the whole dwell interval and admit an admissible impulse that returns the sampled state to the set [2103.13831].

A recurrent misconception is to treat these notions as interchangeable. They are not. Control invariance uses an existential input quantifier, robust invariance changes it to a universal disturbance quantifier, positive invariance removes the control choice, and probabilistic invariance replaces hard set inclusion by probability thresholds. The distinctions are structural, not terminological [2604.06776][1905.04117].

## 2. Predecessor operators and fixed-point characterizations

The standard computational object behind control invariance is the **predecessor operator**. For any \(\Omega\subseteq \mathbb{R}^n\),
\[
\mathrm{Pre}(\Omega):=\{x\in\mathbb{R}^n:\exists u\in U(x)\ \text{s.t.}\ f(x,u)\in\Omega\}.
\]
The classical fixed-point recursion
\[
\Omega_{k+1}=\mathrm{Pre}(\Omega_k)\cap \Omega_k,\qquad \Omega_0=X
\]
converges to \(X_{\mathrm{MCI}}\) under compactness and continuity assumptions, and for LTI systems with polytopic constraints it terminates in finitely many steps [2604.06776]. This places maximal invariance in the broader class of greatest fixed-point problems.

For switched nonlinear systems, the same structure appears in mode-indexed form. With
\[
\mathrm{Pre}(\Omega):=\{x\in\mathbb{R}^n:\exists p\in\mathcal P\ \text{such that}\ f_p(x)\in\Omega\}
\]
or equivalently \(\mathrm{Pre}(\Omega)=\bigcup_{p\in\mathcal P} f_p^{-1}(\Omega)\), a set \(\Omega\) is controlled invariant if and only if \(\Omega\subset \mathrm{Pre}(\Omega)\). The maximal controlled invariant set inside \(\Omega\) is the fixed point of \(I(X)=\mathrm{Pre}(X)\cap X\), and interval-analysis algorithms compute outer and inner approximations of this fixed point in finitely many iterations [1608.08683].

For grid-based nonlinear methods, the predecessor concept can also be encoded graph-theoretically. In the graph algorithm for nonlinear cascade systems, a directed graph on state-space cells is built from the set-valued image \(F(B_i)=f(B_i,U)\), and strongly connected components together with paths to them identify non-leaving cells. The resulting outer approximations converge to the largest control-invariant set as the cell diameter goes to zero [2205.05622].

The fixed-point viewpoint is important because it separates the mathematical definition of invariance from any particular set representation. Polyhedra, interval unions, graph cell complexes, and algebraic templates all approximate the same predecessor-based object.

## 3. Joint state-control invariance and maximal state-control invariant sets

A major refinement of the classical state-space view is to work directly in the **joint state-control space**. Let
\[
Z:=\{z\in\mathbb{R}^{n+m}: x\in X,\ u\in U(x)\},\qquad z=[x;u].
\]
A set \(C\subseteq Z\) is **state-control invariant** if
\[
\forall (x,u)\in C,\ \exists u'\in\mathbb{R}^m\ \text{such that}\ [f(x,u);u']\in C.
\]
The corresponding **maximal state-control invariant set** \(C_{\mathrm{MSCI}}\subseteq Z\) is the largest state-control invariant subset of \(Z\) [2604.06776].

This construction strictly extends the classical maximal control invariant set. If \(\Pi_x(C)=\{x:\exists u,\ [x;u]\in C\}\) denotes projection onto the state coordinates and \(C(x)=\{u:[x;u]\in C\}\) denotes the state-dependent section, then
\[
\Pi_x(C_{\mathrm{MSCI}})=X_{\mathrm{MCI}},
\]
and, for every \(x\in X_{\mathrm{MCI}}\),
\[
C_{\mathrm{MSCI}}(x)=U_{\mathrm{inv}}(x):=\{u\in U(x): f(x,u)\in X_{\mathrm{MCI}}\}.
\]
Accordingly, the MSCI simultaneously encodes the maximal safe state set and the admissible invariance-preserving inputs at each safe state [2604.06776].

The joint-space predecessor operator is
\[
\mathrm{Pre}_z(\Omega):=\{(x,u)\in Z:\exists u^{+}\ \text{s.t.}\ [f(x,u);u^{+}]\in \Omega\}.
\]
For LTI systems \(x^{+}=Ax+Bu\) and a polytope \(\Omega\subseteq \mathbb{R}^{n+m}\) with state projection \(\Pi_x(\Omega)=\{x:H_{\mathrm{proj}}x\le g_{\mathrm{proj}}\}\), this specializes to
\[
\mathrm{Pre}_z(\Omega)=\{z\in\mathbb{R}^{n+m}: H_{\mathrm{proj}}[A\ B]z\le g_{\mathrm{proj}}\}.
\]
The MSCI is then the fixed point of
\[
\Omega_{k+1}=\mathrm{Pre}_z(\Omega_k)\cap \Omega_k,\qquad \Omega_0=Z,
\]
and for polytopic LTI systems the recursion terminates in finitely many steps [2604.06776].

The conceptual significance is that classical control invariance answers only where the state may remain, whereas state-control invariance also specifies which control values preserve that property. For constrained synthesis and safety filters, this extra information is operational rather than merely descriptive.

## 4. Computational frameworks

Model-based computation of control-invariant sets spans several distinct geometric paradigms. For polyhedral LTI systems, classical algorithms iterate predecessor operators in the state space, often through repeated polyhedral projection and intersection. High-dimensional alternatives replace explicit Minkowski sums, projections, and vertex enumeration by LP certificates for \(N\)-step invariance; these LP conditions scale to large systems, including examples with state and input dimensions \(30\) and \(15\), and in an earlier formulation produced a \(15\)-step approximation for dimensions \(20\) and \(10\) in less than two seconds [1810.10372][1708.04797].

For discrete-time switched nonlinear systems, interval-analysis methods represent sets as finite unions of boxes and use convergent inclusion functions to compute outer and inner approximations of maximal controlled invariant sets in finitely many iterations. Under a robustly controlled invariance condition, they also produce a partition-based invariance controller directly from the computation [1608.08683]. For discrete-time nonlinear control-affine systems, a related interval-and-polytope refinement method approximates the maximal controlled invariant set with guaranteed precision and computes sets of control inputs that enforce invariance; an accelerated version updates individual components of set unions rather than all at once [2304.11757].

For nonlinear cascade systems, graph-based methods discretize the state space into cells, construct a directed graph from set-valued images, compute non-leaving cells through strongly connected components, then decompose the system into overlapping subsystems for distributed computation. The global set is reconstructed and validated from subsystem solutions, and the approximation converges to the centralized graph-based result as the grid is refined [2205.05622].

Continuous-time geometric methods replace predecessor iteration by inequalities on support functions. For algebraic systems obtained from projected control systems, invariance of a convex set can be expressed as a support-function inequality valid for any convex set. This yields LMIs for ellipsoids and SOS or SDP conditions for polynomial and piecewise quadratic support functions; the same support-function framework extends to hybrid systems with mode-dependent flows and resets [2101.06990][2112.03394]. Piecewise semi-ellipsoidal sets constitute a convex-programming compromise between ellipsoids and polyhedra: they are quadratic on sectors, more expressive than ellipsoids, and less facet-intensive than fine polyhedra [2007.02770].

Robust and lifted formulations add further geometric structure. Automaton-based methods for discrete-time linear systems with measurable disturbances encode disturbance-reactive controllers as finite automata and compute robust positively invariant sets as linear inequalities in a lifted space of plant states and controller parameters, then project back to obtain robust controlled invariant sets [2109.12378]. For neural-network dynamical systems, set recursion over unions of hyperboxes together with mixed-integer encodings of ReLU networks yields control-invariant subsets with finite termination guarantees and supports mixed-integer MPC with recursive feasibility [2505.11546].

Across these frameworks, the main trade-off is between representational richness and tractability. Ellipsoids and LMIs are compact but can be conservative; polyhedra can be exact but may suffer from vertex or facet explosion; interval, graph, and lifted representations trade algebraic simplicity for scalable certification structures.

## 5. Data-driven and learning-based computation

A separate line of work computes invariant sets directly from data, without first identifying a complete model. One approach characterizes the maximum positively invariant and maximum controlled invariant sets as the zero level set of an optimizer \(v^\star\) of an infinite-dimensional LP over bounded functions. Restricting \(v\) to a finite-dimensional basis and imposing the Bellman-type inequality only on sampled one-step transitions yields a single finite-dimensional LP; the approximation is
\[
X_{N,K}=\{x\in X\mid v_{N,K}(x)\le 0\},
\]
and the method provides convergence rates, sample-complexity bounds, and hard outer guarantees when additional modeling information is available [1912.03256].

For disturbed LTI systems, a direct data-driven RCI method uses a single state-input trajectory and disturbance bounds to construct a feasible model set \(\mathcal M\), then solves LMIs in a semidefinite program to maximize \(\log\det(W)\), where \(W\) parameterizes a polytopic invariant set. The resulting polytopic RCI sets are of comparable size to model-based sets computed with exact system matrices, while also returning a state-feedback controller [2303.18154].

Failure-driven learning offers a different mechanism. The FAIL algorithm operates on deterministic LTI systems with unknown \(A,B\), joint polytopic state-input constraints, noiseless state and input measurements, and sufficient excitation. Starting from the full joint constraint polytope \(P_0=Z\), it collects one-step failing state-input pairs, identifies the violated projected state halfspace, regresses the corresponding predecessor halfspace directly in state-control space, and updates
\[
P_\ell \leftarrow P_{\ell-1}\cap \{z:\hat a_j^\top z\le g_j^{\ell-1}\}.
\]
The sequence is monotone,
\[
C_{\mathrm{MSCI}}\subseteq P_\ell \subseteq P_{\ell-1},
\]
and under the stated learning condition it reaches the MSCI in finitely many iterations [2604.06776]. In the reported double-integrator experiment, the algorithm learned the \(8\) predecessor halfspaces from \(6\) failing trajectories and recovered all \(14\) MSCI halfspaces in \(8\) iterations [2604.06776].

Control-oriented identification frameworks incorporate invariant sets into model learning itself. In quasi-LPV identification, one can regularize the model parameters by the size of a robust control invariant set of an associated uncertain linear model, so that model learning and invariant-set synthesis are coupled rather than decoupled. The regularization is the optimal value of a convex quadratic program in one formulation and of a differentiable robust optimization problem in a reduced-conservativeness formulation using tightened multiplicative uncertainty bounds [2411.18166][2505.07287]. A related neural-network line synthesizes invariant sets offline for ReLU models and then enforces them online through mixed-integer MPC, again making recursive feasibility a learned-model design objective rather than a post hoc verification step [2505.11546].

The main limitations are method-specific. The LP-on-transitions method may need rapidly growing basis size and sample density in high dimension [1912.03256]. The single-trajectory RCI construction requires a bounded feasible model set, which in turn demands rank conditions on the data [2303.18154]. FAIL assumes deterministic noiseless data and explicitly requires failures to reveal missing predecessor constraints [2604.06776].

## 6. Quantitative extensions, applications, and interpretive issues

Control invariance also admits quantitative generalizations. **Invariance pressure** extends invariance entropy by introducing a continuous potential \(f\in C(U,\mathbb{R})\). For an admissible pair \((K,Q)\), the pressure-generating functional
\[
a_\tau(f,K,Q):=\inf\left\{\sum_{\omega\in\mathcal S} e^{(S_\tau f)(\omega)}:\ \mathcal S\ \text{is }(\tau,K,Q)\text{-spanning}\right\}
\]
induces the invariance pressure
\[
P_{\mathrm{inv}}(f,K,Q)=\limsup_{\tau\to\infty}\frac{1}{\tau}\log a_\tau(f,K,Q).
\]
When \(f\equiv 0\), invariance pressure reduces to invariance entropy, and for linear systems with hyperbolic \(A\) the theory yields explicit upper bounds and exact formulas involving unstable eigenvalues and minimal long-term control cost [1805.11858].

Stochastic extensions replace worst-case invariance by probability thresholds. Finite- and infinite-horizon PCISs are computed through dynamic programming, LPs in discrete finite-horizon problems, MILPs in discrete infinite-horizon problems, and discretization schemes with convergence guarantees in continuous-space finite-horizon problems. An infinite-horizon PCIS can also be constructed as a stochastic backward reachable set from an RCIS contained in it [1905.04117]. This positions PCISs as a probabilistic complement to RCISs rather than a replacement.

Impulsive systems require yet another modification. For
\[
\dot x(t)=Ax(t),\qquad x(\tau_{k+1})=e^{AT}x(\tau_k)+Bu(\tau_k),
\]
the admissible set
\[
\mathcal Z_{\mathcal A}:=\{x\in\mathcal X: e^{At}x\in\mathcal Z\ \forall t\in[0,T]\}
\]
captures states whose uncontrolled inter-impulse evolution stays inside the target zone \(\mathcal Z\). An impulsive controlled invariant set must be contained in \(\mathcal Z_{\mathcal A}\), and a valid target zone must contain both an admissible invariant set and an equilibrium set. This leads naturally to zone MPC formulations that track invariant sets rather than points [2103.13831].

Several interpretive issues recur across the literature. First, maximality does not by itself provide a useful input description; this is why joint state-control constructions and methods that compute invariance-preserving input sets are consequential [2604.06776][2304.11757]. Second, safe-state geometry depends strongly on modeling assumptions: deterministic, robust, probabilistic, impulsive, and hybrid notions are mathematically distinct, even when all are described informally as “staying safe.” Third, computational ease depends on the chosen representation. Polyhedra, support functions, interval unions, lifted automata, and neural-network mixed-integer encodings all define valid invariant-set computations, but they optimize different trade-offs between exactness, scalability, and feedback recoverability [2007.02770][2505.11546].

Control-invariant sets therefore function both as a geometric object and as a synthesis interface. They delimit the states from which indefinite constraint satisfaction is possible, organize admissible control choices, and, in many modern formulations, are learned, approximated, or regularized jointly with the dynamical model itself.

Source: https://www.emergentmind.com/topics/control-invariant-sets