---
title: Discrete-Time Control Lyapunov Functions
url: https://www.emergentmind.com/topics/discrete-time-control-lyapunov-functions-dclfs
type: topic
---

# Discrete-Time Control Lyapunov Functions

Searching arXiv for recent and foundational papers on discrete-time control Lyapunov functions to ground the article in published work.
Discrete-time control Lyapunov functions (DCLFs) are Lyapunov-type certificates for controlled systems evolving on discrete time indices, typically written as \(x_{k+1}=f(x_k,u_k)\). In the cited literature, a DCLF is used to encode positive definiteness together with a one-step or multi-step decrease condition under an admissible control input, yielding stability guarantees for nonlinear systems, sampled-data implementations, distributed model predictive control (MPC), event-triggered controllers, reinforcement learning, and neural verification pipelines [2605.01978], [2103.03937], [2508.19678], [2305.06547].

## 1. Formal definitions and canonical inequalities

A standard discrete-time formulation considers the system
\[
x_{k+1}=f(x_k,u_k), \qquad x_0\in\mathbb R^n,\;u_k\in\mathcal U,
\]
with \(f\) continuous, \(f(0,0)=0\), and locally Lipschitz in \(x\). In this setting, a continuously differentiable function \(V:\mathbb R^n\to\mathbb R_{\ge 0}\) is a discrete-time CLF on a domain \(\mathcal D\ni 0\) if there exist class-\(\mathcal K_\infty\) functions \(\underline\alpha,\overline\alpha\) and a constant \(\kappa\in(0,1)\) such that
\[
\underline\alpha(\|x\|)\le V(x)\le \overline\alpha(\|x\|),
\]
and, for every \(x\in\mathcal D\), there exists \(u\in\mathcal U\) satisfying
\[
V(f(x,u))-V(x)\le -\kappa V(x).
\]
This yields the equivalent one-step contraction
\[
V(x_{k+1})\le (1-\kappa)V(x_k),
\]
which is the discrete-time exponential-decay form used explicitly in stability analysis and CLF-guided reinforcement learning [2605.01978].

A closely related classical formulation uses a continuous \(V:\mathbb R^n\to\mathbb R_{\ge 0}\) together with class-\(\mathcal K_\infty\) functions \(\alpha_1,\alpha_2,\alpha_3\) and a scalar \(\rho\in[0,1)\) such that
\[
\alpha_1(\|x\|)\le V(x)\le \alpha_2(\|x\|),\qquad
\min_{u\in\mathcal U}V(f(x,u))\le \rho V(x)-\alpha_3(\|x\|).
\]
Equivalent treatments replace the right-hand side by a positive-definite decrement \(W(x)\), writing \(V(f(x,u))-V(x)\le -W(x)\). Under these conditions, the closed loop is asymptotically stable [1003.0634].

In distributed multi-agent formation control, the same idea is specialized to pairwise deviation coordinates. With
\[
y_{ij}(t)=x_i(t)-x_j(t)-d_{ij}\in\mathbb R^n,
\]
a continuously differentiable \(v:\mathbb R^n\to\mathbb R\) is called a DCLF if there exist constants \(c_1>0\), \(c_2>0\), and \(0<\lambda'\le 1\) such that
\[
c_1\|y_{ij}(t)\|^2\le v(y_{ij}(t))\le c_2\|y_{ij}(t)\|^2,
\]
and
\[
\Delta v(y_{ij}(t))+\lambda'v(y_{ij}(t))\le 0,\qquad
\Delta v(y_{ij}(t)):=v(y_{ij}(t+1))-v(y_{ij}(t)).
\]
Equivalently,
\[
v(y_{ij}(t+1))\le (1-\lambda')v(y_{ij}(t)).
\]
Defining \(\lambda:=1-\lambda'\), this becomes \(v(y_{ij}(t+1))\le \lambda v(y_{ij}(t))\) with \(0<\lambda<1\) [2508.19678].

## 2. One-step, finite-step, and average-descent variants

A recurrent distinction in the literature is between strict one-step decrease and relaxed multi-step decrease. The one-step case gives the most direct exponential estimate: if a feedback policy always selects a control satisfying
\[
V(f(x,u))-V(x)\le -\kappa V(x),
\]
then
\[
V(x_k)\le (1-\kappa)^kV(x_0),
\]
and the origin is exponentially stable [2605.01978].

A common misconception is that a DCLF must decrease at every sampling instant. Several cited works explicitly relax that requirement. Finite-step control Lyapunov functions (fs-CLFs) require contraction only after a fixed number \(M\) of steps. For the system
\[
x_{k+1}=g(x_k,u_k),
\]
an fs-CLF \(V\) satisfies
\[
\underline\alpha(\omega(x))\le V(x)\le \overline\alpha(\omega(x)),
\qquad
V(x(M;x,q(x)))\le \alpha(V(x)),
\]
for an admissible finite-step feedback \(q\) and a contraction \(\alpha\in\mathcal K\) with \(\alpha(r)<r\) for \(r>0\). Repeated application of \(q\) renders the closed-loop trajectories asymptotically \(\omega\)-stable in the target set \(\mathcal A\) [1908.09660].

Generalized DCLFs extend the relaxation further by enforcing average descent over a horizon \(N\). For
\[
x_{k+1}=f(x_k,u_k),
\]
a generalized DCLF \(V\) of horizon \(N\) satisfies
\[
\sum_{k=i}^{i+N-1}\bigl[V(x_{k+1})-V(x_k)\bigr]\le -\alpha(\|x_i\|).
\]
This average-descent constraint permits temporary increases in \(V\) so long as there is net decay over the window. Under the stated small-control property, the existence of such a generalized DCLF implies convergence and Lyapunov-type asymptotic stability [2211.02780].

The dissipativity-based control dissipation function (CDF) framework yields an equivalent multi-step perspective. Here one imposes the dissipation inequality
\[
V(x_{k+1})-V(x_k)\le w(x_k,u_k)
\]
together with a cyclically negative supply:
\[
\sum_{i=0}^{M-1}w(x_{k+i},u_{k+i})\le -\alpha_s(\|x_k\|).
\]
Positive-definite storage and cyclically negative supply yield asymptotic Lyapunov stability, and the cited paper states that a CDF with cyclically negative supply is equivalent to a finite-step CLF [2104.07105].

| Variant | Decrease requirement | Representative source |
|---|---|---|
| One-step DCLF | \(V(x_{k+1})-V(x_k)\le -\kappa V(x_k)\) | [2605.01978] |
| fs-CLF | \(V(x(M;x,q(x)))\le \alpha(V(x))\) | [1908.09660] |
| Generalized / dissipative form | Average descent or cyclically negative supply over \(N\) or \(M\) steps | [2211.02780], [2104.07105] |

This family of relaxations is used to reduce conservativeness. The flexible-CLF overview by M. Lazar states that classical CLFs can be overconservative, and that making the contraction rate a decision variable allows non-monotonicity to be explicitly linked with a decision variable optimized on-line [1003.0634].

## 3. Optimization-based synthesis and MPC embeddings

DCLF conditions are frequently embedded directly into finite-horizon optimization. In sampled-data stabilization via quadratically constrained quadratic programs (QCQPs), the zero-order-hold implementation of a continuous-time control-affine system is represented by a discrete-time map \(x_{k+1}=f_d(x_k,u_k)\), and a DCLF is required to satisfy
\[
V(f_d(x,u))-V(x)\le -\alpha(V(x)).
\]
For a quadratic candidate \(V(x)=x^\top P x\), the Euler-expanded decrease inequality becomes a quadratic constraint in \(u\),
\[
u^\top \Lambda_h(x)u+2\lambda_h(x)^\top u+\ell_h(x)\le 0,
\]
and the controller is synthesized by the QCQP
\[
u^*(x)=\arg\min_{u\in\mathcal U}\|u\|^2
\quad \text{s.t.}\quad
u^\top \Lambda_h(x)u+2\lambda_h(x)^\top u+\ell_h(x)\le 0.
\]
Under feedback linearizability, local exponential stability of the zero-dynamics, and consistency of the Euler approximation with the exact map, the resulting closed loop is uniformly ultimately bounded, with the ultimate bound made arbitrarily small by choosing the sampling period \(h\) small [2103.03937].

In distributed safety-critical MPC for multi-agent systems, DCLFs appear as terminal constraints. Using estimated neighbor states, the predicted deviations are
\[
\tilde y_{ij}(k|t)=x_i(k|t)-x_j^e(k|t)-d_{ij}.
\]
The terminal constraint is imposed as
\[
v(\tilde y_{ij}(T_p|t))
\le
\begin{cases}
\lambda^{T_p}v(\tilde y_{ij}(T_p|0)), & t=0,\\[2mm]
\lambda v(\tilde y_{ij}(T_p|t-1)), & t>0,
\end{cases}
\]
and the paper states that the terminal inequality
\[
v(\tilde y_{ij}(T_p|t))
=
\sum_{j\in\mathcal N_i}\|\tilde y_{ij}(T_p|t)\|^2
\le
\lambda v(\tilde y_{ij}(T_p|t-1))
\]
drives all deviations to zero asymptotically. Under Assumption 1, feasibility at \(t=0\) implies recursive feasibility for all future \(t\in\mathbb N\), and the receding-horizon DSMPC law ensures \(\lim_{t\to\infty}\|y_{ij}(t)\|\le \epsilon\) for any prescribed tolerance \(\epsilon>0\), while safety is maintained by the barrier constraints [2508.19678].

The fs-CLF and generalized-DCLF formulations also enter MPC directly. One approach uses the fs-CLF as the running cost in contractive multi-step MPC, contractive updated multi-step MPC, and classic MPC. Another embeds average-descent constraints into a flexible-step MPC OCP and then implements a variable number of open-loop controls before the next optimization. Under the stated terminal-set and small-control assumptions, these schemes guarantee recursive feasibility and asymptotic stability [1908.09660], [2211.02780].

## 4. Sampled-data, stochastic, and event-triggered DCLFs

In stochastic sample-and-hold control, the DCLF viewpoint is applied to a continuous-time system sampled every \(\delta>0\) with the control held constant between sampling instants. On a ball \(\mathcal B_R\), a function \(V:\mathbb R^n\to\mathbb R_{\ge 0}\) is called a DCLF if there exist class-\(\mathcal K_\infty\) functions \(\alpha_1,\alpha_2,\alpha_3\) and numbers \(\lambda>0,\eta\ge 0\) such that
\[
\alpha_1(\|x\|)\le V(x)\le \alpha_2(\|x\|),
\]
and the sample-to-sample increment satisfies an almost-sure bound
\[
V(X_{(k+1)\delta})-V(X_{k\delta})
\le
-\delta\,\alpha_3(\|X_{k\delta}\|)
+\delta\,\nu(\|X_{k\delta}\|,Z,\lambda,\delta,\eta),
\]
together with a corresponding bound in expectation. The central result states, roughly, that if there is a generally non-smooth control Lyapunov function, then the stochastic system can be practically stabilized in sample-and-hold mode. The construction uses Moreau–Yosida regularization, inf-convolution, proximal subgradients, and lower Dini derivatives, and yields almost-sure practical stability and practical stability in mean under sufficiently small \(\delta\), noise bound \(Z\), and optimization error \(\eta\) [2205.13409].

Event-triggered parameterized control for discrete-time linear systems uses the quadratic DCLF
\[
V(x)=x^\top P x,\qquad P\succ 0,
\]
and imposes the contractive prediction funnel
\[
V(\hat x(t_k+\tau))\le \alpha^\tau V(x(t_k)),
\qquad \tau=0,1,\dots,M,\quad 0<\alpha<1.
\]
At each event time \(t_k\), the controller solves a convex QCQP for the parameter vector \(a(k)\), with quadratic constraints
\[
H_\tau(a)=V(\hat x(t_k+\tau))-\alpha^\tau V(x(t_k))\le 0,\qquad \tau=0,\dots,M.
\]
Between events it applies the time-parameterized input \(u(t)=P(\tau)a(k)\), monitors the Lyapunov-based predictor \(\bar V(t+1|t_k)\), and triggers replanning when the predictor violates the funnel or a small-ball threshold. The resulting closed loop is globally uniformly ultimately bounded, and the inter-event times are non-trivial, with \(t_{k+1}-t_k\ge M\) [2411.12239].

These sampled-data and event-triggered formulations address a point emphasized in the QCQP-based sampled-data paper: continuous-time CLF-based quadratic programs do not address the gap between continuous-time design and discrete-time sampled implementation, which can lead to poor performance on hardware platforms [2103.03937].

## 5. Reinforcement learning and neural verification

A DCLF can be used as an explicit stability prior in reinforcement learning. In the CLF-guided RL formulation, the discrete-time decay condition
\[
V(f(x,u))-V(x)\le -\kappa V(x)
\]
is enforced indirectly through reward shaping. The per-step CLF-shaped reward is
\[
r_{\rm CLF}(x,u,x')
=
-\,\alpha\,V(x)
-\beta\max\{0,\;V(x')-(1-\kappa)V(x)\},
\]
where the first term penalizes large CLF values and the second penalizes decay violations. The cited work states that, by standard arguments in potential-based reward shaping, adding these terms does not alter the optimal policy but strongly encourages actions satisfying the discrete-time Lyapunov decrease. Its discrete-time theorem then gives exponential stability for any feedback policy that always selects a control satisfying the DCLF inequality [2605.01978].

The same paper verifies the theory numerically on the double integrator and cart-pole and implements CLF-guided rewards on a walking humanoid robot. For the double integrator, \(V(x)=x^\top P x\) is derived from the discrete Lyapunov equation, and the paper reports a numerical decay rate \(\kappa\approx 0.15\) for typical \(T=0.02\,\mathrm s\). For the cart-pole, the nonlinear decay condition is shown in the ball \(\|x\|\le \delta\approx 0.1\) with \(\kappa\approx 0.08\), and the learned policy respects the discrete-time Lyapunov condition [2605.01978].

Neural Lyapunov control for discrete-time systems parameterizes both \(V_\theta\) and \(\pi_\beta\) as feed-forward ReLU networks, then verifies positivity and decrease conditions by mixed-integer linear programming. The method combines three ingredients: a mixed-integer linear programming approach for verifying the discrete-time Lyapunov stability conditions, a method for computing verified sublevel sets, and a heuristic gradient-based method for finding counterexamples. The experiments on four standard benchmarks are reported to significantly outperform state-of-the-art baselines; on path tracking the method outperforms recent neural Lyapunov control baselines by an order of magnitude in both running time and the size of the region of attraction, and on cartpole and PVTOL it is stated to be the first automated approach to return a provably stable controller [2305.06547].

## 6. Conservativeness, practical design choices, and representative applications

The literature repeatedly treats conservativeness as a central design issue. The flexible-CLF overview by M. Lazar states that a classical CLF enforces a cone with a fixed, predefined shape and that such a requirement often proves to be overconservative. Flexible CLFs therefore introduce on-line decision variables such as \(\rho_k\in[0,1]\) and \(c_k\ge 0\), and solve a small nonlinear program of the form
\[
\min_{(u,\rho,c)\in \mathcal U\times [0,1]\times \mathbb R_+}
\ell(x_k,u)+\gamma \rho^2+\sigma c^2
\]
subject to
\[
V(f(x_k,u))\le \rho V(x_k)-\alpha_3(\|x_k\|),
\qquad
V(x_k)\le c.
\]
The stated stability theorem guarantees \(\lim_{k\to\infty}x_k=0\) if the on-line program remains feasible and feasibility implies \(\rho_k<1\) whenever \(x_k\neq 0\), while allowing the sequence \(\{V(x_k)\}\) to be non-monotone [1003.0634].

The same overview sketches fast-sampling applications to a Buck–Boost DC–DC converter with sampling interval \(100\,\mu s\) and an electromagnetic actuator controlled at \(500\,\mu s\). It states that the required on-line program solves in well under the sampling time on a standard 32-bit microcontroller, that the flexible-CLF region of attraction is up to \(2\)–\(3\times\) larger than that guaranteed by the best quadratic CLFs for the same constrained linearizations, and that transient performance measured in hardware experiments improves by \(20\)–\(40\%\) versus classical CLF–MPC schemes that enforce strict monotonicity [1003.0634].

Concrete parameter choices also appear in distributed MPC. In the cited multi-agent simulation, each vehicle uses
\[
v(\tilde y_{ij})=\|\tilde y_{ij}\|^2,\qquad
\lambda=0.9\;(\Rightarrow \lambda'=0.1),
\]
with horizon \(T_p=3\) or \(5\) and weighting matrices \(Q=I_4,\;R=I_2\). Under these settings, all inter-agent deviations converge to within the desired \(\epsilon\), while the CBF-based safety constraints prevent collisions with obstacles or other agents [2508.19678].

The CDF framework shows the same tradeoff through horizon parameters. For interconnected synchronous generators with nonlinear coupling and state/input constraints, the paper reports that with kernel \(l(x)=x^\top Qx\) and horizon \(N=4\), one needs \(M=5\) to enforce cyclically negative supply and achieve convergence; with \(N=9\), \(M=1\) suffices because the \(9\)-step CDF is already a one-step CLF [2104.07105].

Several limitations are stated explicitly. For fs-CLFs, the existence of an fs-CLF and the minimal step size \(M\) must be established a priori; contractive MPC introduces a potentially nonconvex terminal constraint; and classic MPC without terminal ingredients typically needs longer horizons \(N\) [1908.09660]. A plausible implication is that DCLF design is often less about a single canonical inequality than about choosing an admissible decrease notion—one-step, finite-step, average-descent, or dissipativity-based—that matches the sampling, communication, and computational structure of the control architecture.

Source: https://www.emergentmind.com/topics/discrete-time-control-lyapunov-functions-dclfs