---
title: Distributed Finite-Horizon LQR
url: https://www.emergentmind.com/topics/distributed-finite-horizon-linear-quadratic-regulator-lqr
type: topic
---

# Distributed Finite-Horizon LQR

Searching arXiv for relevant papers on distributed finite-horizon LQR and closely related formulations.
Distributed finite-horizon linear quadratic regulator (LQR) denotes the class of optimal control problems in which a linear system is regulated over a finite horizon under quadratic performance criteria, while the controller synthesis or implementation is constrained by network structure, locality, communication delays, privacy requirements, or restricted information patterns. In the distributed setting, the classical finite-horizon objective is retained, but the admissible controller class is narrowed by architectural constraints, leading to formulations based on localized closed-loop responses, local predictive trajectories reconstructed from data, structured time-varying gains, cooperative multi-agent Riccati-like recursions, or privacy-aware neighbor interactions [1409.6404] [2003.09813] [1912.08774] [2107.12596] [2509.11917].

## 1. Canonical formulations and problem classes

The standard finite-horizon LQR problem for a linear system
\[
x_{t+1} = A x_t + B u_t + w_t
\]
or, in disturbance-free form,
\[
x(t+1)=A x(t)+B u(t),
\]
seeks to minimize a quadratic performance index over a horizon \(T\). One representative form is
\[
J = \sum_{t=0}^{T-1} x_t^\top Q\,x_t + u_t^\top R\,u_t + x_T^\top Q_f\,x_T,
\]
while another uses a terminal equality constraint \(x(T)=0\) and omits an explicit terminal cost [1409.6404] [2003.09813].

What distinguishes the distributed finite-horizon case is not the stage cost itself, but the controller class. In localized response-based design, the optimization is carried out directly over closed-loop disturbance-to-state and disturbance-to-input maps \((R,M)\) subject to finite impulse response (FIR) and spatial support constraints [1409.6404]. In data-based predictive control, the same finite-horizon quadratic objective is reformulated from a single measured trajectory through local Hankel constraints, without explicit knowledge of \(A,B\) [2003.09813]. In cooperative multi-input regulation, each input channel is assigned to an agent that possesses only its local \(B_i\) and \(R_i\), and neighbor-only information fusion replaces a centralized Riccati recursion [2107.12596]. In distributed output-feedback, a finite-horizon controller is constrained to a linear subspace \(\mathcal{K}\) encoding causality and information structure, with tractability tied to Quadratic Invariance (QI) [1912.08774].

A useful way to classify the literature is by the object being optimized.

| Formulation family | Main optimization variable | Representative work |
|---|---|---|
| Localized response-based design | Closed-loop responses \((R,M)\) | [1409.6404] |
| Data-based predictive control | Local trajectory coefficients \(g_i\) and predicted trajectories | [2003.09813] |
| Subspace-constrained output-feedback | Causal controller \(K\in\mathcal{K}\) | [1912.08774] |

This taxonomy suggests that distributed finite-horizon LQR is not a single algorithmic template. It is a family of structurally constrained optimal control problems whose solvability depends on whether the imposed information pattern admits a tractable reformulation.

## 2. Locality and system-level response parameterization

A central response-based formulation is the localized LQR (LLQR), developed for localizable distributed systems [1409.6404]. The key design variables are strictly proper closed-loop response operators \(R\) and \(M\) satisfying
\[
x = R\,w,\qquad u = M\,w,
\]
where \(R\) maps disturbances to states and \(M\) maps disturbances to inputs. The system is state-feedback localizable over radius \(d\) and horizon \(T\) if these responses satisfy four conditions: plant consistency, FIR temporal support, spatial sparsity, and implementability under communication delays that do not exceed plant propagation [1409.6404].

Spatial locality is encoded through graph neighborhoods. For adjacency support \(\mathrm{sp}(A)\), the forward neighborhood of node \(j\) with radius \(d\) is
\[
\mathcal{F}_{(j,d)} := \bigl\{s \,\big|\, \mathrm{dist}(j,s; \mathrm{sp}(A)) \le d \bigr\},
\]
and the backward neighborhood is
\[
\mathcal{E}_{(j,d)} := \bigl\{s \,\big|\, \mathrm{dist}(s,j; \mathrm{sp}(A)) \le d \bigr\}.
\]
These sets separate disturbance propagation from information aggregation. Intuitively, a disturbance injected at state \(j\) affects only a forward cone of states and actuators for \(T\) steps, while the controller exchanges only locally estimated disturbances over compatible backward cones [1409.6404].

The localized FIR constraint spaces \((\mathcal{S}_x,\mathcal{S}_u)\) require that \(R\) and \(M\) vanish after \(T\) steps and obey support relations aligned with \(\mathrm{sp}(A)\) and \(\mathrm{sp}(B)\). The dynamics consistency constraints are
\[
R[k+1] = A\,R[k] + B\,M[k],\qquad R[1]=I,
\]
with \(R[k]=0\) and \(M[k]=0\) for \(k\ge T+1\). In compact system-level synthesis (SLS) form,
\[
(I - Z A)\,\Phi_x - Z B\,\Phi_u = I,
\]
where \(\Phi_x,\Phi_u\) are block-lower-triangular operators representing the horizon-stacked responses. This equality encodes exactly the closed-loop maps from disturbances to state and input consistent with the plant [1409.6404].

The significance of this representation is that locality is imposed on the achieved closed-loop behavior rather than on the controller matrix alone. This is a substantive shift. A sparse controller gain need not produce localized state propagation, whereas localized closed-loop responses guarantee both bounded disturbance spread and finite settling time.

## 3. Local decomposition, realization, and analytic LLQR synthesis

The localized formulation admits a local-global equivalence that is central to scalability. For a disturbance injected at node \(j\), all nonzero state and input trajectories lie within \(\mathcal{F}_{(j,d)}\) and \(\mathcal{F}_{(j,d+1)}\). Restricting the dynamics to these neighborhoods yields reduced variables \(x_{(j,d)}\), \(u_{(j,d)}\) and a reduced plant \((A_{(j,d)},B_{(j,d)})\), together with an affine horizon-stacked relation
\[
X_{(j)} = W_{(j)} + C_{(j)} U_{(j)}.
\]
Theorem-level equivalence states that a feasible local solution corresponds, through zero-padding embeddings \(E_x,E_u\), to the \(j\)-th columns of a globally feasible \((R,M)\), and conversely any globally feasible \((R,M)\) induces feasible local solutions [1409.6404].

The LLQR objective is then posed directly in the response variables:
\[
\min_{\{R[k],M[k]\}_{k=1}^T}
\sum_{k=1}^{T} \operatorname{Trace}\!\big(R[k]^\top \mathcal{Q}\,R[k] + M[k]^\top \mathcal{R}\,M[k]\big)
\]
subject to the response dynamics and support constraints. This is a convex quadratic program with linear equalities and structured sparsity. After eliminating zero-supported components, each reduced local problem becomes a quadratic program with equality constraints, and the unique optimum is obtained from a linear KKT system:
\[
\begin{bmatrix}
\mathcal{R}_r + C_b^\top \mathcal{Q}_r C_b & C_a^\top\\[3pt]
C_a & 0
\end{bmatrix}
\begin{bmatrix}
U_r^\ast\\ \lambda^\ast
\end{bmatrix}
=
\begin{bmatrix}
-C_b^\top \mathcal{Q}_r W_b\\ -W_a
\end{bmatrix}.
\]
The per-source design therefore reduces to independent local linear solves, and the complexity scales with the horizon \(T\) and neighborhood size rather than the global plant dimension [1409.6404].

Implementation is receding-horizon-like but is expressed through an internal disturbance estimator \(w_e\) and a reference generator \(x_r\):
\[
u[k] = \sum_{\tau=1}^{T} M[\tau]\,w_e[k-\tau],\qquad
x_r[k+1] = \sum_{\tau=1}^{T-1} R[\tau+1]\,w_e[k-\tau],
\]
\[
w_e[k] = x[k+1] - x_r[k+1].
\]
Under exact feasibility, one obtains \(w_e[k]=w[k]\), so the achieved closed-loop maps are exactly \(R\) and \(M\). Under approximate feasibility errors \(\Delta_\tau\), the estimator satisfies
\[
w_e[k] = w[k] + \sum_{\tau=1}^{T-1} \Delta_\tau\,w_e[k-\tau],
\]
and a small-gain argument yields bounded \(w_e\), \(x_r\), and \(u\) for small \(\|\Delta_\tau\|\), even when \(A\) is unstable [1409.6404].

The response-based cost also has an \(H_2\) interpretation. For additive white Gaussian noise with identity covariance, the long-run average LQR cost equals the response-based objective in expectation. This links impulse-response synthesis and mean-square performance without changing the local decomposition [1409.6404].

The benchmark reported for a 59-state tridiagonal chain with \(\rho(A)=1.0768>1\), sparse \(59\times 20\) actuation, \((d,T)=(9,29)\), and communication speed \(h=1.5\), is frequently used to illustrate the trade-off between locality and performance [1409.6404].

| Controller | Normalized objective value |
|---|---:|
| Ideal \(H_2\) (no delay, full communication) | 1.0000 |
| Delayed centralized \(H_2\) (\(h=1.5\), same graph) | 126.7882 |
| Optimal distributed \(H_2\) with QI constraints (\(h=1.5\)) | 1.1061 |
| LLQR (\(h=1.5\), \(d=9\), \(T=29\)) | 1.1142 |

These values support the paper’s claim that LLQR can achieve performance comparable to distributed or centralized \(H_2\) controllers while guaranteeing locality, FIR settling, and distributed implementability [1409.6404].

## 4. Data-driven and learning-based formulations

A second major direction replaces explicit model knowledge by data. In distributed data-based predictive control, a single persistently exciting trajectory \(w^d=\operatorname{col}(u^d,x^d)\) is used to build local Hankel matrices \(H_i\), and each agent enforces local data consistency constraints of the form
\[
H_i g_i = \text{collected past and future local signals},
\]
with predicted future trajectories coupled only through neighbor state variables [2003.09813]. The finite-horizon cost is block-diagonal and separable across agents, while the coupling appears in the local Hankel equalities and the terminal constraints \(x_i(T)=0\). Under controllability and identifiability conditions—either global persistent excitation of order \(n+\tau\), or locally verifiable a posteriori excitation conditions—the distributed data-based problem is an exact reformulation of the centralized finite-horizon LQR with terminal equality, without needing \(A,B\) [2003.09813].

The distributed solver in that framework is a continuous-time primal-dual saddle-point flow on the local quadratic program,
\[
\dot z_i = -2 Q_i z_i - F_{ii} A_i^T \lambda_i - \sum_{j\in N_i} F_{ij} A_j^T \lambda_j,\qquad
\dot \lambda_i = A_i z_{N_i} - b_i,
\]
combined with a distributed stopping certificate. If each agent ensures
\[
\bigl\|[\dot z_i;\dot \lambda_i]\bigr\| < \rho,
\qquad
\rho = \frac{\delta^2}{N\|M^\dagger\|^2},
\]
then the aggregate input deviation satisfies \(\|u-u^\ast\|<\delta\). The associated receding-horizon implementation is stabilizing for sufficiently small \(\delta\) [2003.09813].

A different strand studies distributed finite-horizon output-feedback under subspace constraints \(K\in\mathcal{K}\). In this setting, the controller is block-lower-triangular and constrained by a linear subspace encoding causality and information structure. When \(\mathcal{K}\) is QI with respect to \(C P_{12}\), the finite-horizon problem admits a Youla-type convexification via
\[
H(Q)=(I+Q C P_{12})^{-1}Q,
\]
and the transformed objective is strongly convex in the Youla-like variable \(Q\) [1912.08774]. This geometric property enables model-free zeroth-order learning of a globally optimal distributed output-feedback policy with explicit sample-complexity bounds. The paper states that the model-free sample complexity scales as
\[
\mathcal{O}\!\left(\frac{d^2}{\epsilon^2\delta^4}\log\!\frac{1}{\epsilon\delta}\right)
\]
up to constants [1912.08774].

Further learning-oriented adaptations appear in structured policy iteration and distributed zeroth-order reinforcement learning. A finite-horizon S-PI adaptation consistent with the derivations of "Structured Policy Iteration for Linear Quadratic Regulator" uses backward recursions
\[
P_T = Q_f,\qquad
P_t = Q + K_t^\top R K_t + (A + B K_t)^\top P_{t+1} (A + B K_t),
\]
forward covariance recursions
\[
\Sigma_{t+1} = (A + B K_t)\Sigma_t(A + B K_t)^\top,
\]
and proximal updates on \(K_t\) to enforce lasso, group-lasso, nuclear-norm, or proximity structure [2007.06202]. An implementation-oriented finite-horizon adaptation of asynchronous distributed zeroth-order block coordinate descent uses a learning graph \(G_L\) so that each agent can estimate its local policy gradient by local cost evaluation, without consensus, using episodic finite-horizon returns and block-wise randomized perturbations [2107.12416].

Taken together, these works show that model-based Riccati recursions are only one route to distributed finite-horizon LQR. Exact data-driven reformulations, QI-based convexification, structured proximal policy updates, and local zeroth-order learning all become viable once the information structure is encoded explicitly.

## 5. Cooperative, privacy-preserving, and other distributed architectures

In cooperative finite-horizon LQR for multi-input systems, each input channel is controlled by an agent that possesses only its local \(B_{i,k}\) and \(R_{i,k}\), while the shared plant evolves according to
\[
x_{k+1}=A_k x_k+\sum_{i=1}^m B_{i,k}u_{i,k}.
\]
The controller design uses a distributed information fusion strategy with one neighbor exchange per backward design step and one neighbor exchange per forward control step [2107.12596]. The backward phase computes coupled Riccati-like matrices
\[
\bar{P}_{k+1,i} = \bigl( \breve{P}_{k+1,i}^{-1} + B_{i,k} R_{i,k}^{-1} B_{i,k}^T \bigr)^{-1},
\]
\[
P_{k+1,i} = \Bigl( \sum_{j\in\mathcal{N}_i} \omega_{ij} \bar{P}_{k+1,j}^{-1} \Bigr)^{-1},
\qquad
\breve{P}_{k,i} = A_k^T P_{k+1,i} A_k + N Q_k,
\]
while the forward phase propagates virtual local states \(x_{i,k}\) whose sum equals the plant state. The local feedback law is
\[
u_{i,k} = K_{i,k}^{dis}\,\hat z_{i,k},
\qquad
K_{i,k}^{dis} = - ( R_{i,k} + B_{i,k}^T \breve{P}_{k+1,i} B_{i,k} )^{-1} B_{i,k}^T \breve{P}_{k+1,i}.
\]
Only joint controllability of the aggregate pair \((A_k,B_k)\) is required; individual local pairs may be uncontrollable [2107.12596]. The framework provides boundedness of gains in the time-varying case, convergence in the time-invariant case, and a finite-horizon performance upper bound
\[
J_M \le \frac{1}{N^2}\sum_{i=1}^N x_0^T \breve{P}_{0,i} x_0.
\]

A more recent direction incorporates differential privacy into distributed finite-horizon LQR consensus. For single-integrator agents
\[
x_i(t+1)=x_i(t)+u_i(t),
\]
each agent solves, at every time \(t\), a horizon-\(T\) quadratic tracking problem with local weights \((Q_i,R_i)\), while broadcasting noisy neighbor states \(\tilde x_j(t)=x_j(t)+\eta_j(t)\) [2509.11917]. The first optimal control move has the form
\[
u_i(t)=c(t)K_{Q_i,R_i,t}\sum_{j\in\mathcal N_i} a_{ij}(\tilde x_j(t)-x_i(t)),
\]
and privacy is enforced by consensus-error-dependent Laplace noise:
\[
\eta_i(t+1)\sim \operatorname{Lap}\!\left(
\frac{n c(t)p(t)\Delta_{i,t}\left\|\sum_{j\in\mathcal N_i} a_{ij}[\tilde x_j(t)-x_i(t)]\right\|_\infty}{\epsilon}
\right).
\]
Under assumptions on the graph, bounded gain sensitivity, and the co-designed sequences \(c(t)\) and \(p(t)\), the mechanism at time \(t\) is \(\epsilon_t\)-differentially private with \(\epsilon_t\le \epsilon/p(t)\), the overall privacy leakage is \(\sum_t \epsilon/p(t)\), and the disagreement process remains bounded in mean square [2509.11917]. The privacy-induced performance degradation scales as \(O(\epsilon^{-2})\).

A distributed-parameter extension appears in finite-horizon LQR control of the Lighthill-Whitham-Richards traffic PDE with in-domain variable speed limits. There the feedback law
\[
u(z,t)=-R^{-1}B^\ast P(z,t)\,y(z,t)
\]
is obtained from a space-time Riccati PDE rather than a matrix Riccati recursion [2606.03632]. Although this is not a networked multi-agent architecture, it shows that the finite-horizon LQR paradigm extends naturally to spatially distributed systems with localized actuation.

## 6. Assumptions, misconceptions, and active directions

Several assumptions recur across the literature. LLQR assumes state-feedback access, stabilizability of \((A,B)\), feasibility of the locality constraint pair \((\mathcal S_x,\mathcal S_u)\), and communication not slower than the imposed forward-cone locality [1409.6404]. The distributed data-based approach assumes controllability, full state measurements, feasibility for all valid past windows, and persistent excitation conditions strong enough to identify finite-horizon trajectories from a single sample trajectory; it does not include regularization or slack variables for noisy data [2003.09813]. The output-feedback learning framework assumes bounded noises and exploits local gradient dominance on compact sublevel sets; the strongest guarantees are established for QI information structures [1912.08774]. The cooperative multi-input method assumes a strongly connected communication graph, uniform controllability of the aggregate input pair, and bounded system matrices [2107.12596]. The privacy-preserving consensus framework assumes single-integrator dynamics, bounded sensitivity of local gains, and summability conditions on \(c(t)\) and \(p(t)\) [2509.11917].

A common misconception is that distributed finite-horizon LQR is simply a decentralized Riccati recursion with sparse gains. The surveyed formulations show otherwise. Response-based LLQR optimizes closed-loop maps rather than gains; data-based predictive control replaces model matrices by local Hankel equalities; subspace-constrained output-feedback treats structure as a geometric property of the admissible controller space; and privacy-preserving consensus modifies the cost and communication channels themselves [1409.6404] [2003.09813] [1912.08774] [2509.11917].

A second misconception is that model-free or data-based methods remove structural conditions. In fact, exact recovery of finite-horizon optimal trajectories from data requires persistent excitation and feasibility; global optimality of model-free distributed output-feedback learning relies on QI or related geometric regularity; and asynchronous zeroth-order distributed RL depends on the locality properties encoded by the learning graph [2003.09813] [1912.08774] [2107.12416].

The current research frontier is defined in the source material with unusual consistency. Reported extensions include output-feedback LLQR and robust variants; infinite-horizon localized LQR and model predictive control connections; time-varying plants and disturbance models; stronger robustness guarantees and explicit delay-locality tradeoffs; data-based terminal costs and terminal sets; noisy-data formulations with regularization or slack variables; extensions to sub-Gaussian noises; and safety-constrained learning and control [1409.6404] [2003.09813] [1912.08774]. This suggests that the central open problem is no longer whether finite-horizon LQR can be distributed, but which structural assumptions permit exactness, scalability, robustness, and implementability simultaneously.

Source: https://www.emergentmind.com/topics/distributed-finite-horizon-linear-quadratic-regulator-lqr