Papers
Topics
Authors
Recent
Search
2000 character limit reached

Stochastic Optimal Linear Quadratic Controls with A Recursive Cost Functional in Infinite Horizon

Published 5 May 2026 in math.OC | (2605.04275v1)

Abstract: This paper is concerned with a stochastic linear quadratic (LQ, for short) control problem with a recursive cost functional in an infinite horizon. A main difficult is well-posedness of the BSDE in L<sup>1L<sup>1 and in infinite horizon. A notion of weighted L<sup>2L<sup>2-stabilizability is introduced and characterized, which will lead to an equivalence of the optimal control problem having recursive cost functional with a classical LQ problem. Then all the results of classical problems for open-loop and closed-loop solvability of such an LQ problem can be translated, in terms of the solvability of a forward-backward stochastic differential equation and that of algebraic Riccati equation. Finally, the nonhomogeneous is discussed.

Authors (2)

Summary

  • The paper extends infinite-horizon BSDE theory to drivers with weighted-$L^1$ integrability, establishing finiteness when $p_2>1+\Gamma^2/(2\Theta)$ and addressing a gap beyond standard $L^2$ assumptions.
  • The paper characterizes weighted $L^2$-stability and stabilizability through Lyapunov inequalities and transforms the recursive-cost problem into an equivalent classical stochastic LQ problem with modified system coefficients.
  • The paper derives open-loop solvability through an infinite-horizon FBSDE and closed-loop solvability through a weighted-stabilizing algebraic Riccati equation, while identifying direct solvability of the weighted correction equation as an open issue.

Problem formulation and the L1L^1 obstruction

The paper studies a stochastic linear-quadratic (LQ) optimal control problem in an infinite horizon where the cost functional is recursive in the sense of Duffie–Epstein stochastic differential utility: the cost is the value Y(0)Y(0) of a linear BSDE driven by the running cost f(s,X(s),u(s))f(s,X(s),u(s)) along the state-control pair of the system [A,C;B,D][A,C;B,D]:

dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.

The central technical difficulty is well-posedness. Since u()L2u(\cdot)\in L^2, the driver ff is merely L1L^1 in time and probability, and the paper works with an infinite horizon. The authors note that finite-horizon BSDEs with L1L^1 data are already delicate, and that existing infinite-horizon results (Peng–Shi, Yin, Sun–Yong, Fuhrman–Tessitore, and extensions to jumps by Yu, Wei–Yu, Luo–Li–Wei) all require at least LpL^p integrability, Y(0)Y(0)0. To the authors' knowledge, no prior work treats infinite-horizon BSDEs with merely Y(0)Y(0)1 drivers, so the paper first develops this theory.

The key device is a Doléans exponential discount weight Y(0)Y(0)2 solving Y(0)Y(0)3, Y(0)Y(0)4, i.e., Y(0)Y(0)5. A finite-horizon representation gives Y(0)Y(0)6, which motivates weighted spaces Y(0)Y(0)7 in which integrability is measured against Y(0)Y(0)8. The limit Y(0)Y(0)9 is well-defined provided f(s,X(s),u(s))f(s,X(s),u(s))0 or f(s,X(s),u(s))f(s,X(s),u(s))1 is weighted-f(s,X(s),u(s))f(s,X(s),u(s))2 integrable; the class of admissible drivers is dense in the weighted f(s,X(s),u(s))f(s,X(s),u(s))3 space but is not itself a vector space, a structural point the authors state explicitly. For f(s,X(s),u(s))f(s,X(s),u(s))4, the weighted integral is finite whenever

f(s,X(s),u(s))f(s,X(s),u(s))5

which generalizes the classical stability condition f(s,X(s),u(s))f(s,X(s),u(s))6 (the case f(s,X(s),u(s))f(s,X(s),u(s))7) of Sun–Yong. Thus the paper extends infinite-horizon f(s,X(s),u(s))f(s,X(s),u(s))8 BSDE solvability to the full range f(s,X(s),u(s))f(s,X(s),u(s))9.

Weighted [A,C;B,D][A,C;B,D]0-stabilizability

For the cost functional to be finite, the state and control must be integrable against [A,C;B,D][A,C;B,D]1. The paper introduces weighted [A,C;B,D][A,C;B,D]2-stability of [A,C;B,D][A,C;B,D]3 (the uncontrolled state is in [A,C;B,D][A,C;B,D]4) and weighted [A,C;B,D][A,C;B,D]5-stabilizability of [A,C;B,D][A,C;B,D]6 (existence of [A,C;B,D][A,C;B,D]7 with [A,C;B,D][A,C;B,D]8 weighted [A,C;B,D][A,C;B,D]9-stable). The main characterization is a Lyapunov inequality: dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.0 is weighted dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.1-stable if and only if there exists dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.2 with

dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.3

with a constructive proof via a finite-horizon ODE in dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.4 and passage to the limit, yielding the explicit solution dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.5. The practical consequence is a checkable criterion: weighted dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.6-stability of dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.7 is equivalent to ordinary dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.8-stability of the modified pair dY(s)=[ΘY(s)+ΓZ(s)f(s,X(s),u(s))]ds+Z(s)dW(s),Θ,Γ0.dY(s)=[\Theta Y(s)+\Gamma Z(s)-f(s,X(s),u(s))]ds+Z(s)dW(s),\qquad \Theta,\Gamma\ge 0.9, and analogously for stabilizability of u()L2u(\cdot)\in L^20 versus u()L2u(\cdot)\in L^21. A companion estimate for the nonhomogeneous system gives a uniform bound u()L2u(\cdot)\in L^22.

Under hypothesis (H4) — weighted u()L2u(\cdot)\in L^23-stabilizability with u()L2u(\cdot)\in L^24 a stabilizer, u()L2u(\cdot)\in L^25, u()L2u(\cdot)\in L^26, and u()L2u(\cdot)\in L^27 — the admissible set u()L2u(\cdot)\in L^28 (controls for which the recursive cost is well-defined) coincides with u()L2u(\cdot)\in L^29, and the paper formulates Problem (LQ) with open-loop and closed-loop solvability notions.

Equivalence with a classical LQ problem

The core structural result is a change of variables. Setting ff0 and ff1, the weighted system transforms into a classical (unweighted) controlled system ff2 with ff3, ff4, ff5, ff6, and the recursive cost becomes an ordinary integral cost with transformed (random) inhomogeneities ff7. Hence Problem (LQ) with recursive cost is equivalent to Problem (LQ̃), a classical stochastic LQ problem on the infinite horizon, and weighted stabilizability of the original system is equivalent to ff8-stabilizability of the transformed one. This equivalence is the paper's central simplification: all classical results transfer.

Translated solvability characterizations

Applying the Sun–Yong theory to (LQ̃) and translating back yields two characterizations. Open-loop solvability: a state-control pair ff9 is open-loop optimal if and only if the FBSDE

L1L^10

with L1L^11, admits an adapted solution satisfying the stationary condition L1L^12. Closed-loop solvability: Problem (LQ) is closed-loop solvable if and only if the modified algebraic Riccati equation

L1L^13

admits a weighted L1L^14-stabilizing solution L1L^15, with the optimal feedback gain L1L^16 and the correction process L1L^17, where L1L^18 solves a weighted backward ODE. A notable feature is that although L1L^19 and L1L^10 are deterministic, their weighted transforms L1L^11 are random, so the L1L^12-system is genuinely stochastic in the transformed problem while its translation back has deterministic coefficients.

Extension to nonhomogeneous dynamics

For systems with deterministic additive drift and diffusion terms L1L^13, the decomposition L1L^14 splits the cost into a part depending on L1L^15 and an additive term independent of both; the latter can be dropped, reducing the problem to the homogeneous case already treated. This reduction relies on the determinism of L1L^16 and L1L^17.

Limitations and open questions

Several caveats are stated by the authors. The admissible-driver class L1L^18 is not a vector space, so the well-posedness framework is inherently one-sided (requiring L1L^19 or LpL^p0 to be weighted integrable). The analysis is carried out for one-dimensional Brownian motion, with the multi-dimensional case asserted to be similar but not detailed. Most notably, the authors concede in a remark that they are not able to directly prove solvability of the weighted LpL^p1-equation by LpL^p2 itself; closed-loop solvability is established only via the transformed process LpL^p3, so a direct well-posedness proof of the weighted correction equation remains open. The extension section treats only deterministic nonhomogeneities; random LpL^p4 are not covered.

Conclusion

The paper extends infinite-horizon BSDE theory to drivers that are merely weighted-LpL^p5 integrable, introduces and fully characterizes weighted LpL^p6-stabilizability via Lyapunov equations and an equivalent classical stabilizability condition, and proves an exact equivalence between stochastic LQ control with recursive cost and classical stochastic LQ control. Through this equivalence, open-loop and closed-loop solvability of the recursive-cost problem are characterized respectively by an FBSDE and by a modified algebraic Riccati equation, transferring the entire classical theory to the recursive setting.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.