Deterministic Horizon: Theory & Applications
- Deterministic Horizon is defined as a fixed evaluation interval used in control theory, chaos, and AI to set boundaries for reliable prediction and computation.
- In finite-horizon systems like MJLS-LQR, it enables transforming stochastic problems into deterministic formulations that yield reduced-order Riccati equations.
- Beyond control applications, it quantifies numerical predictability in chaos and establishes architecture-determined limits in transformer-based trustworthy AI.
“Deterministic Horizon” is used in current literature in several technically distinct ways. In finite-horizon control, it denotes a fixed, non-random time interval such as , in contrast to random stopping times or asymptotic formulations; in this sense it is central to the deterministic reformulation of finite-horizon LQR for Markov Jump Linear Systems (MJLS) (Narváez et al., 18 Nov 2025). In deterministic differential games and optimal control, the phrase also marks the difference between finite deterministic horizons and infinite deterministic horizons on (Asri, 2010, Asri et al., 2021). In chaos, it denotes the horizon of predictability , namely the last time up to which a numerically computed orbit remains reliable under finite precision (Angelidis et al., 19 Oct 2025). Recent work in trustworthy AI uses “Deterministic Horizon” for an architecture-determined limit on transformer reasoning depth, denoted (Guo, 21 May 2026).
1. Core meanings across the literature
Taken together, these works use the expression in two main ways. The first is temporal and control-theoretic: a deterministic horizon is a fixed evaluation interval, either finite or infinite, on which dynamics, costs, and dynamic-programming equations are posed. The second is boundary-theoretic: a deterministic horizon is a computable limit on reliable prediction or reasoning, even when the underlying system is mathematically deterministic.
| Domain | Meaning of “Deterministic Horizon” | Representative papers |
|---|---|---|
| MJLS-LQR | Fixed interval with exact deterministic reformulation | (Narváez et al., 18 Nov 2025) |
| Deterministic impulse control / differential games | Finite or infinite deterministic time domain | (Asri, 2010, Asri et al., 2021, Asri et al., 2021) |
| Deterministic optimal control via LP | Infinite discounted horizon in discrete or continuous time | (Gaitsgory et al., 2017, Gaitsgory et al., 2017, Kamoutsi et al., 2017) |
| Receding-horizon control on deterministic systems | Finite prediction horizon used repeatedly online | (Ding et al., 2012, Svoreňová et al., 2013) |
| Chaos | Horizon of predictability under finite precision | (Angelidis et al., 19 Oct 2025) |
| Trustworthy AI | Architecture-determined reasoning-depth limit | (Guo, 21 May 2026) |
In the most explicit control-theoretic usage, “finite horizon” means that performance is evaluated over a fixed deterministic interval , with terminal time given and not random. This is stated directly in the MJLS-LQR formulation and contrasted there with infinite-horizon problems and stationary solutions (Narváez et al., 18 Nov 2025). The same contrast appears in deterministic finite-horizon minimax impulse control, where the horizon is a fixed 0, and in deterministic income-consumption problems, where consumption is optimized up to a finite deterministic time horizon 1 (Asri, 2010, Eisenberg, 2016).
2. Finite-horizon MJLS and deterministic reformulation
In "Finite-Horizon LQR for General Markov Jump Linear Systems: Deterministic Reformulation and Reduced-Order Solution" (Narváez et al., 18 Nov 2025), the deterministic horizon is the interval 2 for the continuous-time MJLS
3
where 4 is a homogeneous continuous-time Markov chain with finite state space 5 and generator matrix 6. The chain is fully general: no irreducibility or ergodicity is assumed, so transient, absorbing, and non-communicating states are allowed. The finite-horizon quadratic cost is
7
with 8 and 9 (Narváez et al., 18 Nov 2025).
The central move is to replace the stochastic state process by mode-indexed second moments
0
These are collected into 1 in the Hilbert space
2
equipped with inner product
3
Because the definition uses unconditional expectations multiplied by indicators, it remains well-defined even when 4 (Narváez et al., 18 Nov 2025).
For a feedback law 5, the second moments satisfy a deterministic linear ODE on 6: 7 where
8
The cost also becomes deterministic: 9 with 0 and 1. The stochastic finite-horizon LQR is therefore exactly equivalent to a deterministic optimal control problem on the same deterministic horizon 2 (Narváez et al., 18 Nov 2025).
This formulation is significant because the original system remains stochastic at the sample-path level, but the optimization problem no longer contains probability measures explicitly. In the paper’s synthesis, the horizon is deterministic, the reformulated problem is deterministic, and all stochasticity is encoded in the fixed coefficients of the deterministic equations (Narváez et al., 18 Nov 2025).
3. Visited states, reduced-order Riccati equations, and exact reduction
A distinctive feature of the general MJLS treatment is the projection onto the set of visited states
3
If 4, then 5 for all 6, and consequently
7
The second-moment trajectory therefore always lies in the subspace
8
The orthogonal projection 9 that zeros out unvisited coordinates yields restricted operators 0 and 1, and the resulting reduction is exact rather than approximate (Narváez et al., 18 Nov 2025).
Dynamic programming on this reduced deterministic problem yields a reduced-order system of coupled Riccati differential equations. The value functional has the quadratic form
2
and for each visited state 3,
4
with terminal conditions
5
Only 6 Riccati equations must be solved, rather than 7, so the deterministic horizon is paired with a mode-space reduction of dimension 8 instead of 9 (Narváez et al., 18 Nov 2025).
The optimal feedback law is the usual mode-dependent Riccati law restricted to visited states: 0 States outside 1 never occur on 2, so their gains are irrelevant. The framework naturally accommodates transient states, absorbing states, and multiple non-communicating recurrent classes; unreachable states become dead coordinates with 3 and 4 (Narváez et al., 18 Nov 2025).
The paper’s numerical examples support the exactness of this reduction. They report validation of the deterministic Riccati solution against Monte Carlo estimates with small relative error, approximately 5–6, and include a satellite orbit control example with an absorbing failure mode (Narváez et al., 18 Nov 2025).
4. Hamilton–Jacobi structure and matrix-space foundations
The deterministic reformulation in (Narváez et al., 18 Nov 2025) is not merely computational. It is tied to a Hamilton–Jacobi–Bellman equation posed on the matrix Hilbert space 7: 8 with terminal condition
9
The Fréchet gradient 0 is rigorously represented as an element of 1 via the Riesz–Fréchet representation theorem. This closes what the paper describes as an open conceptual gap in earlier work, where the quadratic value structure had been adopted as an ansatz without full derivation (Narváez et al., 18 Nov 2025).
This matrix-space HJB viewpoint clarifies what “deterministic horizon” means in the MJLS setting. The original control problem is stochastic because of Markovian jumps, but the horizon is fixed and deterministic, and the paper shows that over this interval the problem can be rewritten as deterministic dynamics plus deterministic integral and terminal costs in an augmented second-moment state (Narváez et al., 18 Nov 2025).
The result also situates the paper relative to classical continuous-time MJLS-LQR theory associated with Wonham, Mariton, and Costa–Fragoso. Classical treatments typically assume irreducibility or related communication hypotheses and sum over all modes. Here, the projection onto 2, the reduced-order Riccati system, and the Hilbert-space HJB formulation generalize that picture to arbitrary finite-state Markov chains (Narváez et al., 18 Nov 2025).
A common misunderstanding is therefore avoided by the deterministic reformulation: the phrase does not mean that the MJLS itself has ceased to jump. Rather, it means that on a fixed interval 3, optimal control can be carried out on a deterministic lifted system whose coefficients encode the original jump process (Narváez et al., 18 Nov 2025).
5. Deterministic horizons in broader control and game theory
Outside MJLS, the phrase retains its time-domain meaning but appears in several neighboring settings. In deterministic finite-horizon minimax impulse control, the horizon is the fixed interval 4, the value function is 5, and the problem is characterized by an Isaacs quasi-variational inequality with an explicit terminal condition at 6 (Asri, 2010). In deterministic income-consumption problems with stochastic interest-rate discounting, the optimization up to a finite deterministic time horizon 7 leads to a time-dependent HJB equation with terminal condition at 8, whereas the infinite-horizon versions are stationary and require different techniques (Eisenberg, 2016).
In deterministic receding-horizon control for finite transition systems under temporal-logic constraints, the horizon is a fixed prediction length 9. At each time step, the controller solves a finite-horizon optimization problem on a deterministic product automaton and applies only the first transition. Correctness with respect to an infinite LTL specification is enforced through terminal constraints derived from an energy function on the product automaton (Ding et al., 2012). A related framework for weighted deterministic transition systems with penalties and a specification of the form 0 combines an offline strategy minimizing expected average cumulative penalty per surveillance cycle with an online receding-horizon refinement over a finite horizon 1 (Svoreňová et al., 2013).
The infinite-horizon variant is equally prominent. Deterministic zero-sum impulse games with both players impulsive are posed on 2 with discount factor 3, and their value functions solve stationary HJBI quasi-variational inequalities (Asri et al., 2021). Deterministic differential games in which both players use continuous and impulse controls likewise produce stationary HJBI QVIs under Isaacs condition (Asri et al., 2021). In both cases, “infinite deterministic horizon” means that time is non-random and unbounded, so the PDE is stationary rather than backward in time (Asri et al., 2021, Asri et al., 2021).
A parallel strand formulates deterministic infinite-horizon optimal control through occupation measures and infinite-dimensional linear programming. Discrete-time discounted problems are rewritten as LPs over discounted occupational measures (Gaitsgory et al., 2017), while deterministic infinite-horizon discounted control in discrete time is linked to primal-dual LP formulations that yield necessary and sufficient optimality conditions and near-optimal controls (Gaitsgory et al., 2017). In continuous time, discounted deterministic optimal control with state constraints is relaxed to a measure LP equivalent to the original problem under mild assumptions, and polynomial data permit Lasserre-type moment/SOS relaxations (Kamoutsi et al., 2017). These papers use “deterministic horizon” in the sense of a fully deterministic time domain and deterministic system evolution, not in the sense of reduced-order finite-horizon reformulation.
The same terminology also appears in reinforcement learning and large-population games. "Deterministic Value-Policy Gradients" treats infinite-horizon discounted deterministic transitions and interprets the rollout length 4 in value-gradient estimation as a practical deterministic horizon for model-based backpropagation (Cai et al., 2019). "Truly Deterministic Policy Optimization" eliminates exploratory noise injection in essentially deterministic environments and reports strong performance on a robotic control task with a long horizon of 5 time steps (Saleh et al., 2022). In deterministic infinite-horizon LQ Nash games with many symmetric players, the 6 limit yields a mean-field-like deterministic aggregate, and the limiting stationary feedback approximates large finite-player equilibria (Papavassilopoulos, 2014).
6. Predictability, computable limits, and architecture-determined horizons
A different meaning appears in chaos theory. "How Far Can We Trust Chaos? Extending the Horizon of Predictability" formalizes the deterministic horizon as the horizon of predictability 7: the largest time or iteration up to which a numerically generated chaotic trajectory can be trusted, within a prescribed error tolerance, under finite-precision arithmetic (Angelidis et al., 19 Oct 2025). For local exponential divergence 8, the paper gives
9
where 0 is initial numerical accuracy, 1 is acceptable error, and 2 is the maximal Lyapunov exponent. For the analytic computation of the Logistic map with mantissa 3 and acceptable precision 4, it derives
5
In this usage, the system is mathematically deterministic, but the deterministic horizon is a numerical reliability boundary rather than a control interval (Angelidis et al., 19 Oct 2025).
The same paper shows that, by exploiting the conjugacy between the Logistic map and the Tent map and using exact rational arithmetic for the Tent map, one can construct chaotic time series whose horizon of predictability is effectively unlimited, with per-iteration error in the logistic coordinate bounded by
6
This shifts the term from time-domain determinism to a computable reliability threshold for deterministic dynamics under numerical representation (Angelidis et al., 19 Oct 2025).
A further extension appears in trustworthy AI. "The Deterministic Horizon: Impossibility Results as Design Specifications for Trustworthy AI Systems" defines the Deterministic Horizon 7 for decoder-only transformers as the maximal effective reasoning depth up to which step-wise reasoning remains reliably better than random (Guo, 21 May 2026). If chain-of-thought uses 8 steps through a stack of 9 layers, the effective reasoning depth is
0
The thesis defines
1
It reports 2 across twelve transformer architectures, gives an architectural scaling law
3
and fits the empirical form
4
Past the horizon, the thesis states a super-exponential accuracy envelope
5
and its fine-tuning impossibility theorem asserts that no architecture-preserving fine-tuning procedure can move the ceiling. The reported experiment on optimal-length traces yields only 6 percentage-point recovery at depth 7 (Guo, 21 May 2026).
These latter uses suggest a broader reinterpretation of the term. In control, the deterministic horizon is a prescribed time domain. In chaos and transformer reasoning, it becomes a computable boundary of reliable evolution imposed by numerical precision or architectural capacity. What remains constant across these usages is the role of the horizon as a sharp organizing boundary: before it, deterministic reasoning or control remains valid in the intended sense; beyond it, a different analytical regime begins (Angelidis et al., 19 Oct 2025, Guo, 21 May 2026).