Papers
Topics
Authors
Recent
Search
2000 character limit reached

Dynamic System Optimum: Principles & Applications

Updated 9 July 2026
  • Dynamic system optimum is a framework that defines optimal temporal evolution by benchmarking the best admissible system trajectory under explicit constraints.
  • It is applied in online learning to reduce dynamic regret, in traffic assignment to minimize total travel time, and in dynamical systems to enhance global stability.
  • Techniques span proximal gradient methods, game-theoretic dynamics, and adjoint-based optimizations to capture time-varying optimality in diverse contexts.

Searching arXiv for recent and foundational uses of “dynamic system optimum” across online optimization, traffic assignment, and dynamical systems. Dynamic system optimum denotes a class of optimization benchmarks in which the reference object is the best admissible evolution of a system over time, rather than the best static configuration. Across the literature, the term appears in several technically distinct settings. In online convex optimization, it refers to a time-varying comparator sequence constrained by a path-variation budget, and optimality is assessed through dynamic regret (Zhao et al., 2018). In dynamic traffic assignment, it denotes a socially optimal time-dependent allocation of flows, routes, or departure decisions that minimizes total system cost under congestion dynamics (Satsukawa et al., 2021, Fu et al., 2021, Ameli et al., 25 Aug 2025). In parameter-dependent dynamical systems, it denotes the choice of fixed parameters that optimize global stability properties such as maximal domain of attraction or minimal absorption time (Koltai et al., 2011). A related recent usage defines a dynamically optimal projection onto a prescribed slow spectral manifold by minimizing integrated future trajectory mismatch (Kogelbauer et al., 23 Mar 2025). Another closely aligned formulation treats policy tuning itself as optimization of an induced autonomous Markov system, calling this “Dynamical System Optimization” (2506.08340). These usages differ in state space, decision variables, and optimality criteria, but they share a common principle: optimality is assigned to system evolution under temporal constraints, rather than to a static snapshot.

1. Dynamic optimum as a moving benchmark in online optimization

In online convex optimization, dynamic system optimum arises through dynamic regret, which replaces the classical fixed comparator by a time-varying comparator sequence. The setting considered in “Proximal Online Gradient is Optimum for Dynamic Regret” uses composite losses

ft(x)=Ft(x)+H(x),f_t(x)=F_t(x)+H(x),

with FtF_t and HH convex and closed, a compact convex domain XRd\mathcal X\subset\mathbb R^d, bounded diameter

xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,

and bounded subgradients

Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)

(Zhao et al., 2018).

The dynamic comparator class is constrained by a weighted path-variation budget,

LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,

which generalizes the classical path budget t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_0 obtained when β=0\beta=0 (Zhao et al., 2018). Dynamic regret is then

RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).

Here the “dynamic optimum” is the best sequence of actions in hindsight subject to the variation budget, not an arbitrary clairvoyant sequence (Zhao et al., 2018).

The algorithmic result is that Proximal Online Gradient (POG),

FtF_t0

with

FtF_t1

achieves the minimax-optimal order of dynamic regret under these assumptions (Zhao et al., 2018). The upper bound has the form

FtF_t2

and with tuned non-increasing steps FtF_t3, FtF_t4, this becomes

FtF_t5

(Zhao et al., 2018). A matching lower bound,

FtF_t6

shows that no online algorithm can do better in order (Zhao et al., 2018). In this sense, the dynamic system optimum is a constrained moving benchmark, and POG is optimal relative to it.

A closely related interpretation appears in shifting regret. When the comparator is allowed only a limited number of switches, the same framework yields

FtF_t7

so the moving optimum may also be parameterized by a switching budget rather than a path-length budget (Zhao et al., 2018). This suggests that, in online learning, “dynamic system optimum” is best understood as a feasible nonstationary reference trajectory endowed with explicit temporal regularity.

2. Dynamic system optimum in traffic assignment

In traffic assignment, dynamic system optimum usually denotes a socially optimal time-dependent traffic state that minimizes total system travel cost under congestion propagation. The term is used in both microscopic atomic-user models and macroscopic aggregate-flow models, with the common feature that users interact through time-dependent congestion rather than static link costs (Satsukawa et al., 2021, Fu et al., 2021, Ameli et al., 25 Aug 2025).

In “Dynamic system optimal traffic assignment with atomic users: Convergence and stability,” the problem is formulated on general many-to-many networks with fixed departure times, atomic users, and route choice only (Satsukawa et al., 2021). Each user FtF_t8 has origin FtF_t9, destination HH0, fixed departure time HH1, and feasible route set HH2 augmented by a null strategy HH3. For a route profile HH4, the dynamic loading model uniquely determines each user’s travel time HH5, under assumptions including FIFO on each link, causality, node rules consistent with realistic macroscopic node-model requirements, and specified merge priority to ensure unique trajectories (Satsukawa et al., 2021).

The DSO objective is

HH6

so optimality means minimizing total travel time of all users in the dynamic network state (Satsukawa et al., 2021). The paper defines the external cost imposed by user HH7 as

HH8

and the marginal social cost as HH9 (Satsukawa et al., 2021). With utility

XRd\mathcal X\subset\mathbb R^d0

the authors show that the resulting DSO game is an exact potential game with potential

XRd\mathcal X\subset\mathbb R^d1

For any unilateral deviation, the utility change equals the potential change, so Nash equilibria coincide with local minima of total system cost in the discrete route-profile space (Satsukawa et al., 2021).

This game-theoretic formulation yields several dynamical results. Under better response dynamics, from any initial profile, the route profile converges almost surely to a Nash equilibrium state, that is, a locally or globally optimal state, and the final total cost is lower than the initial total cost (Satsukawa et al., 2021). Under best response dynamics, closed communication classes consist of Nash equilibrium states with equal total costs, and the process converges almost surely to a set of such equilibrium states (Satsukawa et al., 2021). Under logit response dynamics

XRd\mathcal X\subset\mathbb R^d2

the stochastically stable state is the globally optimal state minimizing total cost (Satsukawa et al., 2021). Thus, in this formulation, dynamic system optimum is a dynamic route assignment minimizing total travel time, and stochastic stability selects the global optimizer rather than merely a local equilibrium.

The paper further interprets the DSO game as an evolutionary implementation scheme for marginal cost pricing. Since each user’s utility is negative marginal social cost, the dynamics emulate exact state-dependent internalization of congestion externalities. The authors contrast this with a fixed implementation scheme using tolls XRd\mathcal X\subset\mathbb R^d3 defined at a target state XRd\mathcal X\subset\mathbb R^d4 (Satsukawa et al., 2021). The theoretical comparison yields two properties stated in the abstract: first, “the total travel time decreases smoother to an efficient traffic state as congestion externalities are perfectly internalised”; second, “a traffic state would reach a more efficient state as the globally optimal state is stabilised” (Satsukawa et al., 2021). Numerical experiments suggest that this evolutionary scheme is robust in the sense that it prevents the process from visiting worse traffic states with high total travel times as often (Satsukawa et al., 2021).

A different but related traffic meaning appears in “Dynamic traffic assignment in a corridor network: Optimum versus Equilibrium,” where DSO is defined as a queue-free dynamic assignment of departure or arrival times in a tandem-bottleneck corridor (Fu et al., 2021). For the morning commute, the objective is

XRd\mathcal X\subset\mathbb R^d5

subject to queue-free bottleneck capacity constraints

XRd\mathcal X\subset\mathbb R^d6

and demand conservation

XRd\mathcal X\subset\mathbb R^d7

(Fu et al., 2021). Here XRd\mathcal X\subset\mathbb R^d8 is destination arrival flow for class XRd\mathcal X\subset\mathbb R^d9, xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,0 is schedule delay, xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,1 free-flow time, and xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,2 bottleneck capacity (Fu et al., 2021). The KKT multipliers xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,3 serve as optimal dynamic tolls, and after eliminating “false bottlenecks,” the solution has a closed form: xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,4 The active time windows are nested,

xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,5

their lengths satisfy

xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,6

and class equilibrium costs are

xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,7

(Fu et al., 2021). Thus the corridor DSO is a layered peak-spreading solution in which each class uses a constant-rate schedule over a nested time window.

The same paper proves a precise relation between DSO and DUE under conditions on the schedule-delay function: queueing delay at bottleneck xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,8 in DUE equals the optimal toll at bottleneck xy22R,x,yX,\|x-y\|_2^2 \le R,\qquad \forall x,y\in\mathcal X,9 in DSO,

Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)0

and class costs also coincide,

Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)1

(Fu et al., 2021). The broader implication is that the DSO toll is exactly the queueing delay needed to decentralize the queue-free optimum, extending the single-bottleneck intuition to a multi-bottleneck corridor.

3. Regional macroscopic formulations and desired arrival times

A more recent traffic formulation appears in “Dynamic System Optimum: A Projection-based Framework for Macroscopic Traffic Models,” which defines DSO on a regional network represented by Macroscopic Fundamental Diagram dynamics (Ameli et al., 25 Aug 2025). The regional graph is

Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)2

with regions Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)3, directed adjacency Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)4, successors Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)5, predecessors Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)6, and region classes Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)7 for origins, destinations, and intermediate regions (Ameli et al., 25 Aug 2025). Demand is indexed by desired arrival time Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)8: Gt(x)2G,xX,Gt(x)Ft(x)\|G_t(x)\|_2 \le G,\qquad \forall x\in\mathcal X,\quad G_t(x)\in \partial F_t(x)9 The state variable is the class-specific regional accumulation

LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,0

(Ameli et al., 25 Aug 2025).

Regional demand and supply are induced by MFD functions,

LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,1

while the control variable

LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,2

specifies the fraction of class LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,3 travelers in region LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,4 sent to successor LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,5 (Ameli et al., 25 Aug 2025). Under the STRADA-style split-supply model,

LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,6

where the partial demand LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,7 is determined by turning fractions and class composition (Ameli et al., 25 Aug 2025). An alternative invariant merge model defines flows by a local optimization problem with KKT solution

LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,8

(Ameli et al., 25 Aug 2025).

The state evolution is governed by regional conservation laws. For intermediate regions,

LDβ:={{yt}t=1T:t=1T1tβyt+1ytDβ},0β<1,\mathcal L_{D_\beta} := \left\{ \{y_t\}_{t=1}^T : \sum_{t=1}^{T-1} t^\beta \|y_{t+1}-y_t\| \le D_\beta \right\}, \qquad 0\le \beta <1,9

and for origins,

t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_00

(Ameli et al., 25 Aug 2025). In compact form,

t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_01

The DSO is then formulated as an optimal control problem over time-dependent departure controls t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_02 and routing splits t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_03. The feasible set for t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_04 is simplex-valued: t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_05 while each departure profile t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_06 must satisfy a fixed total mass constraint (Ameli et al., 25 Aug 2025). The objective includes total time spent,

t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_07

arrival-time penalty,

t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_08

and a terminal penalty

t=1T1yt+1ytD0\sum_{t=1}^{T-1}\|y_{t+1}-y_t\|\le D_09

(Ameli et al., 25 Aug 2025). The full objective is

β=0\beta=00

subject to the regional dynamics and feasible-set constraints (Ameli et al., 25 Aug 2025).

The methodological novelty is a projected gradient algorithm that computes gradients directly from the discretized MFD dynamics rather than from approximations of marginal path travel times. With the discretization

β=0\beta=01

the stage cost is

β=0\beta=02

and the adjoint recursion is

β=0\beta=03

The control gradient is

β=0\beta=04

and the update is

β=0\beta=05

(Ameli et al., 25 Aug 2025). Projections onto routing and departure simplices are given explicitly through KKT multipliers, with sorting-based complexity β=0\beta=06 for route fractions (Ameli et al., 25 Aug 2025).

On the reported 8-region network, the paper compares the “SO β=0\beta=07-controller” against MSA and a gap-based method using total travel cost and average cost. The reported totals are β=0\beta=08 for the SO controller, β=0\beta=09 for MSA, and RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).0 for the gap method, corresponding to about RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).1 reduction versus MSA and about RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).2 versus the gap-based method (Ameli et al., 25 Aug 2025). In the central region RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).3, the average speed is reported as RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).4 m/s for the SO controller, RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).5 m/s for MSA, and RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).6 m/s for the gap method (Ameli et al., 25 Aug 2025). This suggests that, in regional MFD models, dynamic system optimum is most naturally interpreted as a constrained dynamic optimal control problem over aggregate traffic states, with schedule-delay terms and direct adjoint-based optimization.

4. System-level optimum in continuous dynamical systems

Outside traffic and online learning, the term also denotes optimization of the long-term behavior of a continuous-time dynamical system. In “Optimizing the stable behavior of parameter-dependent dynamical systems — maximal domains of attraction, minimal absorption times,” the system is

RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).7

with state RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).8, fixed parameter RTA:=t=1Tft(xt)min{yt}t=1TLDβt=1Tft(yt).\mathcal R_T^A := \sum_{t=1}^T f_t(x_t) - \min_{\{y_t\}_{t=1}^T\in \mathcal L_{D_\beta}} \sum_{t=1}^T f_t(y_t).9, compact state space FtF_t00, and target region FtF_t01 (Koltai et al., 2011). Trajectories leaving FtF_t02 are treated as terminated. The domain of attraction is

FtF_t03

and the absorption time is

FtF_t04

Two optimization objectives are considered: FtF_t05 (Koltai et al., 2011). The first maximizes basin volume penalized by parameter magnitude; the second minimizes average time to reach the target over a prescribed region FtF_t06 (Koltai et al., 2011).

The paper’s central approximation replaces the deterministic system by a finite-state Markov jump process (MJP) induced by a partition FtF_t07 of the state space. The generator is defined by fluxes across cell boundaries: FtF_t08 Off-diagonal entries are nonnegative, column sums are nonpositive, and strict negativity corresponds to leakage out of FtF_t09 into a fictive outside state FtF_t10 (Koltai et al., 2011).

Absorption probabilities FtF_t11 solve

FtF_t12

equivalently

FtF_t13

while expected termination times FtF_t14 solve

FtF_t15

equivalently

FtF_t16

(Koltai et al., 2011). The deterministic objectives are approximated by

FtF_t17

for domain-of-attraction maximization, and

FtF_t18

for absorption-time minimization (Koltai et al., 2011).

A key advantage is that the chain

FtF_t19

is differentiable under mild assumptions, allowing analytical or semi-analytical gradients. The derivative of the generator is expressed through boundary integrals,

FtF_t20

and the resulting optimization is performed by gradient ascent or descent, with optional projection steps to preserve feasibility of FtF_t21 (Koltai et al., 2011).

In this usage, dynamic system optimum is not a moving trajectory benchmark or social traffic state. It is a parameter choice that optimizes the global stability landscape of the system: how much of state space reaches the target and how rapidly it does so. A plausible implication is that this usage is closest to system design or control synthesis, rather than online decision making.

5. Dynamically optimal projection and autonomous-system optimization

Two papers extend the phrase into model reduction and autonomous Markov-system optimization. In “Dynamically Optimal Projection onto Slow Spectral Manifolds for Linear Systems,” the system is the linear dissipative evolution equation

FtF_t22

on a complex Hilbert space FtF_t23, with isolated slow eigenvalues FtF_t24 above the essential spectrum and slow invariant manifold

FtF_t25

(Kogelbauer et al., 23 Mar 2025). The novelty is not the manifold itself, which is assumed known spectrally, but the choice of representative point on that manifold for a general initial condition FtF_t26.

The criterion is the integrated future trajectory misfit,

FtF_t27

Minimizing this over FtF_t28 yields the dynamically optimal projection (Kogelbauer et al., 23 Mar 2025). The solution is explicit: FtF_t29 where the spectrally weighted Gramian is

FtF_t30

The induced projection operator is

FtF_t31

and satisfies

FtF_t32

(Kogelbauer et al., 23 Mar 2025).

This construction differs from orthogonal projection and from the Riesz projection when FtF_t33 is non-normal. For normal FtF_t34, however, DOP reduces to the canonical orthogonal projection

FtF_t35

(Kogelbauer et al., 23 Mar 2025). In the two-dimensional shear example

FtF_t36

the DOP onto the slow eigenspace becomes

FtF_t37

which incorporates the transient influence of the fast variable FtF_t38 on the future slow trajectory (Kogelbauer et al., 23 Mar 2025). Here “dynamic optimum” means best reproduction of future evolution, integrated over time, rather than best instantaneous geometric fit.

A more expansive autonomous-system formulation appears in “Dynamical System Optimization,” where a parameterized policy is viewed as inducing an autonomous Markov chain with transition law FtF_t39 and step cost FtF_t40 (2506.08340). The central claim is that once a policy is fixed, “control authority is transferred to the policy,” so optimization should be posed directly over the parameters of the induced autonomous system rather than through action-level dynamic programming machinery (2506.08340). The generic objective is

FtF_t41

with discounted, average-cost, or finite-horizon variants. In the discounted setting,

FtF_t42

and the Bellman equation is

FtF_t43

(2506.08340).

The paper derives the gradient theorem

FtF_t44

and its score-function form

FtF_t45

(2506.08340). It also defines a DSO Fisher matrix

FtF_t46

for natural-gradient updates (2506.08340). A surrogate objective FtF_t47 is introduced such that

FtF_t48

leading to chain-iteration and proximal-chain analogs of policy iteration and PPO (2506.08340).

The paper also identifies a special linearly-solvable setting in which optimization over all chains yields a global optimum: FtF_t49 (2506.08340). This usage broadens “dynamic system optimum” into an autonomous-system view of learning, system identification, mechanism design, estimator tuning, and related tasks (2506.08340).

6. Structural themes, contrasts, and scope conditions

Across these literatures, dynamic system optimum is not a single formal object but a family of temporally structured optimality concepts. The commonality is optimization over system evolution; the differences lie in what is allowed to vary and what notion of feasibility restricts the optimum.

In online optimization, the admissible comparator sequence is constrained by a weighted path budget FtF_t50, and optimality is inherently minimax: the benchmark is the best moving comparator in hindsight, and algorithmic performance is quantified by regret against it (Zhao et al., 2018). In atomic traffic assignment, the optimum is a route profile minimizing total travel time, and game-theoretic dynamics distinguish local optima from globally stochastically stable states (Satsukawa et al., 2021). In corridor traffic assignment, the optimum is queue-free and constrained by capacity, producing nested time windows and constant-rate flow patterns (Fu et al., 2021). In regional MFD models, the optimum becomes a dynamic optimal control problem over aggregate accumulations, departure releases, and routing fractions, augmented by desired arrival times and terminal penalties (Ameli et al., 25 Aug 2025). In parameter-dependent ODEs, the optimum is a parameter value maximizing domain of attraction or minimizing average absorption time (Koltai et al., 2011). In DOP, the optimum is a projection minimizing integrated future trajectory mismatch (Kogelbauer et al., 23 Mar 2025). In autonomous Markov-system optimization, it is a parameterization minimizing cumulative cost of the induced closed-loop chain (2506.08340).

Several recurring structural devices appear. One is the use of potential or value functions to turn dynamic optimality into an exact characterization. In the DSO traffic game, the potential is FtF_t51 (Satsukawa et al., 2021). In online learning, one-step proximal inequalities and telescoping bounds reduce dynamic regret to comparator movement, gradient accumulation, and diameter terms (Zhao et al., 2018). In DOP, a convex quadratic functional over future trajectories yields a closed-form oblique projection (Kogelbauer et al., 23 Mar 2025). In dynamical-system optimization via MJP approximation, absorption probabilities and termination times solve linear systems, so global stability criteria become differentiable surrogates amenable to local optimization (Koltai et al., 2011). In autonomous Markov-chain optimization, Bellman equations on the induced chain yield gradient, Hessian, and natural-gradient formulas without introducing action-value functions as primary objects (2506.08340).

Several misconceptions are also clarified by the literature. Dynamic system optimum is not necessarily the instantaneous minimizer of a time-varying objective. The online-learning paper explicitly notes that POG does not compute FtF_t52 at each round; instead it controls cumulative loss relative to the best feasible moving comparator sequence (Zhao et al., 2018). In traffic, DSO is not equivalent to dynamic user equilibrium: under certain conditions DUE queueing delay equals DSO toll, but the corresponding flow patterns may still differ, and equivalence can fail when schedule-delay slope conditions are violated (Fu et al., 2021). In the atomic-user traffic game, deterministic better or best response dynamics converge only to local optima; global optimality appears only through logit-based stochastic stability or a slowly increasing inverse-noise schedule FtF_t53 (Satsukawa et al., 2021). In dynamical-system optimization via MJP approximation, the method is global in criterion but still local in parameter search, since the proposed optimization uses gradient ascent or descent and can have multiple local optima (Koltai et al., 2011). In DOP, the manifold is assumed known; what is optimized is the projection fiber, not the invariant manifold itself (Kogelbauer et al., 23 Mar 2025).

The assumptions under which each notion is valid are correspondingly specific. The dynamic-regret optimality result requires convexity, closedness, compact domain, bounded subgradients, and non-increasing positive step sizes, but does not require smoothness or strong convexity (Zhao et al., 2018). The atomic-user DSO game depends on exact finite-user externalities, fixed departure times, route choice only, and a dynamic loading model with unique travel times (Satsukawa et al., 2021). The corridor results rely on homogeneous travelers, common desired time, deterministic bottlenecks, strict quasi-convexity of schedule delay, and corridor topology (Fu et al., 2021). The MFD framework assumes regional homogeneity, deterministic demand, predefined MFDs, and aggregate rather than microscopic FIFO fidelity (Ameli et al., 25 Aug 2025). The MJP stability-design method is subject to discretization error, leakage, and lack of full convergence theorems for absorption quantities in the paper itself (Koltai et al., 2011). DOP is restricted to linear systems with a prescribed slow spectral manifold (Kogelbauer et al., 23 Mar 2025). Autonomous Markov-system optimization generally assumes access to FtF_t54, FtF_t55, and their gradients, and does not provide general convergence theorems for its stochastic optimization algorithms (2506.08340).

Taken together, these works indicate that “dynamic system optimum” is best treated as a context-dependent technical term. In each context, it specifies the best admissible temporal organization of a system under explicit structural constraints: comparator regularity in online learning (Zhao et al., 2018), socially efficient traffic evolution under congestion dynamics (Satsukawa et al., 2021, Fu et al., 2021, Ameli et al., 25 Aug 2025), global stability design in nonlinear ODEs (Koltai et al., 2011), time-domain trajectory fit in spectral model reduction (Kogelbauer et al., 23 Mar 2025), or parameter-optimal autonomous stochastic dynamics (2506.08340). The unifying interpretation is that optimality is assigned to dynamics at the system level, not merely to isolated actions, states, or equilibrium points.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Dynamic System Optimum.