Dynamic System Optimum: Principles & Applications
- Dynamic system optimum is a framework that defines optimal temporal evolution by benchmarking the best admissible system trajectory under explicit constraints.
- It is applied in online learning to reduce dynamic regret, in traffic assignment to minimize total travel time, and in dynamical systems to enhance global stability.
- Techniques span proximal gradient methods, game-theoretic dynamics, and adjoint-based optimizations to capture time-varying optimality in diverse contexts.
Searching arXiv for recent and foundational uses of “dynamic system optimum” across online optimization, traffic assignment, and dynamical systems. Dynamic system optimum denotes a class of optimization benchmarks in which the reference object is the best admissible evolution of a system over time, rather than the best static configuration. Across the literature, the term appears in several technically distinct settings. In online convex optimization, it refers to a time-varying comparator sequence constrained by a path-variation budget, and optimality is assessed through dynamic regret (Zhao et al., 2018). In dynamic traffic assignment, it denotes a socially optimal time-dependent allocation of flows, routes, or departure decisions that minimizes total system cost under congestion dynamics (Satsukawa et al., 2021, Fu et al., 2021, Ameli et al., 25 Aug 2025). In parameter-dependent dynamical systems, it denotes the choice of fixed parameters that optimize global stability properties such as maximal domain of attraction or minimal absorption time (Koltai et al., 2011). A related recent usage defines a dynamically optimal projection onto a prescribed slow spectral manifold by minimizing integrated future trajectory mismatch (Kogelbauer et al., 23 Mar 2025). Another closely aligned formulation treats policy tuning itself as optimization of an induced autonomous Markov system, calling this “Dynamical System Optimization” (2506.08340). These usages differ in state space, decision variables, and optimality criteria, but they share a common principle: optimality is assigned to system evolution under temporal constraints, rather than to a static snapshot.
1. Dynamic optimum as a moving benchmark in online optimization
In online convex optimization, dynamic system optimum arises through dynamic regret, which replaces the classical fixed comparator by a time-varying comparator sequence. The setting considered in “Proximal Online Gradient is Optimum for Dynamic Regret” uses composite losses
with and convex and closed, a compact convex domain , bounded diameter
and bounded subgradients
The dynamic comparator class is constrained by a weighted path-variation budget,
which generalizes the classical path budget obtained when (Zhao et al., 2018). Dynamic regret is then
Here the “dynamic optimum” is the best sequence of actions in hindsight subject to the variation budget, not an arbitrary clairvoyant sequence (Zhao et al., 2018).
The algorithmic result is that Proximal Online Gradient (POG),
0
with
1
achieves the minimax-optimal order of dynamic regret under these assumptions (Zhao et al., 2018). The upper bound has the form
2
and with tuned non-increasing steps 3, 4, this becomes
5
(Zhao et al., 2018). A matching lower bound,
6
shows that no online algorithm can do better in order (Zhao et al., 2018). In this sense, the dynamic system optimum is a constrained moving benchmark, and POG is optimal relative to it.
A closely related interpretation appears in shifting regret. When the comparator is allowed only a limited number of switches, the same framework yields
7
so the moving optimum may also be parameterized by a switching budget rather than a path-length budget (Zhao et al., 2018). This suggests that, in online learning, “dynamic system optimum” is best understood as a feasible nonstationary reference trajectory endowed with explicit temporal regularity.
2. Dynamic system optimum in traffic assignment
In traffic assignment, dynamic system optimum usually denotes a socially optimal time-dependent traffic state that minimizes total system travel cost under congestion propagation. The term is used in both microscopic atomic-user models and macroscopic aggregate-flow models, with the common feature that users interact through time-dependent congestion rather than static link costs (Satsukawa et al., 2021, Fu et al., 2021, Ameli et al., 25 Aug 2025).
In “Dynamic system optimal traffic assignment with atomic users: Convergence and stability,” the problem is formulated on general many-to-many networks with fixed departure times, atomic users, and route choice only (Satsukawa et al., 2021). Each user 8 has origin 9, destination 0, fixed departure time 1, and feasible route set 2 augmented by a null strategy 3. For a route profile 4, the dynamic loading model uniquely determines each user’s travel time 5, under assumptions including FIFO on each link, causality, node rules consistent with realistic macroscopic node-model requirements, and specified merge priority to ensure unique trajectories (Satsukawa et al., 2021).
The DSO objective is
6
so optimality means minimizing total travel time of all users in the dynamic network state (Satsukawa et al., 2021). The paper defines the external cost imposed by user 7 as
8
and the marginal social cost as 9 (Satsukawa et al., 2021). With utility
0
the authors show that the resulting DSO game is an exact potential game with potential
1
For any unilateral deviation, the utility change equals the potential change, so Nash equilibria coincide with local minima of total system cost in the discrete route-profile space (Satsukawa et al., 2021).
This game-theoretic formulation yields several dynamical results. Under better response dynamics, from any initial profile, the route profile converges almost surely to a Nash equilibrium state, that is, a locally or globally optimal state, and the final total cost is lower than the initial total cost (Satsukawa et al., 2021). Under best response dynamics, closed communication classes consist of Nash equilibrium states with equal total costs, and the process converges almost surely to a set of such equilibrium states (Satsukawa et al., 2021). Under logit response dynamics
2
the stochastically stable state is the globally optimal state minimizing total cost (Satsukawa et al., 2021). Thus, in this formulation, dynamic system optimum is a dynamic route assignment minimizing total travel time, and stochastic stability selects the global optimizer rather than merely a local equilibrium.
The paper further interprets the DSO game as an evolutionary implementation scheme for marginal cost pricing. Since each user’s utility is negative marginal social cost, the dynamics emulate exact state-dependent internalization of congestion externalities. The authors contrast this with a fixed implementation scheme using tolls 3 defined at a target state 4 (Satsukawa et al., 2021). The theoretical comparison yields two properties stated in the abstract: first, “the total travel time decreases smoother to an efficient traffic state as congestion externalities are perfectly internalised”; second, “a traffic state would reach a more efficient state as the globally optimal state is stabilised” (Satsukawa et al., 2021). Numerical experiments suggest that this evolutionary scheme is robust in the sense that it prevents the process from visiting worse traffic states with high total travel times as often (Satsukawa et al., 2021).
A different but related traffic meaning appears in “Dynamic traffic assignment in a corridor network: Optimum versus Equilibrium,” where DSO is defined as a queue-free dynamic assignment of departure or arrival times in a tandem-bottleneck corridor (Fu et al., 2021). For the morning commute, the objective is
5
subject to queue-free bottleneck capacity constraints
6
and demand conservation
7
(Fu et al., 2021). Here 8 is destination arrival flow for class 9, 0 is schedule delay, 1 free-flow time, and 2 bottleneck capacity (Fu et al., 2021). The KKT multipliers 3 serve as optimal dynamic tolls, and after eliminating “false bottlenecks,” the solution has a closed form: 4 The active time windows are nested,
5
their lengths satisfy
6
and class equilibrium costs are
7
(Fu et al., 2021). Thus the corridor DSO is a layered peak-spreading solution in which each class uses a constant-rate schedule over a nested time window.
The same paper proves a precise relation between DSO and DUE under conditions on the schedule-delay function: queueing delay at bottleneck 8 in DUE equals the optimal toll at bottleneck 9 in DSO,
0
and class costs also coincide,
1
(Fu et al., 2021). The broader implication is that the DSO toll is exactly the queueing delay needed to decentralize the queue-free optimum, extending the single-bottleneck intuition to a multi-bottleneck corridor.
3. Regional macroscopic formulations and desired arrival times
A more recent traffic formulation appears in “Dynamic System Optimum: A Projection-based Framework for Macroscopic Traffic Models,” which defines DSO on a regional network represented by Macroscopic Fundamental Diagram dynamics (Ameli et al., 25 Aug 2025). The regional graph is
2
with regions 3, directed adjacency 4, successors 5, predecessors 6, and region classes 7 for origins, destinations, and intermediate regions (Ameli et al., 25 Aug 2025). Demand is indexed by desired arrival time 8: 9 The state variable is the class-specific regional accumulation
0
Regional demand and supply are induced by MFD functions,
1
while the control variable
2
specifies the fraction of class 3 travelers in region 4 sent to successor 5 (Ameli et al., 25 Aug 2025). Under the STRADA-style split-supply model,
6
where the partial demand 7 is determined by turning fractions and class composition (Ameli et al., 25 Aug 2025). An alternative invariant merge model defines flows by a local optimization problem with KKT solution
8
The state evolution is governed by regional conservation laws. For intermediate regions,
9
and for origins,
0
(Ameli et al., 25 Aug 2025). In compact form,
1
The DSO is then formulated as an optimal control problem over time-dependent departure controls 2 and routing splits 3. The feasible set for 4 is simplex-valued: 5 while each departure profile 6 must satisfy a fixed total mass constraint (Ameli et al., 25 Aug 2025). The objective includes total time spent,
7
arrival-time penalty,
8
and a terminal penalty
9
(Ameli et al., 25 Aug 2025). The full objective is
0
subject to the regional dynamics and feasible-set constraints (Ameli et al., 25 Aug 2025).
The methodological novelty is a projected gradient algorithm that computes gradients directly from the discretized MFD dynamics rather than from approximations of marginal path travel times. With the discretization
1
the stage cost is
2
and the adjoint recursion is
3
The control gradient is
4
and the update is
5
(Ameli et al., 25 Aug 2025). Projections onto routing and departure simplices are given explicitly through KKT multipliers, with sorting-based complexity 6 for route fractions (Ameli et al., 25 Aug 2025).
On the reported 8-region network, the paper compares the “SO 7-controller” against MSA and a gap-based method using total travel cost and average cost. The reported totals are 8 for the SO controller, 9 for MSA, and 0 for the gap method, corresponding to about 1 reduction versus MSA and about 2 versus the gap-based method (Ameli et al., 25 Aug 2025). In the central region 3, the average speed is reported as 4 m/s for the SO controller, 5 m/s for MSA, and 6 m/s for the gap method (Ameli et al., 25 Aug 2025). This suggests that, in regional MFD models, dynamic system optimum is most naturally interpreted as a constrained dynamic optimal control problem over aggregate traffic states, with schedule-delay terms and direct adjoint-based optimization.
4. System-level optimum in continuous dynamical systems
Outside traffic and online learning, the term also denotes optimization of the long-term behavior of a continuous-time dynamical system. In “Optimizing the stable behavior of parameter-dependent dynamical systems — maximal domains of attraction, minimal absorption times,” the system is
7
with state 8, fixed parameter 9, compact state space 00, and target region 01 (Koltai et al., 2011). Trajectories leaving 02 are treated as terminated. The domain of attraction is
03
and the absorption time is
04
Two optimization objectives are considered: 05 (Koltai et al., 2011). The first maximizes basin volume penalized by parameter magnitude; the second minimizes average time to reach the target over a prescribed region 06 (Koltai et al., 2011).
The paper’s central approximation replaces the deterministic system by a finite-state Markov jump process (MJP) induced by a partition 07 of the state space. The generator is defined by fluxes across cell boundaries: 08 Off-diagonal entries are nonnegative, column sums are nonpositive, and strict negativity corresponds to leakage out of 09 into a fictive outside state 10 (Koltai et al., 2011).
Absorption probabilities 11 solve
12
equivalently
13
while expected termination times 14 solve
15
equivalently
16
(Koltai et al., 2011). The deterministic objectives are approximated by
17
for domain-of-attraction maximization, and
18
for absorption-time minimization (Koltai et al., 2011).
A key advantage is that the chain
19
is differentiable under mild assumptions, allowing analytical or semi-analytical gradients. The derivative of the generator is expressed through boundary integrals,
20
and the resulting optimization is performed by gradient ascent or descent, with optional projection steps to preserve feasibility of 21 (Koltai et al., 2011).
In this usage, dynamic system optimum is not a moving trajectory benchmark or social traffic state. It is a parameter choice that optimizes the global stability landscape of the system: how much of state space reaches the target and how rapidly it does so. A plausible implication is that this usage is closest to system design or control synthesis, rather than online decision making.
5. Dynamically optimal projection and autonomous-system optimization
Two papers extend the phrase into model reduction and autonomous Markov-system optimization. In “Dynamically Optimal Projection onto Slow Spectral Manifolds for Linear Systems,” the system is the linear dissipative evolution equation
22
on a complex Hilbert space 23, with isolated slow eigenvalues 24 above the essential spectrum and slow invariant manifold
25
(Kogelbauer et al., 23 Mar 2025). The novelty is not the manifold itself, which is assumed known spectrally, but the choice of representative point on that manifold for a general initial condition 26.
The criterion is the integrated future trajectory misfit,
27
Minimizing this over 28 yields the dynamically optimal projection (Kogelbauer et al., 23 Mar 2025). The solution is explicit: 29 where the spectrally weighted Gramian is
30
The induced projection operator is
31
and satisfies
32
(Kogelbauer et al., 23 Mar 2025).
This construction differs from orthogonal projection and from the Riesz projection when 33 is non-normal. For normal 34, however, DOP reduces to the canonical orthogonal projection
35
(Kogelbauer et al., 23 Mar 2025). In the two-dimensional shear example
36
the DOP onto the slow eigenspace becomes
37
which incorporates the transient influence of the fast variable 38 on the future slow trajectory (Kogelbauer et al., 23 Mar 2025). Here “dynamic optimum” means best reproduction of future evolution, integrated over time, rather than best instantaneous geometric fit.
A more expansive autonomous-system formulation appears in “Dynamical System Optimization,” where a parameterized policy is viewed as inducing an autonomous Markov chain with transition law 39 and step cost 40 (2506.08340). The central claim is that once a policy is fixed, “control authority is transferred to the policy,” so optimization should be posed directly over the parameters of the induced autonomous system rather than through action-level dynamic programming machinery (2506.08340). The generic objective is
41
with discounted, average-cost, or finite-horizon variants. In the discounted setting,
42
and the Bellman equation is
43
(2506.08340).
The paper derives the gradient theorem
44
and its score-function form
45
(2506.08340). It also defines a DSO Fisher matrix
46
for natural-gradient updates (2506.08340). A surrogate objective 47 is introduced such that
48
leading to chain-iteration and proximal-chain analogs of policy iteration and PPO (2506.08340).
The paper also identifies a special linearly-solvable setting in which optimization over all chains yields a global optimum: 49 (2506.08340). This usage broadens “dynamic system optimum” into an autonomous-system view of learning, system identification, mechanism design, estimator tuning, and related tasks (2506.08340).
6. Structural themes, contrasts, and scope conditions
Across these literatures, dynamic system optimum is not a single formal object but a family of temporally structured optimality concepts. The commonality is optimization over system evolution; the differences lie in what is allowed to vary and what notion of feasibility restricts the optimum.
In online optimization, the admissible comparator sequence is constrained by a weighted path budget 50, and optimality is inherently minimax: the benchmark is the best moving comparator in hindsight, and algorithmic performance is quantified by regret against it (Zhao et al., 2018). In atomic traffic assignment, the optimum is a route profile minimizing total travel time, and game-theoretic dynamics distinguish local optima from globally stochastically stable states (Satsukawa et al., 2021). In corridor traffic assignment, the optimum is queue-free and constrained by capacity, producing nested time windows and constant-rate flow patterns (Fu et al., 2021). In regional MFD models, the optimum becomes a dynamic optimal control problem over aggregate accumulations, departure releases, and routing fractions, augmented by desired arrival times and terminal penalties (Ameli et al., 25 Aug 2025). In parameter-dependent ODEs, the optimum is a parameter value maximizing domain of attraction or minimizing average absorption time (Koltai et al., 2011). In DOP, the optimum is a projection minimizing integrated future trajectory mismatch (Kogelbauer et al., 23 Mar 2025). In autonomous Markov-system optimization, it is a parameterization minimizing cumulative cost of the induced closed-loop chain (2506.08340).
Several recurring structural devices appear. One is the use of potential or value functions to turn dynamic optimality into an exact characterization. In the DSO traffic game, the potential is 51 (Satsukawa et al., 2021). In online learning, one-step proximal inequalities and telescoping bounds reduce dynamic regret to comparator movement, gradient accumulation, and diameter terms (Zhao et al., 2018). In DOP, a convex quadratic functional over future trajectories yields a closed-form oblique projection (Kogelbauer et al., 23 Mar 2025). In dynamical-system optimization via MJP approximation, absorption probabilities and termination times solve linear systems, so global stability criteria become differentiable surrogates amenable to local optimization (Koltai et al., 2011). In autonomous Markov-chain optimization, Bellman equations on the induced chain yield gradient, Hessian, and natural-gradient formulas without introducing action-value functions as primary objects (2506.08340).
Several misconceptions are also clarified by the literature. Dynamic system optimum is not necessarily the instantaneous minimizer of a time-varying objective. The online-learning paper explicitly notes that POG does not compute 52 at each round; instead it controls cumulative loss relative to the best feasible moving comparator sequence (Zhao et al., 2018). In traffic, DSO is not equivalent to dynamic user equilibrium: under certain conditions DUE queueing delay equals DSO toll, but the corresponding flow patterns may still differ, and equivalence can fail when schedule-delay slope conditions are violated (Fu et al., 2021). In the atomic-user traffic game, deterministic better or best response dynamics converge only to local optima; global optimality appears only through logit-based stochastic stability or a slowly increasing inverse-noise schedule 53 (Satsukawa et al., 2021). In dynamical-system optimization via MJP approximation, the method is global in criterion but still local in parameter search, since the proposed optimization uses gradient ascent or descent and can have multiple local optima (Koltai et al., 2011). In DOP, the manifold is assumed known; what is optimized is the projection fiber, not the invariant manifold itself (Kogelbauer et al., 23 Mar 2025).
The assumptions under which each notion is valid are correspondingly specific. The dynamic-regret optimality result requires convexity, closedness, compact domain, bounded subgradients, and non-increasing positive step sizes, but does not require smoothness or strong convexity (Zhao et al., 2018). The atomic-user DSO game depends on exact finite-user externalities, fixed departure times, route choice only, and a dynamic loading model with unique travel times (Satsukawa et al., 2021). The corridor results rely on homogeneous travelers, common desired time, deterministic bottlenecks, strict quasi-convexity of schedule delay, and corridor topology (Fu et al., 2021). The MFD framework assumes regional homogeneity, deterministic demand, predefined MFDs, and aggregate rather than microscopic FIFO fidelity (Ameli et al., 25 Aug 2025). The MJP stability-design method is subject to discretization error, leakage, and lack of full convergence theorems for absorption quantities in the paper itself (Koltai et al., 2011). DOP is restricted to linear systems with a prescribed slow spectral manifold (Kogelbauer et al., 23 Mar 2025). Autonomous Markov-system optimization generally assumes access to 54, 55, and their gradients, and does not provide general convergence theorems for its stochastic optimization algorithms (2506.08340).
Taken together, these works indicate that “dynamic system optimum” is best treated as a context-dependent technical term. In each context, it specifies the best admissible temporal organization of a system under explicit structural constraints: comparator regularity in online learning (Zhao et al., 2018), socially efficient traffic evolution under congestion dynamics (Satsukawa et al., 2021, Fu et al., 2021, Ameli et al., 25 Aug 2025), global stability design in nonlinear ODEs (Koltai et al., 2011), time-domain trajectory fit in spectral model reduction (Kogelbauer et al., 23 Mar 2025), or parameter-optimal autonomous stochastic dynamics (2506.08340). The unifying interpretation is that optimality is assigned to dynamics at the system level, not merely to isolated actions, states, or equilibrium points.