Papers
Topics
Authors
Recent
Search
2000 character limit reached

Euclidean Path-Integral Control: Theory & Applications

Updated 5 July 2026
  • Euclidean Path-Integral Control linearly transforms the nonlinear HJB equation using an exponential desirability function, simplifying stochastic optimal control.
  • It employs a Feynman–Kac representation to express the desirability function as a weighted expectation under reference dynamics, facilitating effective importance sampling.
  • The framework, grounded in a strict noise-control matching condition, extends to diverse applications like epidemiological models and nonlinear controlled systems.

Searching arXiv for the cited Euclidean/path-integral control papers to ground the article. arxiv_search(query="(Pramanik, 2022) Euclidean path integral control", max_results=5) arxiv_search(query="(Pramanik, 2022) Euclidean path integral control", max_results=5) Euclidean Path-Integral Control is the class of stochastic optimal control problems in which the Hamilton–Jacobi–Bellman equation can be linearized by an exponential, or desirability, transform of the value function, yielding a backward Kolmogorov or heat-type PDE and an equivalent Feynman–Kac path integral with a real Euclidean action (Rawlik et al., 2012). In the same literature, this class is identified with linearly-solvable stochastic optimal control, KL-control, and closely related path-integral formulations; its canonical output is an optimal feedback law expressed through the spatial gradient of the desirability function rather than through direct solution of a nonlinear value-function PDE (Thijssen et al., 2014). The resulting framework has been extended from fully observed control-affine diffusions to generalized costs, state-dependent feedback synthesis, reproducing-kernel estimators, Koopman-based representations, partially observed belief-space control with controlled sensing, and nonlinear application domains including epidemiological control (Yang et al., 2014).

1. Linear-solvable structure

The standard Euclidean Path-Integral Control problem is posed for a controlled Itô diffusion

dxt=f(xt,t)dt+B(xt,t)utdt+σ(xt,t)dWt,d\mathbf{x}_t = \mathbf{f}(\mathbf{x}_t,t)\,dt + \mathbf{B}(\mathbf{x}_t,t)\,\mathbf{u}_t\,dt + \boldsymbol{\sigma}(\mathbf{x}_t,t)\,d\mathbf{W}_t,

with finite-horizon cost

Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].

The defining structural assumption is the control–noise matching condition

Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,

or, in equivalent notation used elsewhere in the literature,

BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.

This coupling between diffusion, control authority, and quadratic control cost is the precise condition under which the nonlinear HJB becomes linear after exponentiation of the value function (Yang et al., 2014).

In matched formulations, control and noise act through the same channels. One consequence stated explicitly in the linearly-solvable literature is that no control is allowed in noiseless coordinates; if a coordinate is not directly diffused, it cannot be independently actuated without violating the matching condition (Ohkubo, 2020). This restriction is the price paid for linear solvability. It also clarifies why Euclidean Path-Integral Control is not a general method for arbitrary stochastic control problems, but a structurally specialized one.

The same basic architecture appears in several variants. In reproducing-kernel formulations, the dynamics are written as

dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,

again forcing control and noise through the same subspace (Rawlik et al., 2012). In matched state-dependent feedback formulations, the diffusion is written as

dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),

with the same alignment between control channels and noise channels (Thijssen et al., 2014). Across these notational differences, the core object is unchanged: a stochastic control problem whose nonlinear optimization becomes a linear propagation problem after the appropriate transform.

2. Desirability transform, linear PDE, and Feynman–Kac representation

Starting from the stochastic HJB equation and minimizing over the quadratic control term gives the feedback minimizer

u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),

with the nonlinear HJB reduced to

tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V

under standard notation (Yang et al., 2014). Defining the desirability function

ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)

cancels the gradient-square term when the matching condition holds. The resulting PDE is linear: tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}. Equivalent sign conventions appear across the literature, but the substantive point is invariant: the HJB becomes a linear backward equation for Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].0 (Thijssen et al., 2014).

The optimal control is then recovered directly from the desirability gradient: Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].1 In notation used in other formulations, this appears as

Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].2

or, when the cost has already been scaled by Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].3, without the prefactor (Ohkubo, 2020).

The linear PDE admits a Feynman–Kac, hence Euclidean path-integral, representation under the uncontrolled or reference dynamics

Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].4

The desirability is

Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].5

This is the sense in which the method is “Euclidean”: path weights are real, positive, and Boltzmann-like, Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].6, rather than oscillatory amplitudes (Kappen et al., 2015). Several papers make the same point through the language of Wick rotation, Euclidean action, or linearly-solvable control (Pramanik et al., 2020).

3. Sampling, importance control, and feedback representations

The Feynman–Kac representation turns optimal control into a sampling problem. In its simplest form, one estimates Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].7 by Monte Carlo under the reference process and then differentiates Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].8 to recover Ju(xt,t)=E[Φ(xT)+tT(q(xs,s)+12usR(xs,s)us)ds].J^{\mathbf{u}}(\mathbf{x}_t,t)=\mathbb{E}\left[\Phi(\mathbf{x}_T) + \int_t^T \Big(q(\mathbf{x}_s,s) + \tfrac12\mathbf{u}_s^\top \mathbf{R}(\mathbf{x}_s,s)\mathbf{u}_s\Big) ds\right].9. A central refinement is to sample under an auxiliary control Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,0 and correct by Girsanov weights. In matched form, the resulting path cost includes the quadratic control term and a stochastic integral,

Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,1

and the desirability can be written as

Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,2

This identity underlies importance sampling for path-integral control and explains why improving the sampling controller improves numerical efficiency (Thijssen et al., 2014).

A key result is that better control, in terms of control cost, yields more efficient importance sampling, in terms of effective sample size; the optimal control provides a zero-variance estimate (Thijssen et al., 2014). In the same work, the weighted identity

Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,3

supports direct estimation of state-dependent feedback laws from weighted trajectory ensembles. For parameterizations Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,4, this becomes a linear relation for the coefficient matrix Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,5, making path-integral control compatible with explicit feedback synthesis rather than only open-loop control (Thijssen et al., 2014).

The same importance-sampling viewpoint is developed further through the Path Integral Cross Entropy method. There, the control problem is re-expressed as minimization of a reverse KL divergence between a parametrized controlled path measure and the optimal path measure

Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,6

leading to fixed-point equations or gradient updates for arbitrary controller parameterizations (Kappen et al., 2015). This reframes “how to compute” as “how to learn an effective importance sampler,” with state-feedback controllers as the preferred samplers.

Several non-sampling representations have also been developed. In the reproducing-kernel formulation, the discrete-time recursion

Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,7

is embedded in RKHS covariance operators, producing a model-free, non-parametric estimator with a decomposition into invariant, dynamics-dependent operators and task-dependent cost factors. This decomposition enables sample reuse across tasks (Rawlik et al., 2012). In the Koopman-based formulation, only the specific observable

Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,8

is propagated. A polynomial expansion of the extended observable dynamics then yields coupled linear ODEs for expansion coefficients, rather than direct Monte Carlo over trajectories (Ohkubo, 2020). These developments preserve the same desirability calculus while altering the numerical representation.

4. Generalizations of the Euclidean formulation

Extension Core construction Source
Generalized costs Augmented state Σ(x,t)Σ(x,t)=λB(x,t)R1B(x,t),\boldsymbol{\Sigma}(\mathbf{x},t)\,\boldsymbol{\Sigma}(\mathbf{x},t)^\top = \lambda\,\mathbf{B}(\mathbf{x},t)\,\mathbf{R}^{-1}\,\mathbf{B}(\mathbf{x},t)^\top,9 (Yang et al., 2014)
Belief-space control Controlled sensing enforces BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.0 (Das et al., 21 Apr 2026)
Euclidean action in economics Quantum Lagrangian and saddle-point condition BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.1 (Pramanik et al., 2020)

A major extension replaces the standard running cost by a generalized cost containing stochastic integral terms and linear control costs. The construction introduces an augmented state

BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.2

whose dynamics are

BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.3

The original problem is thereby converted into one with terminal cost BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.4 and quadratic control effort in the augmented state space, and the same desirability transform applies after extending the matching condition to the augmented matrices BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.5 and BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.6 (Yang et al., 2014). This is the main mechanism by which Euclidean Path-Integral Control incorporates linear control costs and stochastic Itô terms without abandoning linear solvability.

A second extension addresses partial observation. For linear-Gaussian systems with controlled sensing, the Gaussian belief state BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.7 obeys

BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.8

where the observation-driven diffusion satisfies

BB=λUR1U,λI=Rν.B\,B^\top=\lambda\,U\,R^{-1}U^\top, \qquad \lambda I = R\nu.9

A fixed observation matrix generally cannot enforce the matching

dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,0

By treating the observation matrix as a control variable and restricting sensing to a measurable selector from the matching set

dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,1

the constrained belief-space HJB again linearizes under dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,2, yielding a linear PDE and Feynman–Kac representation on belief space (Das et al., 21 Apr 2026). Here the diffusion is not process-noise-driven but observation-driven, and the covariance evolves deterministically via a controlled Riccati equation.

A third line of work uses Euclidean action principles even when strict linearly-solvable assumptions are weakened. In a Walrasian or stochastic-volatility setting, the local Euclidean action density

dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,3

defines a Schrödinger- or Feynman–Kac-type evolution dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,4, and optimal controls are extracted from local stationarity conditions such as dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,5 (Pramanik et al., 2020). This is not identical to classical LSOC, but it preserves the Euclidean path-integral viewpoint.

5. Computational examples and empirical domains

The generalized-cost framework has been demonstrated on hierarchical electric load management. For a single thermostatically controlled load type, the path-integral method used 300 time nodes and 5 samples via implicit sampling, while grid-based HJB used 51, 101, and 401 state nodes; the path-integral solution matched the converged grid-based solution, and temperature trajectories differed by less than dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,6 against the finest grid (Yang et al., 2014). For six TCL types, time discretization with 100 nodes and dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,7 implicit samples was used; the dimensionality rendered grid-based methods impractical, while path-integral control remained effective (Yang et al., 2014). These examples illustrate the standard claim that path-integral control avoids a global grid and is therefore attractive in moderate-to-large dimensions.

The Koopman-based Euclidean formulation has been tested on a nonlinear stochastic van der Pol system in which only the second state is actuated and the first-state noise is removed to satisfy the matching condition. With truncation dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,8, the polynomial method used dxt=f(xt,t)dt+B(xt,t)utdt+B(xt,t)dξt,d x_t = f(x_t,t)\,dt + B(x_t,t)u_t\,dt + B(x_t,t)d\xi_t,9 coefficients, whereas the comparison HJB grid used dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),0 points; the reconstructed desirability agreed closely with the direct HJB solution (Ohkubo, 2020). In receding-horizon application, the resulting controller drove the noisy oscillator toward the desired target even though control acted only on one coordinate.

The control–inference duality has also been made explicit. In the inference interpretation, the posterior path law takes the same form as the optimal path measure,

dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),1

with dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),2 interpreted as negative log-likelihood. In a two-dimensional firing-rate model with Gaussian observations on one neuron, the path-integral-based importance sampler achieved an effective sample size of about dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),3 with 22 iterations and 6000 particles per iteration, with computation time approximately dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),4 seconds; an open-loop control reduced ESS to about dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),5, while a forward-filter backward-smoother with 6000 forward and 3600 backward particles required about dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),6 seconds (Kappen et al., 2015). This places Euclidean Path-Integral Control at the boundary between stochastic control and latent-state inference rather than exclusively within either field.

6. Stochastic epidemiology and the SIR Euclidean path integral

A recent application extends the Euclidean construction to a stochastic SIR model with a non-linear incidence rate and two policy controls, lockdown intensity dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),7 and vaccination rate dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),8, under a COVID-19 setting (Pramanik, 2022). The state is

dXu(t)=b(t,Xu(t))dt+σ(t,Xu(t))(u(t,Xu(t))dt+dW(t)),dX^u(t)=b(t,X^u(t))\,dt+\sigma(t,X^u(t))\big(u(t,X^u(t))\,dt+dW(t)\big),9

and the incidence term is saturated: u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),0 The saturation is motivated by the claim that when the proportion of infected agents is very high, exposure is inevitable and the transmission rate responds slower than linearly to further increases in infections. In the simplified incidence u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),1, the derivatives satisfy

u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),2

so the incidence is concave in u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),3 and grows sublinearly at high infection levels (Pramanik, 2022).

The controlled SDEs couple SIR compartments, environmental modifiers, and a stochastic infection-rate process u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),4. The paper’s objective contains discounted quadratic control terms, linear terms in u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),5 and u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),6, and a transmission penalty: u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),7 Because the drift contains u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),8, the control enters nonlinearly and the usual control-affine linear-solvable assumptions do not apply directly. The authors therefore use a Euclidean path-integral discretization based on a quantum Lagrangian

u(x,t)=R1B(x,t)V(x,t),\mathbf{u}^*(\mathbf{x},t) = -\,\mathbf{R}^{-1}\mathbf{B}(\mathbf{x},t)^\top \nabla V(\mathbf{x},t),9

and a transition function

tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V0

Using Itô calculus, Taylor expansion, and Feynman–Kac, this yields a linear relation for tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V1 and a Fokker–Plank type equation (Pramanik, 2022).

Optimality is imposed through the first-order condition

tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V2

With the specific choice

tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V3

the paper derives explicit feedback policies tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V4 and tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V5 for tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V6, with

tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V7

assuming tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V8 (Pramanik, 2022). Under perfect and complete information, the authors prove existence of a unique solution to the stochastic optimization and existence of a Brouwer fixed point for the quantum-Lagrangian mapping on a non-empty, convex, compact set tV=q+Vf+12Tr(ΣΣ2V)12VBR1BV-\partial_t V = q+\nabla V\cdot \mathbf{f} +\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2V\big) -\tfrac12\nabla V^\top \mathbf{B}\mathbf{R}^{-1}\mathbf{B}^\top\nabla V9.

The numerical study uses ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)0, ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)1, ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)2, ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)3, and reports two diffusion regimes, including a higher-noise case with ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)4, ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)5, and ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)6. In that regime, susceptible and recovered curves maintain downward trends while the infected curve becomes ergodic, fluctuating around a level rather than converging monotonically (Pramanik, 2022). The data analysis based on Office for National Statistics UK data for early 2021 sets ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)7, ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)8, ψ(x,t)=exp ⁣(V(x,t)/λ)\psi(\mathbf{x},t)=\exp\!\big(-V(\mathbf{x},t)/\lambda\big)9, tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}.0, and full vaccination tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}.1; over the first 100 days of 2021, the controlled SIR paths reproduce high volatility in tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}.2, downward but fluctuating tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}.3 and tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}.4, an initially declining optimal lockdown intensity with a spike around days 70–80, and a vaccination path without a clear upward trend (Pramanik, 2022).

7. Scope, limitations, and relations to adjacent frameworks

The central limitation of Euclidean Path-Integral Control is structural. The matching condition

tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}.5

or its equivalent forms is restrictive, and several papers identify it as the main barrier to broader applicability (Yang et al., 2014). The partially observed extension makes this especially explicit: with a fixed observation matrix, the observation-driven belief diffusion generally cannot be made equal to tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}.6; controlled sensing is introduced precisely to restore linear solvability, and even then existence of a measurable selector is an assumption tied to sensor richness and feasibility (Das et al., 21 Apr 2026).

The computational burden is shifted rather than eliminated. Monte Carlo evaluation avoids global state-space grids, but sample efficiency depends strongly on the quality of the importance controller; the linearly-solvable literature therefore emphasizes adaptive importance sampling, ESS diagnostics, and feedback learning (Thijssen et al., 2014). Deterministic alternatives such as RKHS embeddings and Koopman polynomial truncations introduce their own approximations: kernel choice and regularization in the former, truncation error and basis growth in the latter (Rawlik et al., 2012). In Euclidean-action formulations outside strict LSOC, the choice of the auxiliary tψ=1λq(x,t)ψψf(x,t)12Tr(ΣΣ2ψ),ψ(x,T)=eΦ(x)/λ.-\partial_t \psi = \frac{1}{\lambda}q(\mathbf{x},t)\,\psi -\nabla\psi\cdot \mathbf{f}(\mathbf{x},t) -\tfrac12\mathrm{Tr}\big(\boldsymbol{\Sigma}\boldsymbol{\Sigma}^\top\nabla^2\psi\big), \qquad \psi(\mathbf{x},T)=e^{-\Phi(\mathbf{x})/\lambda}.7-function becomes a modeling decision that affects tractability (Pramanik et al., 2020).

Euclidean Path-Integral Control is closely connected to KL-control and linearly-solvable MDPs, because all three rely on exponential transformations and linear backward equations (Rawlik et al., 2012). It is also related to Schrödinger bridge formulations, which likewise lead to linear PDEs and admit optimal-transport interpretations. The stochastic SIR study explicitly notes, however, that its approach aligns with the Kappen-type Euclidean path-integral and Feynman–Kac grounding rather than with the entropic optimal-transport viewpoint (Pramanik, 2022). A plausible implication is that Euclidean Path-Integral Control is best understood not as a single algorithm, but as a family of structurally linearizable stochastic-control representations whose practical effectiveness depends on how successfully a problem can be brought into, or approximated by, that linearizable form.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Euclidean Path-Integral Control.