---
title: Stochastic Differential Equations (SDEs)
url: https://www.emergentmind.com/topics/stochastic-differential-equations
type: topic
---

# Stochastic Differential Equations (SDEs)

Stochastic differential equations (SDEs) are differential or integral equations describing continuous-time dynamics driven by random processes, conventionally Brownian motion or a Wiener process. A general Itô SDE has the form
\[
d\mathbf X_t=\mathbf a(t,\mathbf X_t)\,dt+\mathbf b(t,\mathbf X_t)\,d\mathbf W_t,
\]
where the drift $\mathbf a$ specifies the conditional systematic tendency and the diffusion coefficient $\mathbf b$ specifies the scale and geometry of stochastic variation. The differential notation is shorthand for an integral identity; in particular, $d\mathbf W_t$ does not denote an ordinary derivative. SDEs provide pathwise models, while their probability laws evolve according to Fokker–Planck equations. They are used in physical, biological, financial, biomedical, ecological, control, optimization, and machine-learning models.

## 1. Mathematical formulation and stochastic calculus

An SDE is defined on a filtered probability space carrying a Brownian motion. For $t>s$,
\[
W_t-W_s\sim N(0,t-s),
\]
and the increment is independent of the information available up to time $s$. The rigorous meaning of
\[
dX_t=b(t,X_t)\,dt+\sigma(t,X_t)\,dW_t
\]
is the integral equation
\[
X_t=X_0+\int_0^t b(s,X_s)\,ds+\int_0^t\sigma(s,X_s)\,dW_s.
\]
The first integral is an ordinary Lebesgue integral; the second is a stochastic integral defined through limiting procedures for adapted processes. The distinction between a stochastic process and one of its sample paths is fundamental: $X_t$ is a random variable, whereas a realization $x_t$ is an ordinary function of time.

In the Itô interpretation, the integrand is evaluated using information available at the beginning of each time increment. The basic formal rules are
\[
(dW_t)^2=dt,\qquad dt\,dW_t=0,\qquad (dt)^2=0.
\]
For a sufficiently smooth function $f(t,x)$, Itô’s formula is
\[
df(t,X_t)
=
\left(
\frac{\partial f}{\partial t}
+b\frac{\partial f}{\partial x}
+\frac12\sigma^2\frac{\partial^2 f}{\partial x^2}
\right)dt
+
\sigma\frac{\partial f}{\partial x}\,dW_t.
\]
The second-derivative term is the Itô correction and reflects the nonzero quadratic variation of Brownian motion.

A Stratonovich SDE is written
\[
dX_t=b(t,X_t)\,dt+\sigma(t,X_t)\circ dW_t.
\]
Its integral obeys the ordinary chain rule of deterministic calculus. In one dimension, the Stratonovich equation is equivalent to the Itô equation
\[
dX_t=
\left[
b(t,X_t)+\frac12\sigma(t,X_t)\frac{\partial\sigma}{\partial x}(t,X_t)
\right]dt
+\sigma(t,X_t)\,dW_t.
\]
The choice between Itô and Stratonovich interpretations is therefore part of the model specification, not merely a notational convention [1210.0933].

The quadratic variation of Brownian motion is
\[
[W]_t=t.
\]
It is obtained from sums of squared increments,
\[
\sum_j\left(W_{t_{j+1}}-W_{t_j}\right)^2,
\]
rather than from an ordinary Stieltjes integral. Consequently,
\[
d(X_t^2)=2X_t\,dX_t+dt
\]
for Brownian motion, and
\[
\int_0^t X_s\,dX_s=\frac12X_t^2-\frac12t.
\]
This distinguishes stochastic calculus from deterministic calculus. Brownian paths are continuous but almost surely nowhere differentiable and of unbounded variation, so ordinary pathwise Riemann–Stieltjes integration is generally unavailable. Henstock–Kurzweil or Stieltjes-complete integration provides a broader cancellation-based framework, but Itô integration remains a distinct probabilistic construction [1407.7147].

## 2. Drift, diffusion, and probability laws

For a scalar Itô diffusion,
\[
dX_t=\mu(X_t,t)\,dt+\sigma(X_t,t)\,dW_t,
\]
the drift satisfies
\[
\mathbb E[dX_t\mid X_t=x]\approx \mu(x,t)\,dt,
\]
while the conditional variance satisfies
\[
\operatorname{Var}(dX_t\mid X_t=x)
\approx \sigma^2(x,t)\,dt.
\]
In $d$ dimensions, the diffusion covariance is
\[
a(t,x)=\sigma(t,x)\sigma(t,x)^{\mathsf T}.
\]
The drift and diffusion have distinct inferential roles: systematic local motion should not be conflated with intrinsic stochasticity.

If $p(x,t)$ denotes the density of $X_t$, then formally
\[
\frac{\partial p}{\partial t}
=
-\sum_i\frac{\partial}{\partial x_i}\bigl(b_i(x,t)p\bigr)
+
\frac12\sum_{i,j}
\frac{\partial^2}{\partial x_i\partial x_j}
\bigl(a_{ij}(x,t)p\bigr).
\]
This is the Fokker–Planck equation. The SDE represents individual trajectories, whereas the Fokker–Planck equation represents the evolution of their ensemble density. The generator acting on smooth test functions is
\[
Lf(x)
=
b(x)\cdot\nabla f(x)
+\frac12 a(x):D^2f(x).
\]

For the inward-pointing discontinuous drift
\[
dX_t=-k\,\operatorname{sign}(X_t)\,dt+dB_t,
\]
the classical global Lipschitz assumptions fail. A formal stationary Fokker–Planck calculation gives
\[
\rho(x)=k e^{-2k|x|},
\]
a Laplace density centered at zero with scale $1/(2k)$. Euler–Maruyama density recursions and smooth approximations of the sign function approach this candidate numerically, although the existence, uniqueness, Euler–Maruyama convergence, and convergence of stationary densities are not established in that analysis [1308.5339].

SDEs can also be coupled to nonlinear evolution of probability laws. A distribution-dependent SDE, or McKean–Vlasov SDE, has the form
\[
dX_t=b\bigl(t,X_t,\mathcal L(X_t)\bigr)\,dt
+\sigma\bigl(t,X_t,\mathcal L(X_t)\bigr)\,dW_t.
\]
Its law solves a nonlinear Fokker–Planck equation. Weak existence can be formulated through a superposition principle: a solution of the nonlinear Fokker–Planck equation corresponds to a weak solution of the distribution-dependent SDE. Well-posedness is commonly obtained by fixed-point arguments on curves of probability measures, with Wasserstein-distance estimates controlling dependence on the law [2012.13656].

## 3. Existence, uniqueness, regularity, and constraints

Classical existence and uniqueness theorems typically require local or global Lipschitz conditions and suitable growth bounds. Under such assumptions, strong solutions are constructed on a prescribed probability space and are pathwise unique. When coefficients are discontinuous, singular, distribution-dependent, or constrained by algebraic relations, these conclusions may fail or require modified notions of solution.

For discontinuous drifts, one approach replaces a discontinuous function $f$ by its Filippov regularization
\[
F(r)=\bigcap_{\delta>0}\bigcap_{m(N)=0}
\overline{\operatorname{co}\bigl(f(B_\delta(r)\setminus N)\bigr)}.
\]
The SDE is then interpreted as an inclusion,
\[
dX_t+F(X_t)\,dt\ni B(X_t)\,dW_t.
\]
Smooth approximations, uniform Itô estimates, tightness, Skorohod representations, and weak convergence can yield martingale solutions. In finite-dimensional systems with measurable linear-growth drift and Lipschitz diffusion, existence of at least one martingale solution is obtained, but uniqueness is not asserted in general. The same strategy extends to stochastic heat equations and stochastic parabolic systems [1504.06439].

A different pathwise theory treats discontinuous diffusion coefficients in one-dimensional equations driven by Hölder processes:
\[
dX_t=\sigma(X_t)\,dY_t.
\]
If $Y$ is Hölder continuous with exponent greater than $1/2$, $\sigma$ has locally bounded variation and fixed sign, and $1/\sigma$ is locally integrable, the Lamperti transform
\[
A(x)=\int^x\frac{1}{\sigma(y)}\,dy
\]
gives the explicit solution
\[
X_t=A^{-1}\bigl(A(X_0)+Y_t-Y_0\bigr).
\]
Uniqueness holds up to the first time at which $\sigma(X_t)=0$ and is global when $\sigma$ never vanishes. The theory applies, in particular, to fractional Brownian motion with Hurst parameter $H>1/2$ [1908.03183].

Constraints introduce further compatibility requirements. An explicit stochastic differential-algebraic equation may be written
\[
dx=f(x,u)\,dt+\sigma(x,u)\,dW_t,
\]
together with
\[
g(x,u)=-\int_0^t\Gamma(x(s),u(s))\,dW_s.
\]
If the constraint manifold is smooth, every diffusion direction must be tangent to it:
\[
\operatorname{Img}
\begin{bmatrix}
\sigma\\B
\end{bmatrix}
\subseteq \ker Dg.
\]
Equivalently, each diffusion direction must satisfy
\[
D_xg\,\sigma_i+D_ug\,B_i=0.
\]
Failure of this stochastic tangency condition can imply nonexistence of a pathwise Itô solution. For index-one systems, Itô differentiation of the algebraic constraint yields an ordinary SDE for the combined differential and algebraic variables. For completely high-index systems, repeated stochastic differentiation may be required, and some systems are ill-posed. Approximate methods enforce the constraint either with probability one locally or with a prescribed probability bound [2102.00605].

The $G$-framework replaces a single probability law by a sublinear expectation representing volatility uncertainty. A $G$-Brownian motion has uncertain quadratic variation,
\[
\underline{\sigma}^{\,2}\,dt
\le d\langle B\rangle_t
\le \overline{\sigma}^{\,2}\,dt.
\]
A $G$-SDE contains both $dB_t$ and $d\langle B\rangle_t$ terms. Its pathwise representation can reduce the equation to a parametrized ordinary differential equation, and comparison theorems hold quasi-surely under conditions involving the nonlinear function
\[
G(a)=\frac12\left(\overline{\sigma}^{\,2}a^+
-\underline{\sigma}^{\,2}a^-\right)
\]
[1309.5232].

## 4. Numerical integration and likelihood approximation

The Euler–Maruyama method discretizes
\[
dX_t=a(t,X_t)\,dt+b(t,X_t)\,dW_t
\]
as
\[
X_{n+1}
=
X_n+a(t_n,X_n)h+b(t_n,X_n)\Delta W_n,
\]
where
\[
\Delta W_n\sim N(0,h).
\]
For sufficiently regular equations, its deterministic order is $1$ and its usual strong order is $1/2$. At low observation frequency, Euler–Maruyama transition likelihoods can be substantially biased, especially for mean-reverting or nonlinear diffusions.

A modified stochastic Improved Euler or Heun method introduces an auxiliary random sign $S_n\in\{-1,1\}$ for Itô equations:
\[
K_1=h\,a(t_n,X_n)+(\Delta W_n-S_n\sqrt h)b(t_n,X_n),
\]
\[
K_2=h\,a(t_{n+1},X_n+K_1)
+(\Delta W_n+S_n\sqrt h)b(t_{n+1},X_n+K_1),
\]
\[
X_{n+1}=X_n+\frac12(K_1+K_2).
\]
For Stratonovich equations, $S_n=0$. Under smoothness assumptions, the method has global strong order one; specially structured additive-noise equations can exhibit strong order two [1210.0933].

Higher strong-order stochastic Runge–Kutta methods require iterated Itô integrals. For example,
\[
I^{ii}(h)=\frac12\bigl((\Delta W^i)^2-h\bigr),
\]
whereas cross-integrals $I^{ij}(h)$ for $i\ne j$ require additional approximations, such as Wiktorsson-type random series. Strong methods approximate individual paths and must use consistent Brownian increments across resolutions. Weak methods approximate expectations and distributions; they can replace Gaussian increments by discrete random variables with matching moments and require large Monte Carlo ensembles [1606.06604].

For likelihood-based inference, the exact SDE transition density is generally unavailable. A high-order Hermite expansion can approximate it after a Lamperti-type transformation to unit diffusion. For an order-$K$ expansion,
\[
\log p_X^{(K)}(x_j,\Delta_j\mid x_{j-1})
\]
is expressed through powers of $\Delta_j$ and recursively computed coefficients. The order-$2$ approximation is used in the cited simulations. It performs better than Euler–Maruyama at sparse or irregular observation frequencies, although deriving the multidimensional coefficients can be algebraically demanding [1004.3871].

When random effects describe between-subject variability, the resulting stochastic differential mixed-effects model is
\[
d\mathbf X_t^i
=
\boldsymbol\mu(\mathbf X_t^i,\boldsymbol\theta,\mathbf b^i)\,dt
+
\boldsymbol\sigma(\mathbf X_t^i,\boldsymbol\theta,\mathbf b^i)\,d\mathbf W_t^i.
\]
The diffusion represents within-subject stochasticity, while $\mathbf b^i$ represents systematic between-subject variability. Integrating out multiple random effects is performed with a Laplace approximation. Subject-level modes are found through internal optimization, while population parameters are optimized externally. This permits likelihood-based inference for multidimensional SDEs with multiple random effects in pharmacokinetic, biomedical, growth, and ecological applications [1004.3871].

## 5. Modeling, inference, and learning

SDE parameters may be fixed, random, covariate-dependent, or distribution-dependent. Varying-coefficient SDEs replace constant parameters by predictors such as
\[
h(\theta_t)=\beta_0+\sum_j f_j(x_{jt}),
\]
where $f_j$ may be a linear effect, factor effect, random effect, or penalized spline. This allows drift and diffusion parameters to vary with time, temperature, location, individual identity, or behavioral phase while retaining a mechanistic SDE form. Approximate transition likelihoods are evaluated using closed-form transitions when available or Euler–Maruyama otherwise. Penalized likelihood, generalized additive-model bases, random effects, automatic differentiation, and Laplace approximation provide computationally efficient inference [2008.09111].

A neural SDE-learning strategy can embed an Euler–Maruyama transition directly into a neural architecture:
\[
\mathbf x_{t+\tau}
=
\mathbf x_t
+
\tau\mathcal F_\omega(\mathbf x_t,t)
+
\sqrt{\tau}\,
\mathcal L_\phi(\mathbf x_t,t)\boldsymbol\varepsilon_t,
\]
with $\boldsymbol\varepsilon_t\sim N(0,I)$. The approximate conditional transition is Gaussian with mean
\[
\mathbf m_t=\mathbf x_t+\tau\mathcal F_\omega(\mathbf x_t,t)
\]
and covariance
\[
\mathbf\Sigma_t
=
\tau\mathcal L_\phi(\mathbf x_t,t)
\mathcal L_\phi(\mathbf x_t,t)^{\mathsf T}.
\]
Maximum likelihood jointly estimates drift and diffusion. The covariance term is essential: treating stochastic residuals as deterministic prediction error prevents estimation of the diffusion. Applications to geometric Brownian motion and a stochastic Lorenz-63 system show that explicit diffusion modeling improves recovery of stochastic behavior relative to deterministic neural networks [2105.08449].

Neural Laplace methods instead represent a stochastic trajectory through its pathwise Laplace transform,
\[
F(s)=\int_0^\infty e^{-st}X_t\,dt.
\]
For geometric Brownian motion,
\[
dX_t=\mu X_t\,dt+\sigma X_t\,dB_t,
\]
the mean transform satisfies
\[
\mathbb E[F(s)]=\frac{X_0}{s-\mu}
\]
when $\operatorname{Re}(s)>\mu$. The approach is exploratory: it studies geometric Brownian motion, does not explicitly decompose drift and diffusion, and does not establish general SDE-identification results. In the reported experiment, deterministic neural ODE baselines outperform Neural Laplace because the selected geometric Brownian motion regime is dominated by exponential drift [2406.04964].

SDEs also arise as continuous-time models of stochastic gradient descent. For least-squares problems, the corresponding SDE has gradient drift and a diffusion covariance matching the covariance of stochastic-gradient fluctuations:
\[
d\theta_t
=
-\nabla L(\theta_t)\,dt
+
\sqrt{\gamma}\,\sigma(\theta_t)\,dB_t.
\]
In finite-sample overparameterized problems, the diffusion range lies in the span of the training data, and both drift and diffusion vanish on the interpolation set. Consequently, invariant measures can be degenerate and supported on interpolating solutions. In population models with persistent observation noise, the invariant distribution is generally nondegenerate [2407.02322].

## 6. Extensions, geometry, and applications

SDE theory extends beyond semimartingale Brownian drivers. Rough stochastic differential equations combine an Itô Brownian component with a pathwise rough component:
\[
dY_t
=
b_t(Y_t)\,dt
+\sigma_t(Y_t)\,dB_t
+(f_t,f'_t)(Y_t)\,d\mathbf X_t.
\]
The rough path $\mathbf X=(X,\mathbb X)$ stores first- and second-level increments and satisfies Chen’s relation. Stochastic controlled rough paths separate the martingale component from the rough controlled component. The resulting solution map is pathwise and locally stable in the rough-path metric while retaining progressive measurability and Itô integration for the Brownian component. This framework supports conditional SDEs, filtering, stochastic control, common-noise McKean–Vlasov systems, and rough Fokker–Planck equations [2106.10340].

Loop-driven SDEs probe noncommutative geometry. If a Brownian motion is conditioned to close in a free nilpotent group through level $N$, all iterated integrals up to level $N$ vanish at the terminal time. The first surviving effects arise from vector-field commutators of length $N+1$. For a Brownian bridge, corresponding to $N=1$, the leading operator is
\[
\Delta_1=\frac1{24}\sum_{i<j}[V_i,V_j]^2.
\]
If the relevant commutators vanish, the terminal random variable collapses to its initial value; if they span the state space, the terminal law has a smooth density. Thus loop-driven equations connect SDEs with free nilpotent groups, Hörmander theory, Malliavin calculus, stochastic holonomy, and hypoelliptic density asymptotics [1402.5118].

Random delays produce a different departure from ordinary Langevin models. In the equation
\[
\frac{dx(t)}{dt}=x(\tau(t)),
\qquad
\tau(t)\sim\operatorname{Uniform}[0,t],
\]
the stochasticity enters through a randomly selected past argument rather than an additive or multiplicative white-noise term. Under the self-averaging interpretation, the continuous-time equation becomes deterministic:
\[
t\,x''(t)+x'(t)=x(t).
\]
Its solution is
\[
x(t)=I_0(2\sqrt t),
\]
where $I_0$ is the modified Bessel function. A finite-step discretization retains intrinsic fluctuations, and the deterministic continuous limit is recovered only when the step size tends to zero at fixed physical time [1108.1298].

SDEs may also include random effects, memory, uncertain volatility, singular perturbations, and boundary constraints. For $G$-stochastic delay equations, practical exponential stability in the $p$th moment can be transferred among the exact delayed equation, an auxiliary nondelayed equation, and their Euler–Maruyama approximations when the delay and step size are sufficiently small. The stability estimate has the form
\[
\mathbb E|X_t|^p
\le
M\|\xi\|^p e^{-\lambda t}+d,
\]
where $d$ allows convergence to a nonzero residual neighborhood [2405.07519].

Applications include pharmacokinetics and pharmacodynamics, biomedical modeling, animal movement, body-condition dynamics, diving behavior, population ecology, stochastic control, finance, and optimization. In ecological models, varying drift and diffusion can describe temperature-dependent elephant movement, covariate-dependent lipid accumulation in elephant seals, and phase-dependent variability in whale diving. In population models, multiplicative noise can produce extinction events absent from deterministic dynamics. The central methodological distinction throughout these applications is between systematic structure encoded by the drift, intrinsic stochastic fluctuations encoded by the diffusion, heterogeneity encoded by random effects or law dependence, and measurement or observation error, which requires an additional observation model.

Source: https://www.emergentmind.com/topics/stochastic-differential-equations