---
title: Zeroth-Order Mirror Descent
url: https://www.emergentmind.com/topics/zeroth-order-mirror-descent-framework
type: topic
---

# Zeroth-Order Mirror Descent

Zeroth-Order Mirror Descent Framework

The Zeroth-Order Mirror Descent (ZOMD) framework generalizes classical mirror descent methods to settings where only function value—rather than gradient—information is available from potentially biased and noisy oracles. This paradigm enables efficient optimization over general convex (and, in some extensions, nonconvex or composite) objectives, including those with high-dimensional, block-structured, or distributionally-robust characteristics under non-Euclidean geometries. Zeroth-order mirror descent has attained prominence due to its concrete oracle-based convergence guarantees, flexibility in handling bias and structure, and robustness to the absence of differentiability in the objective or regularizer [2303.09793, 2208.04579, 1710.10551].

## 1. Problem Formulation and Oracle Structure

The canonical ZOMD setup involves the minimization of a convex or composite objective over a compact or structured set:
\[
\min_{x \in \mathcal{X}} f(x)
\]
where $f:\mathbb{R}^n\to\mathbb{R}$ is typically convex or satisfies smoothness/regularity assumptions on $\mathcal{X}\subset\mathbb{R}^n$ [2303.09793, 2208.04579, 2408.12209, 1906.05527].

The oracle provides only noisy, possibly biased function values:
\[
\hat{f}(x) = f(x) + e(x,\omega), \qquad \mathbb{E}[e(x,\omega)] = b(x), \quad \|b(x)\|_* \leq B,
\]
with noise variance $\mathbb{E}[e(x,\omega)^2] \leq V^2$. This structure applies in both convex and nonconvex (including minimax and block-structured) settings, facilitating general-purpose optimization in black-box, high-dimensional, or adversarial contexts [2303.09793, 2408.12209, 1906.05527].

## 2. Gradient Surrogates via Smoothing and Estimation

Smoothing a non-differentiable or noisy objective is achieved by convolution with a stochastic kernel, yielding a differentiable approximation:
\[
f_\mu(x) = \mathbb{E}_{u}[f(x+\mu u)],
\]
with $u$ generated from either a Gaussian ($N(0,I)$), Rademacher ($\{\pm1\}^d$), or spherical uniform distribution, depending on the geometry [2303.09793, 2208.04579, 2408.12209, 1710.10551].

Gradient surrogates are computed by querying finite-difference values along random directions:
- **Gaussian/Uniform smoothing (two-point):**
  \[
  \tilde{g}_t = \frac{\hat{f}(x_t+\mu u_t) - \hat{f}(x_t)}{\mu}u_t.
  \]
- **Rademacher smoothing (two-point, mini-batched):**
  \[
  g_t = \frac{1}{m\nu} \sum_{j=1}^m [f(x_t+\nu u_{t,j};\xi_{t,j}) - f(x_t;\xi_{t,j})] u_{t,j},
  \]
  with $u_{t,j}\in\{\pm1\}^d$ and independent samples [2208.04579].

Under suitable bias and variance control, these estimators satisfy $E[\tilde{g}_t|x_t] = \nabla f_\mu(x_t) + B(t)$, with $B(t)$ determined by the bias term and smoothing parameter [2303.09793]. In high dimensions or with structural assumptions (e.g., sparsity), Lasso-based de-biased estimators are used to maintain favorable scaling [1710.10551].

## 3. Mirror Map, Bregman Geometry, and Update Rule

Mirror descent is parameterized by a strongly convex "mirror map" $R$ or $\Psi$, with corresponding Bregman divergence:
\[
D_R(x,y) = R(x) - R(y) - \langle \nabla R(y), x - y \rangle.
\]
The ZOMD update with stochastic step-size $\alpha_t$ is:
\[
x_{t+1} = \operatorname{argmin}_{x\in\mathcal{X}}\left\{\langle \tilde{g}_t, x - x_t \rangle + \frac{1}{\alpha_t} D_R(x,x_t)\right\}.
\]
In structured or block-coordinate variants, one defines block-separable distance generators and applies the (possibly blockwise) proximal mapping accordingly [1906.05527]. For non-Euclidean domains, entropy-like potentials and $\ell_\infty$ geometry are employed to leverage intrinsic dimensionality [2208.04579, 1710.10551].

In minimax or composite problems, primal and dual variables each receive tailored potentials, e.g., an entropy potential on the probability simplex and a Euclidean or non-Euclidean map on the hypothesis space [2408.12209].

## 4. Convergence Principles and Finite-Time Guarantees

A central result is almost-sure convergence to a neighborhood of optimality for convex $f$:
\[
\limsup_{t\to\infty} f(z_t) - f^* \leq \delta + B_1 D,
\]
with $\delta$ (smoothing bias) and $B_1$ (oracle bias contribution) explicitly tied to $\mu$, noise strength, and dimension [2303.09793]. Finite-time concentration inequalities provide probabilistic bounds on deviations from the neighborhood after $t$ iterations, controlled by variance and step-size schedule [2303.09793, 2408.12209].

In nonconvex settings, expected stationarity or generalized gradient mapping norms serve as the measure, with complexity scaling as $O((\ln d)/\epsilon^4)$ or $O(bn/\epsilon^2)$, reflecting the use of mini-batches, block sampling, or variance-reduction [2208.04579, 1906.05527].

For structured problems (e.g., block coordinate or sparse high-dimensional), the use of random feature selection and Lasso-based debiasing under sparsity achieves convergence rates with only logarithmic dependence on the ambient dimension [1710.10551].

## 5. Deterministic and Advanced Variants

Recent research incorporates deterministic vector-field-driven mirror descent, replacing the stochastic surrogate with central finite difference schemes. The update is governed by:
\[
x_{j+1} = (\nabla \Phi)^{-1}(\nabla \Phi(x_j) - \eta_j \Omega(x_j)),
\]
where $\Omega$ is constructed deterministically using $2d+1$ function values per iteration. Trajectory-wise a posteriori certification provides verifiable last-iterate guarantees under relative-smoothness-type inequalities and punctured-neighborhood generalized star-convexity conditions [2602.00634]. The error floor is explicitly resolution-dependent, and backtracking can be used to certify monotonic descent [2602.00634].

## 6. Specialized Extensions: Block, Composite, and Minimax Problems

The ZOMD framework supports block coordinate approaches and composite settings:
- **Block-coordinate and composite objectives:** The domain is partitioned, and updates are made selectively per block, enabling scalable optimization for high-dimensional and separable regularized objectives. Complexity achieves $O(bn/\epsilon^2)$ for $(\epsilon,\Lambda)$-stationarity with a two-phase approach yielding high-probability bounds [1906.05527].
- **Distributionally robust and minimax programs:** ZO-SMD is adapted to minimax excess risk optimization, updating both model and dual variables via separate mirror maps, with optimal $O(1/\sqrt{t})$ convergence of both excess risk estimation and minimax error in both smooth and nonsmooth regimes [2408.12209].

## 7. Parameter Tuning, Bias–Variance Trade-off, and Practical Considerations

Parameter choices for step sizes ($\alpha_t$, $\eta_t$), smoothing ($\mu$), and batch size are critical for achieving the explicit bias-variance trade-off. Key principles:
- Smoothing parameter $\mu$ determines the bias (smoothing error $O(\mu)$ or $O(\mu^2)$) versus the variance (inflated as $O(1/\mu^2)$ as $\mu\to0$).
- For unbiased oracles, one may schedule $\mu\to0$ slowly to obtain vanishing neighborhoods; under nonzero bias, the limiting error is minimized at a balancing value of $\mu$ [2303.09793].
- Step-size schedules must satisfy $\sum \alpha_t = \infty$, $\sum \alpha_t^2 < \infty$. Commonly, $\alpha_t=1/t$ is effective [2303.09793].
- In nonconvex and high-dimensional settings, mini-batching and feature selection reduce variance and computational cost without degraded rates [2208.04579, 1710.10551].
- Adaptive step sizes can obviate the need for Lipschitz constants [2208.04579].

The practical implementation requires only function value oracles and is robust to noise and structural heterogeneity of the objective or constraint geometry.

---

**References:**  
- "Robust Analysis of Almost Sure Convergence of Zeroth-Order Mirror Descent Algorithm" [2303.09793]  
- "Adaptive Zeroth-Order Optimisation of Nonconvex Composite Objectives" [2208.04579]  
- "Stochastic Zeroth-order Optimization in High Dimensions" [1710.10551]  
- "Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess Risk Optimization" [2408.12209]  
- "Deterministic Zeroth-Order Mirror Descent via Vector Fields with A Posteriori Certification" [2602.00634]  
- "Zeroth-Order Stochastic Block Coordinate Type Methods for Nonconvex Optimization" [1906.05527]

Source: https://www.emergentmind.com/topics/zeroth-order-mirror-descent-framework