---
title: Inexact Dual Averaging Methods
url: https://www.emergentmind.com/topics/inexact-dual-averaging
type: topic
---

# Inexact Dual Averaging Methods

Inexact dual averaging denotes a class of dual-averaging methods in which the dual information used to recover primal iterates is not exact. The inexactness may arise from message compression with error feedback, approximate solution of the dual-averaging subproblem, consensus-induced oracle noise in distributed optimization, or approximate inner minimization in Lagrangian dual methods. Across these settings, the central objective is to preserve the averaging structure of dual averaging while quantifying how perturbations enter convergence bounds, feasibility guarantees, and structural properties of the iterates [2510.03507] [2403.14398] [1911.05979] [1302.3129].

## 1. Problem formulations and exact baseline

A canonical composite formulation is
\[
\min_{x\in\mathcal X}\;F(x)=f(x)+\psi(x),
\]
where \(f:\mathbb R^d\to\mathbb R\) is convex and \(L\)-smooth, and \(\psi:\mathbb R^d\to\mathbb R\cup\{+\infty\}\) is a closed convex regularizer or an indicator of a constraint set \(\mathcal X\) [2510.03507]. In the structured-learning setting, the same template appears as
\[
\min_{x\in\mathbb R^n}\;F(x):=f(x)+r(x),
\]
with \(r\) encoding sparsity, low rank, or related structure [2403.14398].

Exact dual averaging maintains an aggregate gradient and then solves a regularized primal recovery subproblem. One formulation uses
\[
G_k=\sum_{i=1}^k s_i\,\nabla f_{\xi_i}(x_{i-1}),\qquad \alpha_k=\sum_{i=1}^k s_i,
\]
followed by
\[
x_k=\arg\min_x\left\{\langle G_k,x\rangle+\tfrac12\|x-x_0\|_{H_k}^2+\alpha_k r(x)\right\}.
\]
When \(H_k=\eta^{-1}I\), this reduces to the classical proximal-DA subproblem with closed-form prox-updates for many \(r(\cdot)\) [2403.14398]. In the composite error-feedback setting, the exact dual-averaging reference point is the recursion \(z_t=\sum_{s=1}^t g_s\), where the primal iterate is recovered from a subproblem involving \(\langle z_t,x\rangle\), the accumulated regularizer, and a prox-function \(h\) through its Bregman divergence [2510.03507].

The same averaging principle also appears in distributed and constrained settings. In distributed dual averaging, each agent solves a primal step of the form
\[
x_{i,t+1}
=\arg\min_{x\in\mathcal X}
\Bigl\{
\sum_{k=0}^t a\,\langle h_{i,k},x\rangle+d(x)
\Bigr\},
\]
where \(d\) is the prox-function and \(h_{i,k}\) is a local dual estimate [1911.05979]. In dual methods for smooth convex programs with complicating constraints, averaging is applied to approximate primal and dual sequences generated from inexact dual gradients [1302.3129].

## 2. Sources of inexactness

The literature treats several distinct perturbation mechanisms. Some modify the gradient accumulation itself; some perturb the primal recovery subproblem; some replace exact global information with local surrogates; and some solve the inner Lagrangian problem only approximately.

| Setting | Inexactness mechanism | Control condition |
|---|---|---|
| Composite optimization with compression | \(\Delta_t=\mathcal C(u_t)\), \(e_t=u_t-\Delta_t\), \(u_t=g_t+e_{t-1}\) | \(\mathbb E[\mathcal C(u)]=u\), \(\mathbb E\|\mathcal C(u)-u\|^2\le (1-\delta)\|u\|^2\) |
| Adaptive dual averaging for structured learning | \( \hat x_k \) is an \(\epsilon_k\)-approximate subproblem solution | \(\min_{s\in\partial Q_k(\hat x_k)}\|s\|\le\epsilon_k\), \(Q_k(\hat x_k)\le Q_k(x_{k-1})\), \(\sum_{k=1}^\infty \epsilon_k^2<\infty\) |
| Distributed dual averaging | \(h_{i,t}=g_t+\delta_{i,t}\) from incomplete consensus | \(\|\delta_{i,k}\|\le C\|x_k-\mathbf 1 y_k\|\), \(\sum_{k=0}^{t-1}\|\delta_{i,k}\|=O(1)\) |
| Inexact dual first-order methods | \(\bar u(\lambda)\) approximately minimizes the inner Lagrangian | \(L(\bar u(\lambda),\lambda)-L(u(\lambda),\lambda)\le \epsilon_{\mathrm{in}}/3\) |

These models share a common feature: the error is not ignored but embedded into the analysis. In the error-feedback construction, the identity
\[
\Delta_t+e_t=g_t+e_{t-1}
\]
ensures that compression errors are carried forward explicitly [2510.03507]. In RAMDA, inexactness is made implementable through a subgradient-residual test and an objective-nondecrease exclusion criterion [2403.14398]. In distributed dual averaging, consensus mismatch is reinterpreted as an inexact-gradient oracle [1911.05979]. In inexact dual first-order methods for constrained convex optimization, approximate inner minimization induces an approximate dual function \(\bar d(\lambda)\) and approximate dual gradient \(\bar\nabla d(\lambda)\), together with the inequality
\[
0 \ge d(\mu)-[\bar d(\lambda)+\langle \bar\nabla d(\lambda),\mu-\lambda\rangle]
\ge -L_d\|\mu-\lambda\|^2-\epsilon_{\mathrm{in}}
\]
for any \(\mu\ge 0\) [1302.3129].

## 3. Algorithmic realizations

In the composite error-feedback scheme, the state consists of a dual vector \(z_t\), an error-memory vector \(e_t\), and a primal iterate \(x_t\). With a prox-function \(h:\mathcal X\to\mathbb R\) that is \(1\)-strongly convex with respect to some norm \(\|\cdot\|\), and Bregman divergence
\[
D_h(x,y)=h(x)-h(y)-\langle \nabla h(y),x-y\rangle,
\]
the iteration is
\[
g_t=\nabla f(x_{t-1};\xi_t),\qquad
u_t=g_t+e_{t-1},
\]
\[
\Delta_t=\mathcal C(u_t),\qquad e_t=u_t-\Delta_t,
\]
\[
z_t=z_{t-1}+\Delta_t,
\]
\[
x_t=\arg\min_{x\in\mathcal X}
\Bigl\{
\langle z_t,x\rangle+t\,\psi(x)+\tfrac{1}{\gamma_t}h(x)
\Bigr\}.
\]
An equivalent weighted form replaces \(t\) by \(A_t=\sum_{s=1}^t \alpha_s\) and \(\sum_{s=1}^t\Delta_s\) by \(\sum_{s=1}^t\alpha_s\Delta_s\) [2510.03507].

RAMDA retains the dual-averaging subproblem but introduces both adaptive preconditioning and inexact subproblem solves. Writing
\[
Q_k(x)=\langle G_k,x\rangle+\tfrac12(x-x_0)^T H_k(x-x_0)+\alpha_k r(x),
\]
the method computes only an approximate minimizer \(\hat x_k\). To obtain \(\hat x_k\), a proximal-gradient loop is applied to \(Q_k=\bar f_k+r\), where
\[
\bar f_k(x)=\langle G_k,x\rangle+\tfrac12(x-x_0)^T H_k(x-x_0),
\]
using
\[
z^{j+1}\leftarrow \operatorname{prox}_{\theta_k r}\bigl(z^j-\theta_k\nabla \bar f_k(z^j)\bigr),\qquad \theta_k\le 1/\|H_k\|_2.
\]
The iteration stops when the prescribed subgradient-residual and objective checks are satisfied [2403.14398].

In the smooth distributed setting, the local dual estimate is updated through a second-order consensus recursion:
\[
s_{i,t+1}=\sum_j p_{ij}s_{j,t}+\nabla f_i(x_{i,t+1})-\nabla f_i(x_{i,t}),
\]
\[
h_{i,t+1}=\sum_j p_{ij}h_{j,t}+s_{i,t+1}-s_{i,t}.
\]
This is then coupled with the dual-averaging primal step
\[
x_{i,t+1}
=\arg\min_{x\in\mathcal X}
\Bigl\{
\sum_{k=0}^t a\,\langle h_{i,k},x\rangle+d(x)
\Bigr\}
\]
[1911.05979].

In the constrained smooth convex case, inexact dual first-order methods operate on the dual problem
\[
d(\lambda)=\min_{u\in U} L(u,\lambda),\qquad \max_{\lambda\ge 0} d(\lambda),
\]
where \(L(u,\lambda)=F(u)+\langle \lambda,h(u)\rangle\). The outer loop uses approximate gradients \(g^k=h(\bar u^k)\), generated by approximately solving the inner problem. The IDG scheme updates
\[
\lambda^{k+1}=[\lambda^k+\alpha^k g^k]_+,
\]
and forms averaged primal and dual iterates
\[
\hat \lambda^k=\frac{1}{S^k}\sum_{j=0}^k \alpha_j\lambda^{j+1},\qquad
\hat u^k=\frac{1}{S^k}\sum_{j=0}^k \alpha_j \bar u^j.
\]
The IDFG variant adds a fast-gradient momentum step and a different averaging rule for \(\hat u^k\) [1302.3129].

## 4. Convergence theory

The central technical question is how the perturbation enters the dual-averaging telescoping argument. In the composite error-feedback setting, the main result for fixed weights \(\alpha_t\equiv 1\) and constant \(\gamma_t\equiv\gamma>0\) is stated for
\[
\bar x_T=\frac1T\sum_{t=1}^T x_t.
\]
Under convexity and \(L\)-smoothness of \(f\), closed convexity of \(\psi\), \(1\)-strong convexity of \(h\), and an unbiased compression operator satisfying
\[
\mathbb E[\mathcal C(u)]=u,\qquad
\mathbb E\|\mathcal C(u)-u\|^2\le (1-\delta)\|u\|^2,
\]
one has
\[
\mathbb E[F(\bar x_T)]-F(x^*)
\le
\frac{R^2}{\gamma T}
+\frac{\gamma L^2}{2T}
+\frac{L^2}{2T\delta}\sum_{t=1}^T \mathbb E\|e_{t-1}\|^2.
\]
With \(\gamma=\tfrac{R}{L}\sqrt{T}\) and the standard error-feedback estimate
\[
\sum_{t=1}^T \mathbb E\|e_t\|^2\le \frac{1-\delta}{\delta}\sum_{t=1}^T \mathbb E\|u_t\|^2,
\]
this yields
\[
\mathbb E[F(\bar x_T)]-F(x^*)=O\!\bigl(\tfrac{1}{\sqrt T}\bigr),
\]
and, ignoring constants,
\[
\mathbb E[F(\bar x_T)]-F(x^*)=O\!\Bigl(\tfrac{LR}{\sqrt T}\Bigr),
\]
which matches the classical exact composite dual averaging rate. The paper further remarks that one can refine the result to show an \(O(1/T)\) rate when \(f\) is also strongly convex [2510.03507].

The proof is based on a perturbed dual-averaging template. Defining
\[
\Phi_t=
\min_{x\in\mathcal X}
\Bigl\{
\langle z_t,x\rangle+t\,\psi(x)+\tfrac1\gamma h(x)
\Bigr\},
\]
one obtains
\[
\Phi_t-\Phi_{t-1}
\le
\langle g_t,x_{t-1}-x^*\rangle
+\langle e_{t-1},x_{t-1}-x_t\rangle
-\tfrac1\gamma D_h(x_t,x_{t-1}),
\]
and then bounds the error term using Young’s inequality and strong convexity of \(h\) [2510.03507].

In RAMDA, the convergence statement is asymptotic rather than purely ergodic. Under standard smoothness and bounded-variance assumptions on \(f\), step-sizes \(s_k\) satisfying
\[
\sum s_k/\alpha_k=\infty,\qquad \sum (s_k/\alpha_k)^2<\infty,
\]
momentum-averaging weights \(c_k\in[0,1]\) with \(\sum c_k=\infty\), and \(\sum \epsilon_k^2<\infty\), the iterates almost surely converge to a stationary point \(\bar x\) of \(F(x)=\mathbb E[f_\xi(x)]+r(x)\). The method also attains the familiar \(O(1/\sqrt K)\) rate, or \(1/K\) in convex cases, in terms of the squared norm of a limiting-subgradient measure [2403.14398].

In smooth distributed dual averaging, the decisive condition is that the second-order consensus matrix
\[
E(a)=
\begin{pmatrix}
\beta & a\\
L(\beta+1)&\beta+La
\end{pmatrix},
\qquad \beta=\sigma_2(P)<1,
\]
satisfies \(\rho(E(a))<1\), together with
\[
aL+\frac{aL}{(1-\rho(E(a)))^2}\le \frac12.
\]
Then the ergodic average \(\tilde y_t=\tfrac1t\sum_{k=1}^t y_k\) satisfies
\[
f(\tilde y_t)-f(x^*)\le \frac{n\,d(x^*)}{a\,t}=O\!\Bigl(\tfrac1t\Bigr),
\]
and each local average \(\tilde x_{i,t}\) also converges to \(x^*\) at rate \(O(1/t)\) [1911.05979].

For inexact dual first-order methods with averaging, the outer rates depend on the specific scheme. For IDG,
\[
F^*-d(\hat \lambda^k)\le \frac{L_d\|\lambda^*-\lambda^0\|^2}{k+1}+\epsilon_{\mathrm{in}},
\]
while IDFG yields
\[
F^*-d(\hat \lambda^k)\le \frac{4L_dR_d^2}{(k+1)^2}+\frac{k+1}{3}\epsilon_{\mathrm{in}}.
\]
The corresponding analyses also provide estimates on primal feasibility violation and primal suboptimality. The error propagation is mild in the sense summarized in the paper: IDG does not accumulate inner errors, whereas IDFG accumulates them linearly in \(k_{\mathrm{out}}\) but is faster in terms of \(k\) [1302.3129].

## 5. Regularizers, constraints, and structural effects

The nonsmooth or constrained part is not a peripheral detail in inexact dual averaging. In the composite error-feedback formulation, the dual-averaging subproblem has the form
\[
\langle z_t,x\rangle+t\,\psi(x)+\tfrac1{\gamma_t}h(x),
\]
so the regularizer or indicator enters directly into the accumulated objective. The paper emphasizes that the summation structure naturally accommodates \(\psi\), that the nonsmooth \(\psi\) accumulates linearly in \(t\), and that no virtual iterate is needed [2510.03507]. This point is methodologically significant because the paper also argues that the basic error-feedback mechanism and its standard analysis no longer stand when a composite part is involved [2510.03507].

In structured neural network training, the regularizer is used to induce sparsity, low rank, or related architecture-level structure. RAMDA connects inexact dual averaging to manifold identification through partial smoothness. If \(r\) is partly smooth at a solution \(\bar x\) relative to an active manifold \(\mathcal M\), and prox-regularity together with the nondegeneracy condition
\[
-\nabla f(\bar x)\in \operatorname{relint}\partial r(\bar x)
\]
hold, then the inexact DA iterates \(\hat x_k\) almost surely lie in \(\mathcal M\) for all sufficiently large \(k\) [2403.14398]. The paper interprets this as eventual attainment of the ideal structure induced by the regularizer at the stationary point of asymptotic convergence [2403.14398].

Constraint handling is equally central in the distributed and Lagrangian settings. Distributed dual averaging is described as attractive for handling constraints and dynamic networks [1911.05979]. In distributed model predictive control, complicating constraints are moved into the cost through Lagrange multipliers, and primal feasibility can be enforced through constraint tightening:
\[
G u+Ex+g+\mu\mathbf 1\le 0.
\]
Under Slater, the choice
\[
0<\mu\le \tfrac12 \min_j[-(G\hat u+Ex+g)_j]
\]
preserves strict feasibility of the tightened problem, and if \(\mu\) and \(\epsilon_{\mathrm{outer}}\) are \(O(\epsilon)\), the returned \(\hat u\) is feasible for the original constraints and satisfies \(F(\hat u)-F^*=O(\epsilon)\) [1302.3129].

## 6. Relations to proximal methods, limitations, and application domains

A recurrent comparison is between dual averaging and per-step proximal or mirror-descent updates. The composite error-feedback work contrasts dual averaging with proximal methods of the form
\[
x_t=\arg\min_x\Bigl\{\langle g_t,x\rangle+\psi(x)+\tfrac1\eta D_h(x,x_{t-1})\Bigr\},
\]
noting that proximal methods rely on per-step composite contractions, whereas dual averaging carries past gradients in \(z_t\) and solves a global subproblem at each step. This global subproblem is what enables the clean telescoping argument used in the inexact analysis [2510.03507].

The same section also identifies a limitation of prior error-feedback practice: standard EF methods are effective for smooth unconstrained optimization with compression, but fail in the broader setting of composite optimization. The reason is presented as a fundamental limitation in both the method and its analysis technique. The proposed combination of Dual Averaging with EControl is described as the first provable integration of error-feedback into composite dual averaging, with a strong convergence analysis in the general composite setting [2510.03507].

RAMDA broadens the inexact-dual-averaging perspective in a different direction. Compared with exact dual averaging, it allows diagonal adaptive \(H_k\), introduces momentum averaging via \(c_k\), and tolerates inexact prox-solve. Compared with other inexact proximal methods, its subgradient-norm criterion is described as fully implementable, as not requiring local smoothness of \(r\), and as allowing nonconvex \(r\) [2403.14398]. The associated proximal-gradient subsolver has complexity \(O(n)\) per PG iteration for the gradient plus the cost of the prox, and the iteration count needed to achieve \(\|\text{subgrad}\|\le \epsilon_k\) is \(O(\epsilon_k^{-1})\) when \(r\) is convex and \(O(\epsilon_k^{-2})\) when \(r\) is nonconvex [2403.14398].

The application range in the cited works is broad but technically coherent. Potential applications beyond composite convex optimization include constrained distributed optimization, safe reinforcement learning, stochastic approximation under resource constraints, and settings with inexact or incremental oracles that can be viewed as a form of compression error [2510.03507]. Empirical studies for RAMDA report large-scale modern computer vision, language modeling, and speech tasks, including structured ResNet on ImageNet, sparse Transformer-XL on WikiText, and sparse Tacotron2 on LJSpeech; the PG-based inexact subsolver cuts the per-epoch cost of adaptive structured training by \(\sim 2\)–\(4\times\) over near-exact solvers, with negligible loss in final accuracy [2403.14398]. In distributed smooth optimization, the proposed method is examined on a large-scale LASSO problem, where primal residual and objective error decay like \(O(1/t)\) [1911.05979]. In distributed MPC, inexact dual averaging is integrated with a parallel coordinate-descent inner solver and a tightening procedure that preserves feasibility guarantees [1302.3129].

Source: https://www.emergentmind.com/topics/inexact-dual-averaging