---
title: Error Feedback in Optimization
url: https://www.emergentmind.com/topics/error-feedback-ef
type: topic
---

# Error Feedback in Optimization

Searching arXiv for recent and foundational papers on Error Feedback to ground the article and citations.
Error Feedback (EF), also called error compensation, denotes a family of stateful correction mechanisms in which the discrepancy between an intended vector and its compressed, quantized, clipped, or otherwise distorted surrogate is stored and re-injected into later iterations. In contemporary optimization literature, EF is most closely associated with communication-efficient distributed and federated learning under biased or contractive compressors such as Top-\(K\), but related architectures also appear in \(\Delta\Sigma\) quantization, compressed second-order preconditioners, and differentially private SGD. Across these domains, EF is best understood not as a single algorithm but as a residual-memory principle whose mathematical behavior depends strongly on smoothness, stochasticity, constraints, and the structure of the underlying distortion operator [1901.09847][1609.01383].

## 1. Canonical mechanism and virtual-iterate interpretation

A standard EF recursion in smooth unconstrained optimization has the form
\[
p_t=\gamma g_t+e_t,\qquad \Delta_t=\mathcal C(p_t),\qquad x_{t+1}=x_t-\Delta_t,\qquad e_{t+1}=p_t-\Delta_t.
\]
Here \(g_t\) is a gradient or stochastic gradient, \(\mathcal C\) is a compressor, and \(e_t\) is the residual memory. The central idea is that compression error is not discarded: whatever is lost when \(p_t\) is mapped to \(\Delta_t\) becomes the next residual. In distributed variants, the same principle is applied workerwise and then averaged at the server; in two-sided schemes such as dist-EF-SGD, both workers and server maintain residual variables, and the recursion includes the factor \(\eta_{t-1}/\eta_t\) when learning rates vary [2510.03507][2003.04706].

The classical analytical device is the virtual iterate
\[
\tilde x_t:=x_t-e_t.
\]
Under the additive update above,
\[
\tilde x_{t+1}=x_{t+1}-e_{t+1}=x_t-\Delta_t-(p_t-\Delta_t)=\tilde x_t-\gamma g_t.
\]
Thus the hidden sequence \(\tilde x_t\) follows the same recursion as uncompressed SGD. This identity explains why EF is effective in smooth unconstrained settings: the actual iterate is a perturbed version of an exact first-order method, and the perturbation is the residual itself. Much of the later EF literature either strengthens this virtual-iterate view or studies precisely where it breaks.

## 2. Compression models, bias correction, and classical stabilization results

The EF literature distinguishes unbiased compressors from contractive or biased compressors. One common formulation defines an unbiased compressor by
\[
\mathbb{E}[\mathcal{C}(x)] = x,\qquad \mathbb{E}\|\mathcal{C}(x)\|^2 \le \delta\|x\|^2,
\]
and a contractive compressor by
\[
\mathbb{E}\|\mathcal{C}(x)-x\|^2 \le \left(1-\frac1\delta\right)\|x\|^2.
\]
Equivalent notations appear as \(\mathbb U(\omega)\) for unbiased compression and \(\mathbb B(\alpha)\) for biased contractive compression with
\[
\mathbb E\|\mathcal C(x)-x\|^2\le (1-\alpha)\|x\|^2.
\]
Top-\(K\) is the canonical biased example: it is contractive, with \(\alpha=k/d\) or equivalently \(\delta=d/K\), but it is not unbiased [2006.11077].

The original motivation for EF was that naive biased compression can be unstable. Sign-based and Top-\(K\)-type methods can fail even on simple convex or strongly convex problems, and the 2019 analysis of signSGD showed explicit counterexamples in which the objective increases in expectation or the iterates remain trapped away from the optimum. In that work, EF-SGD with arbitrary compression was shown to achieve the same convergence rate as SGD without additional assumptions, and the smooth nonconvex bound places compression only in a higher-order term [1901.09847]. This established the now-standard viewpoint that the main pathology is not compression per se, but uncorrected biased compression.

A related conclusion appears in later distributed analyses: biased compression alone is not stable in general, whereas EF converts persistent directional distortion into a delayed-transmission effect. This is the historical core of EF’s role in communication-efficient optimization.

## 3. Modern formulations: EF21, unified bias-variance correction, momentum, and sharper heterogeneity theory

A major reformulation of EF is EF21, which replaces explicit residual accumulation by a recursive gradient estimator. Worker \(i\) maintains \(g_i^t\) and updates
\[
x^{t+1}=x^t-\gamma g^t,\qquad g^t=\frac1n\sum_{i=1}^n g_i^t,
\]
\[
g_i^{t+1}=g_i^t+\mathcal C\big(\nabla f_i(x^{t+1})-g_i^t\big).
\]
The compressor is applied not to the full gradient but to the innovation relative to the current local estimate. This yields a one-step contraction recursion for \(\|\nabla f_i(x^t)-g_i^t\|^2\), and under standard smoothness and lower-boundedness assumptions EF21 attains an \(O(1/T)\) nonconvex rate and a linear rate under the Polyak–Łojasiewicz condition, without bounded-gradient assumptions and without auxiliary unbiased compressors [2106.05203].

The 2021 extension paper showed that the EF21 mechanism supports a broad algorithmic envelope: partial participation, stochastic approximation, variance reduction, proximal composite objectives, heavy-ball momentum, and bidirectional compression all admit explicit convergence theory within the same Markov-compressor framework. In particular, EF21-PAGE supplies a variance-reduced finite-sum analogue, EF21-Prox covers \(f+r\) with proximal updates, and EF21-BC compresses both uplink and downlink while improving substantially over earlier bidirectional EF analyses [2110.03294].

A different line, EF-BV, places EF and DIANA-style variance reduction inside a single compressor class \(\mathbb C(\eta,\omega)\) defined by separate bias and variance controls:
\[
\|\mathbb E[\mathcal C(x)]-x\|\le \eta\|x\|,\qquad
\mathbb E\|\mathcal C(x)-\mathbb E[\mathcal C(x)]\|^2\le \omega\|x\|^2.
\]
Its update
\[
d_i^t=\mathcal C_i^t(\nabla f_i(x^t)-h_i^t),\qquad
h_i^{t+1}=h_i^t+\lambda d_i^t,\qquad
g^{t+1}=h^t+\nu d^t
\]
recovers DIANA when \(\nu=1\) and EF21 when \(\nu=\lambda\). The key consequence is that biased compressors and averaging-induced variance reduction need not be treated as disjoint worlds [2205.04180].

Two later refinements are especially relevant. First, adding Polyak momentum before compression in EF21-SGDM and EF21-SGD2M removes the large-batch requirement that earlier stochastic EF21 analyses needed in the nonconvex regime. The resulting stochastic term matches the desired \(O(\sigma^2/(n\varepsilon^4))\) behavior asymptotically, and the paper’s central message is explicit: momentum provably improves error feedback [2305.15155]. Second, the 2024 “Reloaded” analysis showed that EF21’s heterogeneity dependence can be improved from the quadratic mean
\[
\sqrt{\frac1n\sum_{i=1}^n L_i^2}
\]
to the arithmetic mean
\[
\frac1n\sum_{i=1}^n L_i
\]
of local smoothness constants, via a weighted Lyapunov analysis. This is a strict improvement and can be substantial in heterogeneous regimes [2402.10774].

## 4. Critiques, impossibility results, and setting-dependent limitations

EF is not uniformly dominant across settings, and a substantial body of work has made that point sharply. One influential critique argues that EF is not the right default mechanism for contractive biased compressors because any contractive compressor \(\mathcal C_1\) can be converted into an induced unbiased compressor
\[
\mathcal C(x)=\mathcal C_1(x)+\mathcal C_2\bigl(x-\mathcal C_1(x)\bigr),
\]
after which standard unbiased-compression methods can be used. In that framework, the induced approach has reduced persistent memory, better communication-complexity guarantees, weaker assumptions, and immediate compatibility with DIANA-style variance reduction and partial participation. The same paper also states that if the compressor is already unbiased, adding EF is generally a bad idea and can hurt empirically [2006.11077].

Another critique is structural rather than comparative. In composite optimization with
\[
F(x)=f(x)+\psi(x),
\]
the classical EF virtual-iterate argument no longer survives the nonlinear proximal map. The paper “Composite Optimization with Error Feedback: the Dual Averaging Approach” states that vanilla EF is not the right abstraction once a non-smooth regularizer or constraints are present, because the composite update destroys the additive structure that underpins standard EF analysis. Its remedy is to move error control into dual accumulation via Dual Averaging + EControl rather than in the primal step itself [2510.03507].

The nonsmooth constrained convex regime produces an even sharper separation among EF variants. In Safe-EF, compressed subgradient descent can stall on \(f(x)=\|x\|_1\), and EF21 can diverge on the same type of nonsmooth problem, whereas an EF14-style residual mechanism combined with a feasibility-preserving switching rule attains the lower bound order \(O(RM/\sqrt{\delta T})\) in the unidirectional case [2505.06053]. Thus “EF” is not a monolithic concept: gradient-tracking EF21, classical residual EF14, and composite-aware dual schemes behave differently outside the smooth unconstrained setting.

A further limitation concerns analysis quality. The 2020 revisit of dist-EF-SGD showed that a widely cited convergence proof under arbitrary learning-rate schedules was mathematically invalid because the memory term scales with \(\eta_{t-1}/\eta_t\). The corrected theorem makes the error bound explicitly depend on learning-rate history, recovering validity but not the original schedule-independent lemma [2003.04706].

Finally, the 2025 tight worst-case analysis of first-order methods with error feedback found that in the single-agent deterministic \(L\)-smooth \(\mu\)-strongly convex setting with a deterministic contractive compressor, EF and EF21 have exactly the same optimal worst-case rate and the same optimal stepsize, and both are strictly worse than compressed gradient descent. The conclusion is intentionally narrow, but it is decisive within that model: error feedback is not “compression for free” in every regime [2506.05271].

## 5. Beyond gradient uplink compression: quantization, preconditioners, and differential privacy

Outside distributed gradient communication, EF appears in several technically distinct roles. In quantization theory, a \(\Delta\Sigma\) modulator can be modeled as a static uniform quantizer with an EF filter \(R[z]\), giving
\[
v=x+R[z]w,\qquad \epsilon=P[z]R[z]w.
\]
The 2016 rate-distortion analysis showed that the optimal EF-filter amplitude has the one-parameter form
\[
r_{\mathrm{opt}}(\omega)=\frac{\theta(\alpha_{\mathrm{opt}})}{\sqrt{p^2(\omega)+\alpha_{\mathrm{opt}}}},
\]
with
\[
D(\nu,\lambda)=D(\nu^\lambda,1),
\]
so the achievable MSE decays as \(O(\nu^{-\lambda})\). In this setting EF is a noise-shaping device rather than an optimizer correction mechanism [1609.01383].

In second-order optimization, EF can be applied to the internal state of a preconditioner rather than to communicated gradients. EFCP compresses the gradient history fed into full-matrix preconditioners such as M-FAC and GGT through
\[
a_t=\xi_{t-1}+g_t,\qquad c_t=\mathrm{Compress}(a_t),\qquad \xi_t=a_t-c_t,
\]
and then builds the preconditioner from the compressed history \(c_t\). The empirical claim is strong: full-matrix preconditioners can be compressed to up to \(99\%\) sparsity without accuracy loss, with one to two orders of magnitude memory savings in practice. The paper is equally clear that it does not prove a new convergence theorem for compressed full-matrix M-FAC or GGT [2306.06098].

In differentially private optimization, DiceSGD uses clipped EF to remove the constant clipping bias of DPSGD-GC. Its update direction is
\[
v^t=\frac1B\sum_{i\in\mathcal B^t}\operatorname{clip}(\nabla f(x^t;\xi_i),C_1)+\operatorname{clip}(e^t,C_2),
\]
followed by
\[
x^{t+1}=x^t-\eta^t(v^t+w^t),\qquad
e^{t+1}=e^t+\frac1B\sum_{i\in\mathcal B^t}\nabla f(x^t;\xi_i)-v^t.
\]
The fixed-point argument shows that, unlike standard clipped DP-SGD, DiceSGD does not shift the stationary condition to the clipped-gradient field. The accompanying Rényi-DP analysis is algorithm-specific because the residual is a hidden, nonprivatized state [2311.14632].

## 6. Federated learning, constraints, and recent residual refinements

Recent work has pushed EF into explicitly federated regimes with local steps, heterogeneity, and partial participation. Safe-EF addresses nonsmooth constrained convex optimization with global constraint
\[
g(x)=\frac1n\sum_{i=1}^n g_i(x)\le 0
\]
by switching between objective and constraint subgradients according to whether \(g(x^t)\le c\), while still using an EF14-style residual:
\[
v_i^t=C_i(e_i^t+h_i^t),\qquad e_i^{t+1}=e_i^t+h_i^t-v_i^t.
\]
Its virtual iterate
\[
\hat x^t=w^t-\gamma e^t
\]
satisfies
\[
\hat x^{t+1}=\hat x^t-\gamma h^t.
\]
The resulting deterministic bidirectional-compression guarantee is
\[
\mathbb E[f(\bar x^T)-f(x^*)],\ \mathbb E[g(\bar x^T)]
\le \mathcal O\!\left(\frac{RM}{\sqrt{\delta_s\delta\,T}}\right),
\]
and the unidirectional rate matches the paper’s lower bound up to constants [2505.06053].

A 2026 refinement, SA-PEF, modifies EF for non-IID federated learning with local SGD and biased uplink compression by introducing step-ahead partial error feedback. Client \(k\) first previews a fraction \(\alpha_r\) of its residual through
\[
w_{r+\frac12,0}^{(k)}=w_r^{(k)}-\alpha_r e_r^{(k)},
\]
then performs local SGD, and finally compresses
\[
u_{r+1}^{(k)}=(1-\alpha_r)e_r^{(k)}+g_r^{(k)}.
\]
The method recovers EF when \(\alpha_r=0\) and step-ahead EF when \(\alpha_r=1\). Its defining theoretical quantity is the residual contraction factor
\[
\rho_r=\Bigl(1-\frac1\delta\Bigr)\Bigl(2(1-\alpha_r)^2+24\alpha_r^2(\eta_rLT)^2\Bigr),
\]
which is strictly smaller than the EF baseline \(2(1-1/\delta)\) for
\[
\alpha_r\in\Bigl(0,\frac{1}{1+12(\eta_rLT)^2}\Bigr),
\]
with optimum
\[
\alpha_r^\star=\frac{1}{1+12(\eta_rLT)^2}.
\]
The nonconvex convergence rate matches standard Fed-SGD up to constant factors, while the smaller \(\rho_r\) explains the empirically faster early training phase relative to EF [2601.20738].

Taken together, these works establish a general pattern. EF remains a central tool for biased compression, but its useful form is regime-dependent. Classical residual EF is robust in some nonsmooth constrained settings; gradient-tracking EF21 is powerful in smooth problems and admits many extensions; dual-averaging or safe-switching variants become necessary once proximal structure or safety constraints enter; and recent federated refinements modify the residual pathway itself to improve transient behavior under non-IID local training. In current literature, the most precise summary is therefore not that EF is universally optimal, but that EF is a residual-correction design principle whose success depends on matching the error pathway to the geometry of the optimization problem.

Source: https://www.emergentmind.com/topics/error-feedback-ef