---
title: 'Averaged Operators: Theory and Applications'
url: https://www.emergentmind.com/topics/averaged-operators
type: topic
---

# Averaged Operators: Theory and Applications

In Hilbert-space fixed-point theory, an averaged operator is a mapping of the form
$$
T=(1-\alpha)I+\alpha N,\qquad \alpha\in(0,1),
$$
where \(N\) is nonexpansive. This representation places averaged operators strictly between the identity and general nonexpansive mappings, with firmly nonexpansive operators appearing as the special case \(\alpha=1/2\). The class organizes metric projections, resolvents, proximal mappings, gradient steps, and many splitting operators, and it has become a common language for convergence theory, exact composition constants, and structural generalizations in optimization, metric geometry, and algebra [1704.07338][1912.01593][2010.05726][2412.11600].

## 1. Core definition and basic inequalities

A mapping \(T:\mathbb{R}^n\to\mathbb{R}^n\) or, more generally, \(T:H\to H\) on a real Hilbert space is nonexpansive if
$$
\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.
$$
It is \(\alpha\)-averaged if there exists a nonexpansive operator \(G\) such that
$$
T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).
$$
This implies that \(T\) is nonexpansive and that \(T\) and \(G\) share the same fixed points [1704.07338].

A standard characterization is the inequality
$$
\|Tx-Ty\|^2 \le \|x-y\|^2-\frac{1-\alpha}{\alpha}\,\|(I-T)x-(I-T)y\|^2,
$$
valid for all \(x,y\). If \(y\in\operatorname{Fix}(T)\), this specializes to
$$
\|Tx-y\|^2 \le \|x-y\|^2-\frac{1-\alpha}{\alpha}\,\|(I-T)x\|^2.
$$
These inequalities yield Fejér monotonicity and the standard residual estimate
$$
\frac{1}{K}\sum_{k=0}^{K-1}\|(I-T)x^k\|^2 \le \frac{\alpha}{1-\alpha}\cdot \frac{\|x^0-x^\star\|^2}{K},
$$
for the fixed-point iteration \(x^{k+1}=Tx^k\) when \(x^\star\in\operatorname{Fix}(T)\) [1912.01593].

Firmly nonexpansive operators coincide with the case \(\alpha=1/2\). Resolvents of maximal monotone operators and proximal mappings are firmly nonexpansive; this is the main reason averaged-operator theory interacts so closely with monotone operator splitting and proximal algorithms [1704.07338].

## 2. Composition laws, modulus of averagedness, and exact constants

A central problem is to quantify how averaged a given operator is. The Bauschke–Bendit–Moursi modulus of averagedness is the smallest \(\alpha\) for which a nonexpansive operator is \(\alpha\)-averaged. Recent work shows that this modulus creates a sharp threshold at \(1/2\): if an operator is averaged with a constant less than \(1/2\), then it is a bi-Lipschitz homeomorphism, while for proximal mappings the condition \(\mu(\operatorname{prox}_f)<1/2\) holds if and only if \(f\) is Lipschitz smooth [2507.19533].

For compositions, the Ogura–Yamada coefficient plays a distinguished role. If \(T_1\) and \(T_2\) are \(\alpha_1\)- and \(\alpha_2\)-averaged, then \(T_1T_2\) is \(\alpha\)-averaged with
$$
\alpha=\frac{\alpha_1+\alpha_2-2\alpha_1\alpha_2}{1-\alpha_1\alpha_2}.
$$
Scaled relative graph methods show that this coefficient is tight for the composition class, and the same methodology yields a tight coefficient for Davis–Yin three-operator splitting [1912.01593].

Exact moduli are known for several basic operators. Song proved that for every nonempty closed convex set \(C\neq X\), the metric projection \(P_C\) satisfies \(K(P_C)=1/2\), sharpening the classical statement that projections are merely firmly nonexpansive. The same work shows that \(K(T)=0\) exactly for translations \(T=\operatorname{Id}+v\), and that noninjectivity forces \(K(T)\ge 1/2\) [2312.15421]. For orthogonal projections onto closed subspaces \(U,V\), the composition \(P_VP_U\) has exact modulus
$$
\mathcal{K}(P_VP_U)=\frac{2-c_F^2+c_F}{4-c_F^2},
$$
where \(c_F(U,V)\) is the cosine of the Friedrichs angle; this improves the general \(\frac23\) bound in finite-dimensional configurations and shows that the Ogura–Yamada bound is sharp in infinite-dimensional worst cases [2303.13738].

| Operator or class | Exact modulus / coefficient | Source |
|---|---:|---|
| Projection \(P_C\), \(C\neq X\) | \(K(P_C)=1/2\) | [2312.15421] |
| Reflector \(R_C=2P_C-\operatorname{Id}\) | \(K(R_C)=1\) | [2312.15421] |
| Composition \(T_1T_2\) | \(\frac{\alpha_1+\alpha_2-2\alpha_1\alpha_2}{1-\alpha_1\alpha_2}\) | [1912.01593] |
| \(P_VP_U\) for subspaces | \(\frac{2-c_F^2+c_F}{4-c_F^2}\) | [2303.13738] |

These exact constants matter because the residual constant in fixed-point iteration is \(\alpha/(1-\alpha)\). Smaller averagedness coefficients therefore produce strictly sharper \(O(1/k)\) residual bounds [1912.01593].

## 3. Fixed-point algorithms and convex optimization

Averaged operators sit at the center of modern first-order convex optimization because many algorithms can be written as fixed-point iterations of averaged maps. The Krasnosel’skiĭ–Mann scheme
$$
x_{k+1}=x_k+\lambda_k\big(T(x_k)-x_k\big)
$$
reduces to the plain iteration \(x_{k+1}=T(x_k)\) when \(T\) itself is already \(\alpha\)-averaged and \(\lambda_k=1\). Forward–backward splitting, Douglas–Rachford splitting, and ADMM all fit this template [1603.06772].

For smooth \(f\) with \(L\)-Lipschitz gradient and convex \(g\), forward–backward splitting
$$
x_{k+1}=\operatorname{prox}_{\gamma g}\big(x_k-\gamma \nabla f(x_k)\big)
$$
is \(\alpha\)-averaged with
$$
\alpha=\frac{2}{4-\gamma L},\qquad \gamma\in(0,2/L).
$$
Douglas–Rachford splitting has the form
$$
z_{k+1}=\big((1-\alpha)I+\alpha\,R_{\gamma g}R_{\gamma f}\big)z_k,
$$
with \(R_{\gamma h}=2\,\operatorname{prox}_{\gamma h}-I\), and ADMM appears as Douglas–Rachford splitting on the dual [1603.06772].

This perspective extends directly to time-varying convex optimization. If \(T_k\) is a sequence of \(\alpha_k\)-averaged operators and \(x_k^\star\in\operatorname{Fix}(T_k)\) moves with bounded drift
$$
\|x_\tau^\star-x_{\tau-1}^\star\|\le \delta,
$$
then the running iteration
$$
x_{k+1}=T_k(x_k)
$$
tracks the moving solution set. Under bounded operator images, the mean fixed-point residual satisfies
$$
\frac{1}{T}\sum_{k=1}^T \frac{1-\alpha_k}{\alpha_k}\,\|T_k(x_k)-x_k\|^2
\le \frac{\|x_1-x_1^\star\|^2}{T}+\delta(4X+\delta),
$$
while contractive cases yield direct tracking-error bounds. Running projected gradient, proximal point, forward–backward splitting, Douglas–Rachford splitting, and running ADMM all fall under this framework [1704.07338].

Residual-based line search can be added without breaking the averaged-operator analysis. A general scheme chooses \(\alpha_k\ge \alpha\) along the residual direction \(r(x)=S(x)-x\) and accepts a trial step when
$$
\|S(x^k+\alpha_k r^k)-(x^k+\alpha_k r^k)\|
\le (1-\varepsilon)\,\|\bar r^k\|.
$$
For nonexpansive \(S\), residual norms converge; if \(\operatorname{Fix}(S)\neq\varnothing\), then \(r^k\to0\) and \(x^{k+1}-x^k\to0\); if \(S\) is contractive, linear convergence follows [1603.06772].

## 4. Variable-metric, set-valued, and nonlinear-geometric generalizations

One major extension replaces scalar relaxation by a changing metric. In variable-metric algorithms driven by averaged operators, one works with a sequence \(U_n\in P_\alpha(H)\) of self-adjoint strongly positive operators and studies compositions that are averaged with respect to the \(U_n^{-1}\)-norm. This yields a general variable-metric iteration with errors and relaxation, together with weak convergence and strong-convergence criteria, and it specializes to variable-metric forward–backward and primal–dual splitting [1807.04027].

A more explicit operator-valued replacement of scalar averaging is the notion of an \(A\)-averaged operator:
$$
T_A=(I-A)+AR,
$$
where \(R\) is nonexpansive and \(A\) is a self-adjoint linear operator satisfying \(M_{\mathrm{eig}}I\succeq A\succeq m_{\mathrm{eig}}I\) with \(M_{\mathrm{eig}},m_{\mathrm{eig}}\in[\varepsilon,1-\varepsilon]\). Such maps are \(M_{\mathrm{eig}}\)-averaged in the metric induced by \(A^{-1}\), and the extended iteration
$$
x^{k+1}=x^k+A^k(R(x^k)-x^k)
$$
converges to a fixed point under a variable-metric Fejér condition. This formalism is used to analyze semismooth Newton and active-set methods for sparse convex optimization, as well as operator-averaged forward–backward and primal–dual schemes [2112.03790].

Set-valued variants arise through union averaged nonexpansive operators. Such an operator has the form
$$
F(x)=\bigcup_{i\in I(x)} T_i(x),
$$
where each branch \(T_i\) is single-valued and averaged, and the selector \(x\mapsto I(x)\) is outer semicontinuous. This class is closed under unions, convex combinations, and compositions. Around strong fixed points, Krasnosel’skiĭ–Mann-type iterations converge locally, and proximal mappings of min-convex functions are union \(1/2\)-averaged. As a result, forward–backward and Douglas–Rachford methods extend to min-convex regularization and union-of-convex feasibility models [1807.05810].

Beyond Hilbert spaces, averagedness has been reformulated in CAT(0) geometry through \(\alpha\)-firmly nonexpansive operators defined with the discrepancy functional
$$
\Delta_T(x,y)=\langle \overrightarrow{xy},\overrightarrow{Tx\,Ty}\rangle.
$$
The defining inequality is
$$
d(Tx,Ty)^2+(1-2\alpha)d(x,y)^2\le 2(1-\alpha)\Delta_T(x,y).
$$
This notion reproduces nonexpansiveness, admits composition and convex-combination rules, and yields weak convergence of Picard iterates for quasi \(\alpha\)-firmly nonexpansive maps. Cyclic and averaged projection algorithms in complete CAT(0) spaces are particular cases [2010.05726].

A further enlargement is the class of \(\alpha\)-conically nonexpansive operators, \(T=(1-\alpha)\operatorname{Id}+\alpha N\) with \(\alpha\in(0,\infty)\). In this setting averaged operators correspond to \(\alpha\in(0,1)\), and resolvents \(J_A\) of \(p\)-comonotone operators satisfy
$$
\alpha=\frac{1}{2(p+1)}.
$$
This connects averagedness, resolvents, cocoercivity, and proximal mappings for hypoconvex functions [1902.09827].

## 5. Algebraic averaging operators, groups, and Hopf algebras

A distinct algebraic usage of the term concerns operators satisfying multiplicative averaging identities rather than metric nonexpansiveness. In a commutative \(R\)-algebra \(A\), an averaging operator is an \(R\)-module endomorphism \(f:A\to A\) such that
$$
f(xf(y))=f(x)f(y),\qquad \forall x,y\in A.
$$
The image \(f(A)\) is a subalgebra, \(f(A)\cdot \ker(f)\subseteq \ker(f)\), and \(f\) induces a Lie bracket
$$
[x,y]_f = x f(y)-y f(x),
$$
making \(A_f\) a solvable Lie algebra of derived length \(2\) [1401.7389].

Recent work extends averaging from associative and Lie algebras to groups and Hopf algebras. An averaging operator on a group \(G\) is a map \(A:G\to G\) such that
$$
A(g)A(h)=A(A(g)h)=A(gA(h)),\qquad \forall g,h\in G.
$$
If \(A(e)=e\), then \(A\) is idempotent and satisfies the pointed identity
$$
\operatorname{Ad}_{A(g)}A(h)=A(\operatorname{Ad}_{A(g)}h).
$$
An averaging group induces a disemigroup via
$$
g\diamond h=gA(h),\qquad g\triangleright h=A(g)h,
$$
and, when \(A(e)=e\), a rack via
$$
g\triangleright h=A(g)\,h\,A(g)^{-1}.
$$
Smooth averaging Lie groups differentiate to averaging Lie algebras, and averaging operators on groups correspond exactly to averaging coalgebra maps on the group Hopf algebra \(k[G]\) by linear extension [2412.11600].

The same work defines averaging Hopf algebras by requiring a coalgebra map \(A:H\to H\) to satisfy
$$
A(a)A(b)=A(A(a)b)=A(aA(b)),\qquad \forall a,b\in H.
$$
It also constructs the free averaging group on a set \(X\) using a normal-form language of averaging words and an inductively defined multiplication and averaging operator with the universal property expected of a free object [2412.11600].

These algebraic notions are motivated in part by Koszul duality: averaging operators are presented as Koszul-dual to weight-zero Rota–Baxter operators across associative and Lie settings, and the group/Hopf constructions are designed to preserve that duality pattern [2412.11600].

## 6. Harmonic-analytic and operator-theoretic uses of averaging

In noncommutative harmonic analysis, “differential transforms attached to averaging operators” compare two averaging mechanisms at each scale. On \(L_p(\mathcal N)\), with Hardy–Littlewood averages \(M_k\) and dyadic conditional expectations \(E_k\), the operators
$$
T f(x)=\sum_{k\in\mathbb Z} v_k (M_k-E_k)f(x),
\qquad
D f(x)=\sum_{k\in\mathbb Z} v_k (M_k-M_{k-1})f(x)
$$
satisfy endpoint and strong-type bounds:
$$
\|Tf\|_{L_{1,\infty}(\mathcal N)}\le C_d\|f\|_1,\qquad
\|Tf\|_{BMO_d(\mathcal N)}\le C_d\|f\|_\infty,
$$
and hence
$$
\|Tf\|_p\le C_{p,d}\|f\|_p,\qquad
\|Df\|_{1,\infty}\le C_d\|f\|_1,\qquad
\|Df\|_p\le C_{p,d}\|f\|_p.
$$
Here the “differentiation” is discrete in scale rather than generated by a continuous derivation [2104.08526].

A different line of work studies operators obtained by averaging a family \(\{T_\theta\}\). Because \(L^{1,\infty}\) is not a Banach space, weak-type \((1,1)\) bounds do not automatically pass to sums or averages. Under uniform weighted endpoint estimates
$$
T_j:L^1(u)\to L^{1,\infty}(u),\qquad \forall u\in A_1,
$$
with control through \(\varphi(\|u\|_{A_1})\), the averaged operator \(T=\sum_j T_j\) or \(T_A f=\int_\Omega T_\theta f\,dP(\theta)\) retains essentially the same weighted weak-type behavior for all \(A_1\) weights, up to a logarithmic factor in the \(A_1\) characteristic [2301.05201].

In scattering theory on singular spectra, averaged wave operators are formed by Cesàro or Abel–Poisson means of
$$
U_2^{-n}AU_1^n
\quad\text{and}\quad
U_2^nAU_1^{-n}.
$$
For singular unitary operators \(U_1,U_2\) and bounded \(A\), if \(\operatorname{rank}(AU_1-U_2A)\le 2\), then the weak limit of the difference of the averaged past and future wave operators is zero; consequently, the averaged past and future wave operators either both exist or both fail to exist, and if they exist, they coincide [1106.5203].

Across these settings, averaged operators appear in two complementary roles. In fixed-point theory they are structural contractions built from nonexpansive maps; in algebra and analysis they are frequently literal averages over symmetries, scales, or operator families. The common thread is that averaging creates additional rigidity—quantitative in optimization, categorical in algebra, and regularizing in harmonic and spectral analysis.

Source: https://www.emergentmind.com/topics/averaged-operators