Papers
Topics
Authors
Recent
Search
2000 character limit reached

Averaged Operators: Theory and Applications

Updated 5 July 2026
  • Averaged operators are mappings defined as T=(1-α)I+αN with α in (0,1) that lie between the identity and nonexpansive maps, ensuring Fejér monotonicity and convergence.
  • They are central to fixed-point algorithms and splitting methods by providing exact moduli, sharp residual estimates, and versatile application in proximal and projection methods.
  • Their framework extends to variable-metric methods, algebraic averaging in groups and Hopf algebras, and harmonic analysis, unifying diverse areas of research.

In Hilbert-space fixed-point theory, an averaged operator is a mapping of the form

T=(1α)I+αN,α(0,1),T=(1-\alpha)I+\alpha N,\qquad \alpha\in(0,1),

where NN is nonexpansive. This representation places averaged operators strictly between the identity and general nonexpansive mappings, with firmly nonexpansive operators appearing as the special case α=1/2\alpha=1/2. The class organizes metric projections, resolvents, proximal mappings, gradient steps, and many splitting operators, and it has become a common language for convergence theory, exact composition constants, and structural generalizations in optimization, metric geometry, and algebra (Simonetto, 2017, Huang et al., 2019, Berdellima, 2020, Zhang et al., 2024).

1. Core definition and basic inequalities

A mapping T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n or, more generally, T:HHT:H\to H on a real Hilbert space is nonexpansive if

T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.

It is α\alpha-averaged if there exists a nonexpansive operator GG such that

T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).

This implies that TT is nonexpansive and that NN0 and NN1 share the same fixed points (Simonetto, 2017).

A standard characterization is the inequality

NN2

valid for all NN3. If NN4, this specializes to

NN5

These inequalities yield Fejér monotonicity and the standard residual estimate

NN6

for the fixed-point iteration NN7 when NN8 (Huang et al., 2019).

Firmly nonexpansive operators coincide with the case NN9. Resolvents of maximal monotone operators and proximal mappings are firmly nonexpansive; this is the main reason averaged-operator theory interacts so closely with monotone operator splitting and proximal algorithms (Simonetto, 2017).

2. Composition laws, modulus of averagedness, and exact constants

A central problem is to quantify how averaged a given operator is. The Bauschke–Bendit–Moursi modulus of averagedness is the smallest α=1/2\alpha=1/20 for which a nonexpansive operator is α=1/2\alpha=1/21-averaged. Recent work shows that this modulus creates a sharp threshold at α=1/2\alpha=1/22: if an operator is averaged with a constant less than α=1/2\alpha=1/23, then it is a bi-Lipschitz homeomorphism, while for proximal mappings the condition α=1/2\alpha=1/24 holds if and only if α=1/2\alpha=1/25 is Lipschitz smooth (Song et al., 22 Jul 2025).

For compositions, the Ogura–Yamada coefficient plays a distinguished role. If α=1/2\alpha=1/26 and α=1/2\alpha=1/27 are α=1/2\alpha=1/28- and α=1/2\alpha=1/29-averaged, then T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n0 is T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n1-averaged with

T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n2

Scaled relative graph methods show that this coefficient is tight for the composition class, and the same methodology yields a tight coefficient for Davis–Yin three-operator splitting (Huang et al., 2019).

Exact moduli are known for several basic operators. Song proved that for every nonempty closed convex set T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n3, the metric projection T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n4 satisfies T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n5, sharpening the classical statement that projections are merely firmly nonexpansive. The same work shows that T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n6 exactly for translations T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n7, and that noninjectivity forces T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n8 (Song, 2023). For orthogonal projections onto closed subspaces T:RnRnT:\mathbb{R}^n\to\mathbb{R}^n9, the composition T:HHT:H\to H0 has exact modulus

T:HHT:H\to H1

where T:HHT:H\to H2 is the cosine of the Friedrichs angle; this improves the general T:HHT:H\to H3 bound in finite-dimensional configurations and shows that the Ogura–Yamada bound is sharp in infinite-dimensional worst cases (Bauschke et al., 2023).

Operator or class Exact modulus / coefficient Source
Projection T:HHT:H\to H4, T:HHT:H\to H5 T:HHT:H\to H6 (Song, 2023)
Reflector T:HHT:H\to H7 T:HHT:H\to H8 (Song, 2023)
Composition T:HHT:H\to H9 T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.0 (Huang et al., 2019)
T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.1 for subspaces T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.2 (Bauschke et al., 2023)

These exact constants matter because the residual constant in fixed-point iteration is T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.3. Smaller averagedness coefficients therefore produce strictly sharper T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.4 residual bounds (Huang et al., 2019).

3. Fixed-point algorithms and convex optimization

Averaged operators sit at the center of modern first-order convex optimization because many algorithms can be written as fixed-point iterations of averaged maps. The Krasnosel’skiĭ–Mann scheme

T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.5

reduces to the plain iteration T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.6 when T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.7 itself is already T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.8-averaged and T(x)T(y)xy,x,y.\|T(x)-T(y)\|\le \|x-y\|,\qquad \forall x,y.9. Forward–backward splitting, Douglas–Rachford splitting, and ADMM all fit this template (Giselsson et al., 2016).

For smooth α\alpha0 with α\alpha1-Lipschitz gradient and convex α\alpha2, forward–backward splitting

α\alpha3

is α\alpha4-averaged with

α\alpha5

Douglas–Rachford splitting has the form

α\alpha6

with α\alpha7, and ADMM appears as Douglas–Rachford splitting on the dual (Giselsson et al., 2016).

This perspective extends directly to time-varying convex optimization. If α\alpha8 is a sequence of α\alpha9-averaged operators and GG0 moves with bounded drift

GG1

then the running iteration

GG2

tracks the moving solution set. Under bounded operator images, the mean fixed-point residual satisfies

GG3

while contractive cases yield direct tracking-error bounds. Running projected gradient, proximal point, forward–backward splitting, Douglas–Rachford splitting, and running ADMM all fall under this framework (Simonetto, 2017).

Residual-based line search can be added without breaking the averaged-operator analysis. A general scheme chooses GG4 along the residual direction GG5 and accepts a trial step when

GG6

For nonexpansive GG7, residual norms converge; if GG8, then GG9 and T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).0; if T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).1 is contractive, linear convergence follows (Giselsson et al., 2016).

4. Variable-metric, set-valued, and nonlinear-geometric generalizations

One major extension replaces scalar relaxation by a changing metric. In variable-metric algorithms driven by averaged operators, one works with a sequence T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).2 of self-adjoint strongly positive operators and studies compositions that are averaged with respect to the T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).3-norm. This yields a general variable-metric iteration with errors and relaxation, together with weak convergence and strong-convergence criteria, and it specializes to variable-metric forward–backward and primal–dual splitting (Glaudin, 2018).

A more explicit operator-valued replacement of scalar averaging is the notion of an T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).4-averaged operator:

T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).5

where T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).6 is nonexpansive and T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).7 is a self-adjoint linear operator satisfying T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).8 with T=(1α)I+αG,α(0,1).T=(1-\alpha)I+\alpha G,\qquad \alpha\in(0,1).9. Such maps are TT0-averaged in the metric induced by TT1, and the extended iteration

TT2

converges to a fixed point under a variable-metric Fejér condition. This formalism is used to analyze semismooth Newton and active-set methods for sparse convex optimization, as well as operator-averaged forward–backward and primal–dual schemes (Simões, 2021).

Set-valued variants arise through union averaged nonexpansive operators. Such an operator has the form

TT3

where each branch TT4 is single-valued and averaged, and the selector TT5 is outer semicontinuous. This class is closed under unions, convex combinations, and compositions. Around strong fixed points, Krasnosel’skiĭ–Mann-type iterations converge locally, and proximal mappings of min-convex functions are union TT6-averaged. As a result, forward–backward and Douglas–Rachford methods extend to min-convex regularization and union-of-convex feasibility models (Dao et al., 2018).

Beyond Hilbert spaces, averagedness has been reformulated in CAT(0) geometry through TT7-firmly nonexpansive operators defined with the discrepancy functional

TT8

The defining inequality is

TT9

This notion reproduces nonexpansiveness, admits composition and convex-combination rules, and yields weak convergence of Picard iterates for quasi NN00-firmly nonexpansive maps. Cyclic and averaged projection algorithms in complete CAT(0) spaces are particular cases (Berdellima, 2020).

A further enlargement is the class of NN01-conically nonexpansive operators, NN02 with NN03. In this setting averaged operators correspond to NN04, and resolvents NN05 of NN06-comonotone operators satisfy

NN07

This connects averagedness, resolvents, cocoercivity, and proximal mappings for hypoconvex functions (Bauschke et al., 2019).

5. Algebraic averaging operators, groups, and Hopf algebras

A distinct algebraic usage of the term concerns operators satisfying multiplicative averaging identities rather than metric nonexpansiveness. In a commutative NN08-algebra NN09, an averaging operator is an NN10-module endomorphism NN11 such that

NN12

The image NN13 is a subalgebra, NN14, and NN15 induces a Lie bracket

NN16

making NN17 a solvable Lie algebra of derived length NN18 (Cao, 2014).

Recent work extends averaging from associative and Lie algebras to groups and Hopf algebras. An averaging operator on a group NN19 is a map NN20 such that

NN21

If NN22, then NN23 is idempotent and satisfies the pointed identity

NN24

An averaging group induces a disemigroup via

NN25

and, when NN26, a rack via

NN27

Smooth averaging Lie groups differentiate to averaging Lie algebras, and averaging operators on groups correspond exactly to averaging coalgebra maps on the group Hopf algebra NN28 by linear extension (Zhang et al., 2024).

The same work defines averaging Hopf algebras by requiring a coalgebra map NN29 to satisfy

NN30

It also constructs the free averaging group on a set NN31 using a normal-form language of averaging words and an inductively defined multiplication and averaging operator with the universal property expected of a free object (Zhang et al., 2024).

These algebraic notions are motivated in part by Koszul duality: averaging operators are presented as Koszul-dual to weight-zero Rota–Baxter operators across associative and Lie settings, and the group/Hopf constructions are designed to preserve that duality pattern (Zhang et al., 2024).

6. Harmonic-analytic and operator-theoretic uses of averaging

In noncommutative harmonic analysis, “differential transforms attached to averaging operators” compare two averaging mechanisms at each scale. On NN32, with Hardy–Littlewood averages NN33 and dyadic conditional expectations NN34, the operators

NN35

satisfy endpoint and strong-type bounds:

NN36

and hence

NN37

Here the “differentiation” is discrete in scale rather than generated by a continuous derivation (Xu, 2021).

A different line of work studies operators obtained by averaging a family NN38. Because NN39 is not a Banach space, weak-type NN40 bounds do not automatically pass to sums or averages. Under uniform weighted endpoint estimates

NN41

with control through NN42, the averaged operator NN43 or NN44 retains essentially the same weighted weak-type behavior for all NN45 weights, up to a logarithmic factor in the NN46 characteristic (Baena-Miret et al., 2023).

In scattering theory on singular spectra, averaged wave operators are formed by Cesàro or Abel–Poisson means of

NN47

For singular unitary operators NN48 and bounded NN49, if NN50, then the weak limit of the difference of the averaged past and future wave operators is zero; consequently, the averaged past and future wave operators either both exist or both fail to exist, and if they exist, they coincide (Bessonov, 2011).

Across these settings, averaged operators appear in two complementary roles. In fixed-point theory they are structural contractions built from nonexpansive maps; in algebra and analysis they are frequently literal averages over symmetries, scales, or operator families. The common thread is that averaging creates additional rigidity—quantitative in optimization, categorical in algebra, and regularizing in harmonic and spectral analysis.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Averaged Operators.