Averaged Operators: Theory and Applications
- Averaged operators are mappings defined as T=(1-α)I+αN with α in (0,1) that lie between the identity and nonexpansive maps, ensuring Fejér monotonicity and convergence.
- They are central to fixed-point algorithms and splitting methods by providing exact moduli, sharp residual estimates, and versatile application in proximal and projection methods.
- Their framework extends to variable-metric methods, algebraic averaging in groups and Hopf algebras, and harmonic analysis, unifying diverse areas of research.
In Hilbert-space fixed-point theory, an averaged operator is a mapping of the form
where is nonexpansive. This representation places averaged operators strictly between the identity and general nonexpansive mappings, with firmly nonexpansive operators appearing as the special case . The class organizes metric projections, resolvents, proximal mappings, gradient steps, and many splitting operators, and it has become a common language for convergence theory, exact composition constants, and structural generalizations in optimization, metric geometry, and algebra (Simonetto, 2017, Huang et al., 2019, Berdellima, 2020, Zhang et al., 2024).
1. Core definition and basic inequalities
A mapping or, more generally, on a real Hilbert space is nonexpansive if
It is -averaged if there exists a nonexpansive operator such that
This implies that is nonexpansive and that 0 and 1 share the same fixed points (Simonetto, 2017).
A standard characterization is the inequality
2
valid for all 3. If 4, this specializes to
5
These inequalities yield Fejér monotonicity and the standard residual estimate
6
for the fixed-point iteration 7 when 8 (Huang et al., 2019).
Firmly nonexpansive operators coincide with the case 9. Resolvents of maximal monotone operators and proximal mappings are firmly nonexpansive; this is the main reason averaged-operator theory interacts so closely with monotone operator splitting and proximal algorithms (Simonetto, 2017).
2. Composition laws, modulus of averagedness, and exact constants
A central problem is to quantify how averaged a given operator is. The Bauschke–Bendit–Moursi modulus of averagedness is the smallest 0 for which a nonexpansive operator is 1-averaged. Recent work shows that this modulus creates a sharp threshold at 2: if an operator is averaged with a constant less than 3, then it is a bi-Lipschitz homeomorphism, while for proximal mappings the condition 4 holds if and only if 5 is Lipschitz smooth (Song et al., 22 Jul 2025).
For compositions, the Ogura–Yamada coefficient plays a distinguished role. If 6 and 7 are 8- and 9-averaged, then 0 is 1-averaged with
2
Scaled relative graph methods show that this coefficient is tight for the composition class, and the same methodology yields a tight coefficient for Davis–Yin three-operator splitting (Huang et al., 2019).
Exact moduli are known for several basic operators. Song proved that for every nonempty closed convex set 3, the metric projection 4 satisfies 5, sharpening the classical statement that projections are merely firmly nonexpansive. The same work shows that 6 exactly for translations 7, and that noninjectivity forces 8 (Song, 2023). For orthogonal projections onto closed subspaces 9, the composition 0 has exact modulus
1
where 2 is the cosine of the Friedrichs angle; this improves the general 3 bound in finite-dimensional configurations and shows that the Ogura–Yamada bound is sharp in infinite-dimensional worst cases (Bauschke et al., 2023).
| Operator or class | Exact modulus / coefficient | Source |
|---|---|---|
| Projection 4, 5 | 6 | (Song, 2023) |
| Reflector 7 | 8 | (Song, 2023) |
| Composition 9 | 0 | (Huang et al., 2019) |
| 1 for subspaces | 2 | (Bauschke et al., 2023) |
These exact constants matter because the residual constant in fixed-point iteration is 3. Smaller averagedness coefficients therefore produce strictly sharper 4 residual bounds (Huang et al., 2019).
3. Fixed-point algorithms and convex optimization
Averaged operators sit at the center of modern first-order convex optimization because many algorithms can be written as fixed-point iterations of averaged maps. The Krasnosel’skiĭ–Mann scheme
5
reduces to the plain iteration 6 when 7 itself is already 8-averaged and 9. Forward–backward splitting, Douglas–Rachford splitting, and ADMM all fit this template (Giselsson et al., 2016).
For smooth 0 with 1-Lipschitz gradient and convex 2, forward–backward splitting
3
is 4-averaged with
5
Douglas–Rachford splitting has the form
6
with 7, and ADMM appears as Douglas–Rachford splitting on the dual (Giselsson et al., 2016).
This perspective extends directly to time-varying convex optimization. If 8 is a sequence of 9-averaged operators and 0 moves with bounded drift
1
then the running iteration
2
tracks the moving solution set. Under bounded operator images, the mean fixed-point residual satisfies
3
while contractive cases yield direct tracking-error bounds. Running projected gradient, proximal point, forward–backward splitting, Douglas–Rachford splitting, and running ADMM all fall under this framework (Simonetto, 2017).
Residual-based line search can be added without breaking the averaged-operator analysis. A general scheme chooses 4 along the residual direction 5 and accepts a trial step when
6
For nonexpansive 7, residual norms converge; if 8, then 9 and 0; if 1 is contractive, linear convergence follows (Giselsson et al., 2016).
4. Variable-metric, set-valued, and nonlinear-geometric generalizations
One major extension replaces scalar relaxation by a changing metric. In variable-metric algorithms driven by averaged operators, one works with a sequence 2 of self-adjoint strongly positive operators and studies compositions that are averaged with respect to the 3-norm. This yields a general variable-metric iteration with errors and relaxation, together with weak convergence and strong-convergence criteria, and it specializes to variable-metric forward–backward and primal–dual splitting (Glaudin, 2018).
A more explicit operator-valued replacement of scalar averaging is the notion of an 4-averaged operator:
5
where 6 is nonexpansive and 7 is a self-adjoint linear operator satisfying 8 with 9. Such maps are 0-averaged in the metric induced by 1, and the extended iteration
2
converges to a fixed point under a variable-metric Fejér condition. This formalism is used to analyze semismooth Newton and active-set methods for sparse convex optimization, as well as operator-averaged forward–backward and primal–dual schemes (Simões, 2021).
Set-valued variants arise through union averaged nonexpansive operators. Such an operator has the form
3
where each branch 4 is single-valued and averaged, and the selector 5 is outer semicontinuous. This class is closed under unions, convex combinations, and compositions. Around strong fixed points, Krasnosel’skiĭ–Mann-type iterations converge locally, and proximal mappings of min-convex functions are union 6-averaged. As a result, forward–backward and Douglas–Rachford methods extend to min-convex regularization and union-of-convex feasibility models (Dao et al., 2018).
Beyond Hilbert spaces, averagedness has been reformulated in CAT(0) geometry through 7-firmly nonexpansive operators defined with the discrepancy functional
8
The defining inequality is
9
This notion reproduces nonexpansiveness, admits composition and convex-combination rules, and yields weak convergence of Picard iterates for quasi 00-firmly nonexpansive maps. Cyclic and averaged projection algorithms in complete CAT(0) spaces are particular cases (Berdellima, 2020).
A further enlargement is the class of 01-conically nonexpansive operators, 02 with 03. In this setting averaged operators correspond to 04, and resolvents 05 of 06-comonotone operators satisfy
07
This connects averagedness, resolvents, cocoercivity, and proximal mappings for hypoconvex functions (Bauschke et al., 2019).
5. Algebraic averaging operators, groups, and Hopf algebras
A distinct algebraic usage of the term concerns operators satisfying multiplicative averaging identities rather than metric nonexpansiveness. In a commutative 08-algebra 09, an averaging operator is an 10-module endomorphism 11 such that
12
The image 13 is a subalgebra, 14, and 15 induces a Lie bracket
16
making 17 a solvable Lie algebra of derived length 18 (Cao, 2014).
Recent work extends averaging from associative and Lie algebras to groups and Hopf algebras. An averaging operator on a group 19 is a map 20 such that
21
If 22, then 23 is idempotent and satisfies the pointed identity
24
An averaging group induces a disemigroup via
25
and, when 26, a rack via
27
Smooth averaging Lie groups differentiate to averaging Lie algebras, and averaging operators on groups correspond exactly to averaging coalgebra maps on the group Hopf algebra 28 by linear extension (Zhang et al., 2024).
The same work defines averaging Hopf algebras by requiring a coalgebra map 29 to satisfy
30
It also constructs the free averaging group on a set 31 using a normal-form language of averaging words and an inductively defined multiplication and averaging operator with the universal property expected of a free object (Zhang et al., 2024).
These algebraic notions are motivated in part by Koszul duality: averaging operators are presented as Koszul-dual to weight-zero Rota–Baxter operators across associative and Lie settings, and the group/Hopf constructions are designed to preserve that duality pattern (Zhang et al., 2024).
6. Harmonic-analytic and operator-theoretic uses of averaging
In noncommutative harmonic analysis, “differential transforms attached to averaging operators” compare two averaging mechanisms at each scale. On 32, with Hardy–Littlewood averages 33 and dyadic conditional expectations 34, the operators
35
satisfy endpoint and strong-type bounds:
36
and hence
37
Here the “differentiation” is discrete in scale rather than generated by a continuous derivation (Xu, 2021).
A different line of work studies operators obtained by averaging a family 38. Because 39 is not a Banach space, weak-type 40 bounds do not automatically pass to sums or averages. Under uniform weighted endpoint estimates
41
with control through 42, the averaged operator 43 or 44 retains essentially the same weighted weak-type behavior for all 45 weights, up to a logarithmic factor in the 46 characteristic (Baena-Miret et al., 2023).
In scattering theory on singular spectra, averaged wave operators are formed by Cesàro or Abel–Poisson means of
47
For singular unitary operators 48 and bounded 49, if 50, then the weak limit of the difference of the averaged past and future wave operators is zero; consequently, the averaged past and future wave operators either both exist or both fail to exist, and if they exist, they coincide (Bessonov, 2011).
Across these settings, averaged operators appear in two complementary roles. In fixed-point theory they are structural contractions built from nonexpansive maps; in algebra and analysis they are frequently literal averages over symmetries, scales, or operator families. The common thread is that averaging creates additional rigidity—quantitative in optimization, categorical in algebra, and regularizing in harmonic and spectral analysis.