Extended Centralized Circumcentered Reflection (ecCRM)
- Extended Centralized Circumcentered Reflection Method (ecCRM) is an accelerated feasibility algorithm framework that unifies and extends classical projection–reflection schemes using a modular centralization operator.
- It incorporates a tunable kernel operator and relaxation parameter to balance per-iteration complexity with convergence dynamics, achieving both linear and superlinear rates under appropriate conditions.
- Its versatility is proven in high-dimensional convex settings like matrix completion and image reconstruction, reducing iterations and runtime compared to traditional methods.
The Extended Centralized Circumcentered Reflection Method (ecCRM) is a general framework for accelerated feasibility algorithms in convex and affine settings that unifies and extends several earlier projection–reflection schemes. It replaces the fixed centralization step of the classical centralized CRM (cCRM) with a modular centralization operator and a relaxation parameter, providing tunable control over per-iteration complexity and convergence dynamics. EcCRM retains global convergence, achieves linear rates under error bound regularity, and under smoothness or vanishing step sizes exhibits provably superlinear acceleration. The method's versatility and performance are demonstrated both theoretically and through extensive large-scale numerical experimentation (Barros, 5 Dec 2025).
1. Mathematical Foundation and Problem Setting
EcCRM operates primarily on two-set convex feasibility problems: Classical projection–reflection schemes such as alternating projections, Douglas–Rachford, and Cimmino are generally limited to linear convergence under regularity assumptions. The circumentered-reflection method (CRM) improved this by achieving superlinear convergence in certain cases, specifically under smooth boundary conditions.
The generalization to ecCRM introduces an admissible centralization operator (with and for all ), and a relaxation parameter : The ecCRM update step is then defined as: where , , and .
Common choices for include:
- (three projections per step)
- (four projections, coinciding with cCRM)
- (five projections, "deep" kernel)
This modularity enables trade-offs between contraction strength and computational expense per iteration (Barros, 5 Dec 2025).
2. Algorithmic Structure and Implementation
A typical iteration of ecCRM consists of:
- Application of the kernel to the current iterate.
- Projection onto from .
- Formation of a centralized point via convex combination governed by .
- Projection/reflection onto and .
- Circumcenter computation for the three points derived above.
ecCRM Pseudocode (Two-set Case)
1 2 3 4 5 6 7 8 9 10 11 12 |
z = z0 k = 0 while max(dist(z, X), dist(z, Y)) > eps: t = T(z) x = P_X(t) w = alpha_k * t + (1 - alpha_k) * x u = P_Y(w) v = x z_new = circumcenter(w, 2*v - w, 2*u - w) z = z_new k += 1 return z |
Extensions exist for multi-set feasibility problems, firm nonexpansive operator intersections, and affine subspace contexts, adapting the centralization and circumcenter computation accordingly (Behling et al., 2017, Arefidamghani et al., 2022, Bauschke et al., 2019).
3. Convergence Theory
Global Convergence
Assuming , the ecCRM sequence is Fejér monotone with respect to and converges to a point in for any admissible and any sequence . The algorithm does not require strict regularity or Slater-type assumptions for convergence (Barros, 5 Dec 2025).
Linear Convergence Rate
Suppose a local error bound holds in the form
For , ecCRM achieves Q-linear convergence with rate
and the improvement in each step is quantified: This holds for convex sets, finite intersections of affine subspaces, and products of firmly nonexpansive operators (Arefidamghani et al., 2022, Behling et al., 2017).
Superlinear Convergence
If and are -smooth and intersect transversally, and either every centralized point is strictly centralized or , ecCRM achieves superlinear convergence: as . A vanishing schedule ensures superlinearity even if strict centralization fails (Barros, 5 Dec 2025, Behling et al., 2022).
4. Centralization, Kernel Choice, and Step Size Effects
Selecting the kernel and relaxation parameter determines the balance:
- "Deeper" kernels ( involves more projections/reflections) yield stronger contractions and accelerate convergence, at higher computational cost.
- Shallower kernels (e.g., ) achieve cheaper steps but slower shrinkage of the feasibility gap per iteration.
- Fixed typically balances centralization and step length.
- Smaller increases centralization, supporting superlinear convergence but may reduce movement per iteration.
- Vanishing schedules accelerate convergence in nearly tangent or smooth manifold settings (Barros, 5 Dec 2025, Behling et al., 2022).
5. Applications and Comparative Numerical Performance
EcCRM is applicable wherever two-set feasibility or intersection problems appear:
- Matrix and tensor completion (e.g., PSD completion, rank constraints)
- Image reconstruction
- Signal recovery
- Intersection of high-dimensional geometric sets (ellipsoids, subspaces)
- Fixed-point problems for firmly nonexpansive operators
- Primal–dual and ADMM-type splitting in optimization contexts (Barros, 5 Dec 2025, Lindstrom, 2020, Arefidamghani et al., 2022)
In matrix completion with and rank 5:
- Deep kernel ecCRM () at reduced total runtime and iteration count by roughly 9% compared to cCRM, despite extra projections.
In intersections of high-dimensional ellipsoids :
- Vanishing step sizes in ecCRM reduced iterations by 15% and runtime by 20% versus fixed- cCRM at tight tolerances ().
Tests on random intersections of multiple sets demonstrated ecCRM can use orders of magnitude fewer projections than sequential or product-space methods, with efficiency gains increasing in higher dimensions and larger set cardinalities (Behling et al., 2022, Arefidamghani et al., 2022).
6. Relationship to Prior and Alternative Feasibility Schemes
EcCRM strictly generalizes cCRM and is compatible with various operator contexts, including affine isometries (Bauschke et al., 2019), convex combinations of projections, classical alternated projections (MAP), Douglas–Rachford, and even primal–dual schemes via iterated operator application (Barros, 5 Dec 2025, Lindstrom, 2020).
The circumcenter operator provides the closest point to the intersection among affine combinations of reflection trajectories, yielding contraction factors that can match or improve upon those for classical methods. The centralization operator—either as a fixed projection or via kernel composition—suppresses zig-zagging and accelerates convergence in practice.
EcCRM inherits or improves upon the convergence rate of the underlying kernel, and its modular structure allows practitioners to tune projections and contractions to computational resources and problem geometry. Convex combinations and centralization steps are shown formally to preserve nonexpansiveness and monotonicity required for convergence (Arefidamghani et al., 2022).
7. Summary Table: Key Algorithmic and Theoretical Elements
| Component | ecCRM Feature | Implications |
|---|---|---|
| Centralization | Modular operator and parameter | Tunable contraction/cost |
| Kernel choices | Depth–rate trade-off | |
| Convergence | Global (Fejér monotonicity), linear (error bound), superlinear (smoothness/vanishing ) | Robust across regimes |
| Complexity | projections, 2 reflections, one circ per iteration | Scalable |
| Applicability | Convex/affine sets, fixed-point problems, primal–dual | Versatile algorithm |
The extended centralized circumcentered reflection method constitutes a modular, accelerated baseline for projection–reflection schemes applicable to a variety of feasibility, fixed-point, and optimization problems. Its analysis unifies and extends earlier convergence guarantees and demonstrates robust empirical efficacy on high-dimensional and large-scale instances (Barros, 5 Dec 2025, Behling et al., 2017, Arefidamghani et al., 2022, Behling et al., 2022).