Greedy-Threshold Methods: Theory & Applications

• Greedy-threshold methods are techniques that replace exact maximizers with adaptive threshold rules in greedy algorithms for approximation and optimization.
• They generalize classical approaches by incorporating parameters like τ, λ, or f(m) to control selection criteria and benchmark comparisons.
• These methods find applications in sparse recovery, nonlinear inverse problems, and decentralized control, balancing computational cost and performance.

Greedy-threshold denotes a family of constructions in which a greedy procedure is governed by a threshold condition rather than by an exact maximizer. In the classical Thresholding Greedy Algorithm (TGA), the threshold is implicit in the requirement that the selected coefficients are the largest in modulus; in weak and generalized variants, admissibility is relaxed by parameters such as $\tau$, $\lambda$, or a comparison function $f(m)$. In algorithmic settings outside Banach-space approximation, the same pattern appears when one accepts any atom, row, task, or candidate whose score exceeds a prescribed, adaptive, or capped threshold, and in some analyses the threshold instead marks a regime boundary below which a greedy policy is exactly optimal and above which it is not. This suggests a unifying view of greedy-threshold methods as threshold-controlled relaxations, generalizations, or phase-transition analyses of greediness (Berná et al., 2022, Berasategui et al., 2023, Yang et al., 2013, Xu et al., 2016, Wang et al., 2019).

1. Foundational definitions

In the approximation-theoretic literature, the basic object is a basis $\mathcal B=(e_n)_{n=1}^\infty$ with biorthogonal functionals $(e_n^*)$. For

$x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$

a finite set $A\subset\mathbb N$ of cardinality $m$ is called a greedy set when the selected coefficients dominate the unselected ones in modulus. One common formulation is

$$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$

and the associated greedy operator is

$G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$

Equivalent expositions use the non-strict relation $\lambda$0 together with a tie-breaking rule by natural ordering. The TGA is then the sequence $\lambda$1 obtained by repeatedly selecting the largest coefficients in modulus (Chu, 2022, Berná et al., 2022).

A first generalization introduces an explicit threshold parameter $\lambda$2. The $\lambda$3-Thresholding Greedy Algorithm chooses any set $\lambda$4 of size $\lambda$5 satisfying

$\lambda$6

and forms

$\lambda$7

When $\lambda$8, this is the classical TGA. A second generalization enlarges the greedy sum itself: instead of comparing the error after $\lambda$9 greedy terms with best $f(m)$0-term benchmarks, one defines

$f(m)$1

leading to $f(m)$2-almost greedy and $f(m)$3-partially greedy bases (Berasategui et al., 2023, Chu, 2022).

A further axis of generalization replaces the benchmark size $f(m)$4 by a function $f(m)$5. For $f(m)$6 in the class $f(m)$7 of continuous, increasing, concave maps with $f(m)$8, $f(m)$9, and $\mathcal B=(e_n)_{n=1}^\infty$0 on $\mathcal B=(e_n)_{n=1}^\infty$1, a basis is called $\mathcal B=(e_n)_{n=1}^\infty$2-greedy if

$\mathcal B=(e_n)_{n=1}^\infty$3

and $\mathcal B=(e_n)_{n=1}^\infty$4-almost greedy if

$\mathcal B=(e_n)_{n=1}^\infty$5

for all $\mathcal B=(e_n)_{n=1}^\infty$6, $\mathcal B=(e_n)_{n=1}^\infty$7, and greedy sets $\mathcal B=(e_n)_{n=1}^\infty$8 of size $\mathcal B=(e_n)_{n=1}^\infty$9 (Chu, 2022). These variants make explicit that “threshold” may act on coefficient admissibility, on greedy-sum size, or on the benchmark against which greedy error is measured.

2. Structural theory in Banach and quasi-Banach spaces

The classical characterization of greedy bases is the Konyagin–Temlyakov theorem: a basis is greedy if and only if it is unconditional and democratic. The almost-greedy property replaces the best linear $(e_n^*)$0-term error $(e_n^*)$1 by the best projection error

$(e_n^*)$2

and almost-greedy bases are exactly those that are quasi-greedy and democratic. In parallel, quasi-greediness is equivalent to convergence of greedy approximants and to uniform boundedness of greedy operators (Berná et al., 2022, Albiac et al., 2019).

Threshold enlargement does not behave uniformly across all greedy-type classes. For almost-greedy bases, the enlargement parameter $(e_n^*)$3 does not produce a genuinely new class: a basis is almost greedy if and only if it is $(e_n^*)$4-almost greedy for some, equivalently all, $(e_n^*)$5. By contrast, for each $(e_n^*)$6 there exists an unconditional basis that is $(e_n^*)$7-partially greedy but is not $(e_n^*)$8-partially greedy. The characterization of $(e_n^*)$9-partially greedy bases is

$x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$0

where $x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$1-max-conservativity is expressed by

$x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$2

for sets $x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$3 with

$x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$4

This distinction corrects a common oversimplification: allowing larger greedy sums preserves almost-greediness but strictly weakens partial greed when $x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$5 (Chu, 2022).

The $x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$6-theory yields a different phenomenon. For every non-identity $x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$7,

$x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$8

The paper also characterizes $x=\sum_{n=1}^\infty e_n^*(x)\,e_n,$9-almost greedy as quasi-greedy plus Property $A\subset\mathbb N$0, and $A\subset\mathbb N$1-greedy as $A\subset\mathbb N$2-unconditional plus Property $A\subset\mathbb N$3. This collapses the distinction between best linear and best threshold approximants once the comparison size is strictly sublinear. A plausible implication is that sublinear benchmark growth regularizes the gap between linear and coordinate projection models of approximation (Chu, 2022).

Several later refinements restrict the admissible comparison supports. Consecutive greedy bases compare greedy error only with approximants supported on intervals of $A\subset\mathbb N$4, while CGPCC restricts further to interval-supported polynomials with constant coefficients. On Schauder bases, consecutive-greedy is equivalent to almost-greedy. The sequential theory replaces intervals by families $A\subset\mathbb N$5 generated by a fixed gap sequence; the $A\subset\mathbb N$6-almost greedy property and the $A\subset\mathbb N$7-strong partially greedy property are equivalent to their classical counterparts if and only if $A\subset\mathbb N$8 is bounded. Under additional conditions, the $A\subset\mathbb N$9-minimum partially greedy property lies strictly between almost-greedy and strong partially greedy (Berasategui et al., 2023, Berasategui et al., 2023).

Quantitative control is given by Lebesgue-type constants and related parameters. The Lebesgue constants

$m$0

satisfy

$m$1

where $m$2 are unconditionality parameters and $m$3 are the squeeze-symmetry constants. This answers Temlyakov’s 2011 question about a natural greedy-type parameter complementing $m$4 in an exact linear rule for $m$5. Rate-of-convergence results then bound the TGA error by a product of $m$6 and $m$7, and in $m$8 the trigonometric system and the Haar basis admit sharp rates (Albiac et al., 2021, Temlyakov, 2023). Related work also characterizes greedy bases by approximation with polynomials of constant coefficients, including the RGPCC and URGPCC formulations, and extends these equivalences to quasi-Banach spaces (Berasategui et al., 2023).

3. Sparse recovery and thresholded pursuit

In compressive sensing, thresholding often replaces the exact “largest inner product” step of a greedy pursuit. Orthogonal Matching Pursuit with Thresholding (OMPT) takes measurements $m$9, a normalized dictionary $$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$0, and a threshold parameter $$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$1. At iteration $$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$2, instead of selecting the atom of maximum correlation with the residual $$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$3, OMPT chooses any index $$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$4 satisfying

$$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$5

The support is updated, a least-squares projection is performed on the selected support, and the residual is recomputed. The analysis uses the global $$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$6-coherence

$$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$7

which bridges mutual coherence and the restricted isometry constant via

$$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$8

Under

$$\min_{n\in A}|e_n^*(x)|>\max_{n\notin A}|e_n^*(x)|,$$9

and

$G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$0

OMPT recovers a $G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$1-sparse signal exactly in $G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$2 steps, and the paper states that these conditions coincide with the best known bounds for standard OMP while reducing the cost of the selection step (Yang et al., 2013).

Thresholding Greedy Pursuit (TGP) applies the same principle to a CoSaMP-style framework. At each iteration it computes the proxy

$G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$3

keeps all coordinates above a scalar threshold,

$G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$4

merges them into the support estimate, solves a least-squares problem on the merged support, and updates the residual. The theory emphasizes asymptotic sparse recovery with additive noise. With

$G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$5

the “No Phantom Signal” theorem yields $G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$6 when $G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$7 with probability at least $G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$8, and the “No False Discoveries” theorem gives

$G_m(x)=\sum_{n\in A}e_n^*(x)\,e_n.$9

under $\lambda$00. In the exact-recovery regime, if

$\lambda$01

and

$\lambda$02

then TGP recovers exactly

$\lambda$03

with probability $\lambda$04. The paper stresses that the threshold can be chosen without the knowledge of sparsity level of the signal and strength of the noise (Le et al., 2021).

Taken together, OMPT and TGP show that thresholding is not merely a heuristic weakening of greedy pursuit. In both cases, the thresholded rule replaces a more expensive exact maximization while retaining recovery guarantees under coherence- or concentration-based assumptions (Yang et al., 2013, Le et al., 2021).

4. Learning and nonlinear inverse problems

Orthogonal Greedy Learning (OGL) provides a learning-theoretic version of the same idea. Classical OGL selects

$\lambda$05

and updates the predictor by orthogonal projection onto the span of selected atoms. The $\lambda$06-greedy-threshold metric declares an atom $\lambda$07 to be active when

$\lambda$08

or, in the closely related formulation,

$\lambda$09

The $\lambda$10-Threshold OGL algorithm chooses any active atom, projects orthogonally onto the enlarged span, and stops when no active atom remains or when

$\lambda$11

Under the source condition

$\lambda$12

the output $\lambda$13 satisfies, with probability at least $\lambda$14,

$\lambda$15

and choosing

$\lambda$16

yields the rate $\lambda$17. The papers emphasize that steepest gradient descent is not the unique greedy criterion of OGL and that the threshold parameter acts simultaneously as a greediness control and an adaptive stopping rule (Xu et al., 2016, Xu et al., 2014).

A related pattern appears in nonlinear Kaczmarz methods. The greedy capped nonlinear Kaczmarz framework introduces a capped set of promising rows at each iterate. In the distance–residual capped method, one defines

$\lambda$18

and the capped set

$\lambda$19

In the residual–distance capped method, one defines

$\lambda$20

Randomization is then performed only within $\lambda$21 or $\lambda$22, with probabilities determined by residual- or distance-based scores. Under the local tangential cone condition, the resulting single-row and block methods satisfy expected contraction bounds that the paper states are strictly smaller than the NRK factor. This is an explicit exploration–exploitation design: discard low-score rows by a threshold, then sample within the retained set (Zhang et al., 2022).

5. Threshold-greedy optimization and decentralized control

For monotone submodular task allocation under a partition matroid, the Decreasing Threshold Task Allocation (DTTA) algorithm initializes a global threshold

$\lambda$23

and then sweeps

$\lambda$24

At each threshold level, each robot proposes any task with marginal gain at least $\lambda$25, conflicts are resolved by a coordination step, and many tasks can be allocated in parallel. The resulting guarantee is

$\lambda$26

with time complexity

$\lambda$27

The lazy variant LDTTA maintains cached marginals in a max-heap and uses submodularity to avoid recomputing most gains, while retaining the same $\lambda$28 approximation guarantee (Li et al., 2019).

Noisy submodular maximization uses thresholding in a statistically adaptive form. The Confident Sample subroutine decides whether an unknown mean is approximately above or below a threshold $\lambda$29 with probability at least $\lambda$30, and the monotone cardinality algorithm CTG integrates it into a threshold schedule based on

$\lambda$31

With probability at least $\lambda$32, CTG returns $\lambda$33 with

$\lambda$34

The same framework extends to unconstrained non-monotone maximization through CDG and to matroid constraints through CCTG, the latter obtaining

$\lambda$35

Here the threshold is not fixed solely by optimization geometry; it is coupled to adaptive sampling and confidence control (Chen et al., 2023).

Threshold control can also be the object being optimized. In persistent monitoring on graphs, each agent carries a threshold matrix $\lambda$36 that determines dwell times and next-hop decisions by testing whether the current node uncertainty falls below $\lambda$37 and whether some neighboring uncertainty exceeds $\lambda$38. Because local optimization over thresholds is highly initialization-dependent, the paper develops an off-line greedy initialization based on asymptotic cycle analysis and a target-cycle expansion operation. The resulting method constructs a high-performing set of initial thresholds and then refines them by on-line IPA-driven gradient descent. This use of greediness is secondary to the threshold controller itself, but it shows that threshold-greedy methodology also appears as an initialization strategy for hybrid distributed control (Welikala et al., 2019).

6. Thresholds as optimality boundaries and phase transitions

Not all greedy-threshold results are algorithmic selection rules. In some settings, the threshold is a regime boundary that exactly characterizes when a greedy policy is optimal. For a battery limited energy harvesting communication system with i.i.d. arrivals, finite battery capacity $\lambda$39, and reward $\lambda$40 increasing, concave, and continuously differentiable, the greedy policy uses all available battery energy in each slot. Its baseline throughput is

$\lambda$41

The main theorem states that there exists a critical battery size

$\lambda$42

such that

$\lambda$43

For the AWGN reward,

$\lambda$44

this becomes

$\lambda$45

The paper also provides lower and upper bounds on $\lambda$46 and asymptotic formulas for geometric, Poisson, uniform, exponential, and Rayleigh arrivals. A common misconception is that greediness should improve with larger storage; this result shows the opposite structure: greedy is exactly optimal only on the interval $\lambda$47 (Wang et al., 2019).

A second regime-threshold interpretation appears in online edge coloring. The folklore greedy algorithm uses at most

$\lambda$48

colors. The sharp-threshold results show that this guarantee is unimprovable for deterministic algorithms when $\lambda$49 and for randomized algorithms when $\lambda$50, matching the classical impossibility results. Beyond those regimes, however, the greedy barrier disappears: there is a deterministic online algorithm achieving $\lambda$51-colorings for all $\lambda$52, and a randomized algorithm achieving $\lambda$53-colorings already for $\lambda$54. The paper explicitly describes these as sharp thresholds for when greedy can be surpassed (Blikstad et al., 29 Jul 2025).

These phase-transition results use “threshold” in a different sense from TGA, OMPT, or DTTA. The threshold does not define admissible local moves; it delineates the structural regime in which greediness is exactly optimal, provably optimal only up to a factor, or asymptotically improvable. This suggests that greedy-threshold is best understood as a broader research motif rather than a single algorithmic template (Wang et al., 2019, Blikstad et al., 29 Jul 2025).