Metric Reservoir Sampling Techniques

• Metric reservoir sampling is a family of bounded-memory algorithms that employ metric-driven criteria, such as weights, temporal decay, or confidence scores, instead of uniform random replacement.
• These methods optimize unbiased variance estimates and support diverse applications including subset sum estimation, graph stream analysis, and continual learning.
• Key techniques include VAROPT_k, Graph Priority Sampling, and time-weighted approaches that tailor eviction and retention policies for improved sample representativeness.

Metric reservoir sampling denotes a family of bounded-memory streaming samplers in which retention, eviction, or weighting is driven by a metric, score, decay function, or objective-specific quantity rather than by uniform replacement alone. The cited literature suggests that the phrase does not identify a single canonical algorithm. Instead, it spans fixed-size weighted priority reservoirs for subset sums, graph streams, and repeated-key aggregates; confidence- and time-weighted buffers for continual learning and visual tracking; temporally biased reservoirs with explicit decay semantics; and reservoir reuse inside stochastic estimators of metric quantities such as Sliced Wasserstein Distance. A separate geometric line studies sampling of metric measure spaces via $\varepsilon$-nets and snowflaked metrics; that line is related terminologically but is not a reservoir algorithm in the streaming sense (0803.0473, Ahmed et al., 2017, Duffield et al., 2017, Chen et al., 2021, Li et al., 2012, Hentschel et al., 2018, Hentschel et al., 2019, Boss et al., 1 Oct 2025, Saucan, 2011).

1. Multiple meanings of “metric” in reservoir sampling

In one major usage, the metric is a scalar importance weight that enters a threshold or priority law. In $\mathrm{VAROPT}_k$, items have weights $w_i>0$, inclusion probabilities are of threshold form

$p_i=\min\{1,w_i/\tau_k\},$

and sampled items receive adjusted weight

$\hat w_i=\max\{w_i,\tau_k\}.$

The objective is “variance-optimal unbiased estimation of subset sums” under a fixed sample size $k$ (0803.0473). In graph streams, Graph Priority Sampling maintains a reservoir $\hat K_t$ of size $m$, assigns each arriving edge $k$ a random key $u(k)\sim \mathrm{Uni}(0,1]$, an adaptive weight $\mathrm{VAROPT}_k$0, and a priority

$\mathrm{VAROPT}_k$1

The sample is the top-$\mathrm{VAROPT}_k$2 priority edges, and the metric is the weight function $\mathrm{VAROPT}_k$3, which may depend on graph structure, attributes, or variance-reduction surrogates (Ahmed et al., 2017). For repeated-key streams, Priority-Based Aggregation maintains per-key priorities $\mathrm{VAROPT}_k$4 and unbiased aggregate estimates in a fixed-size cache over non-unique keys (Duffield et al., 2017).

In a second usage, the metric is an application-specific value signal. Confidence Reservoir Sampling in task-free online continual learning keeps the outer reservoir-style admission test but changes eviction by scoring memory items with

$\mathrm{VAROPT}_k$5

where $\mathrm{VAROPT}_k$6 is an exploitation rate and $\mathrm{VAROPT}_k$7 is a margin increment based on softmax confidence (Chen et al., 2021). In online visual tracking, time-weighted reservoir sampling assigns each sample a time-based weight

$\mathrm{VAROPT}_k$8

and a key

$\mathrm{VAROPT}_k$9

so that recent samples are more likely to remain in bounded foreground and background buffers used for online Mahalanobis metric learning (Li et al., 2012).

In a third usage, the metric is temporal age. Temporally-biased sampling schemes specify a decay function $w_i>0$0 over item age and aim to maintain inclusion probabilities proportional to that decay, while controlling memory usage through a reservoir cap or a target size (Hentschel et al., 2018, Hentschel et al., 2019).

In a fourth usage, reservoir sampling is embedded inside a stochastic estimator of a metric. ReSWD stores projection directions and scores each direction by

$w_i>0$1

then uses weighted reservoir sampling to retain “informative projection directions” across optimization steps for lower-variance Sliced Wasserstein estimation (Boss et al., 1 Oct 2025).

2. Fixed-size weighted and priority reservoirs

The foundational fixed-size formulation is the weighted subset-sum problem addressed by $w_i>0$2. After processing a stream prefix $w_i>0$3, the sampler stores a reservoir $w_i>0$4 of size at most $w_i>0$5, and any subset sum

$w_i>0$6

is estimated by

$w_i>0$7

The threshold $w_i>0$8 is defined by

$w_i>0$9

and the scheme satisfies three defining properties: inclusion probabilities proportional to size in threshold form, a sample of at most $p_i=\min\{1,w_i/\tau_k\},$0 items, and no positive covariances between distinct adjusted weights. Its central claim is optimality of average subset-sum variance for every subset cardinality $p_i=\min\{1,w_i/\tau_k\},$1, and it supports the streaming recurrence

$p_i=\min\{1,w_i/\tau_k\},$2

as well as a mergeability law over disjoint partitions (0803.0473).

Graph Priority Sampling specializes the same priority-sampling paradigm to graph streams. Each arriving edge is provisionally inserted, the edge of lowest priority

$p_i=\min\{1,w_i/\tau_k\},$3

is identified if the reservoir exceeds capacity, the threshold is updated by

$p_i=\min\{1,w_i/\tau_k\},$4

and $p_i=\min\{1,w_i/\tau_k\},$5 is evicted. Selected edges are normalized with

$p_i=\min\{1,w_i/\tau_k\},$6

The graph-specific novelty is that $p_i=\min\{1,w_i/\tau_k\},$7 can encode “number of sampled adjacent edges,” “number of triangles completed by the edge,” or a variance-oriented metric such as

$p_i=\min\{1,w_i/\tau_k\},$8

For subgraphs $p_i=\min\{1,w_i/\tau_k\},$9, the estimator is the product of constituent edge estimators,

$\hat w_i=\max\{w_i,\tau_k\}.$0

and the paper establishes unbiasedness through a martingale formulation of graph stream order sampling (Ahmed et al., 2017).

Priority-Based Aggregation adapts order sampling to repeated keys. The stream consists of weighted items $\hat w_i=\max\{w_i,\tau_k\}.$1, the true per-key aggregate is

$\hat w_i=\max\{w_i,\tau_k\}.$2

and the summary stores at most $\hat w_i=\max\{w_i,\tau_k\}.$3 keys. The key technical device is “a single persistent random variable across the lifetime of each key in the cache.” Priority evolves as

$\hat w_i=\max\{w_i,\tau_k\}.$4

where $\hat w_i=\max\{w_i,\tau_k\}.$5 is accumulated weight since the latest admission of key $\hat w_i=\max\{w_i,\tau_k\}.$6. The algorithm keeps the top-$\hat w_i=\max\{w_i,\tau_k\}.$7 current priorities, uses a monotone threshold $\hat w_i=\max\{w_i,\tau_k\}.$8, and maintains unbiased estimates $\hat w_i=\max\{w_i,\tau_k\}.$9 for per-key aggregates (Duffield et al., 2017).

For distributed weighted reservoirs with fixed positive weights, an exact bottom-$k$0 view is also available. Each item receives an exponential key

$k$1

and the reservoir contains the $k$2 smallest keys. This directly supports weighted and unweighted reservoir sampling in a distributed mini-batch streaming model, and the paper explicitly notes that the method remains valid when weights are “fixed metric-derived weights” known at arrival time (Hübschle-Schneider et al., 2019). In the with-replacement setting, each reservoir slot can be maintained as an independent one-item weighted sampler with replacement probability $k$3, and skip-based acceleration is obtained from the threshold

$k$4

with accepted multiplicity sampled from a zero-truncated binomial law (Meligrana, 2024).

3. Learned confidence, topology, and recency as reservoir metrics

Confidence Reservoir Sampling treats uniform replacement as suboptimal for continual learning because it preserves “equilibrium/fairness of storage, but not informativeness.” The admission gate remains reservoir-style: $\mathrm{VAROPT}_k$20 but eviction is metric-driven. The score

$k$5

combines exploitation rate

$k$6

with margin increment

$k$7

The paper defines two replacement strategies: deterministic eviction

$k$8

and probabilistic eviction

$k$9

High-score examples are “more appropriate to replace” because they are either highly exploited or less informative. Empirically, ER-C improves average accuracy on MNIST-S, MNIST-P, CIFAR10-S, and Mini-S, and reduces forgetting on all four datasets, but the paper does not provide a formal theorem for CRS (Chen et al., 2021).

In visual tracking, the reservoir metric is explicitly time-based. The tracker maintains separate finite buffers $\hat K_t$0 and $\hat K_t$1 for foreground and background samples, used both as basis matrices for non-sparse reconstruction and as training pools for triplet-based Mahalanobis metric learning. For each new sample, time-weighted reservoir sampling sets

$\hat K_t$2

and inserts the sample if the corresponding class buffer is not full or if $\hat K_t$3 exceeds the smallest stored key. The paper states that this balances “sample diversity and adaptability,” because the procedure is still reservoir-style random sampling while assigning later samples larger weights. Weighted reservoir sampling performs better than ordinary reservoir sampling in CLE on multiple sequences, and the implementation uses $\hat K_t$4 and $\hat K_t$5 in experiments (Li et al., 2012).

These constructions suggest two application-specific patterns. First, the reservoir can remain structurally classical while the eviction rule becomes metric-driven, as in CRS. Second, the metric can be folded directly into the key distribution, as in time-weighted tracking reservoirs.

4. Temporal metrics and decay-controlled reservoirs

Temporally-biased sampling formalizes age as the metric. The target condition is that, for items $\hat K_t$6 and $\hat K_t$7 at time $\hat K_t$8,

$\hat K_t$9

where $m$0 is a nonnegative, nonincreasing decay function and $m$1 is age (Hentschel et al., 2019). In the exponential case,

$m$2

and the earlier formulation writes the ratio law as

$m$3

for $m$4 and $m$5 (Hentschel et al., 2018).

The simpler scheme, T-TBS, probabilistically maintains a target sample size but does not enforce a hard cap. In the exponential case it uses per-step retention

$m$6

and arrival acceptance

$m$7

where $m$8 is the mean batch size. T-TBS exactly preserves exponential temporal bias, but sample size is controlled only in expectation (Hentschel et al., 2018).

R-TBS is the reservoir-based construction. It introduces a latent sample

$m$9

where $k$0 is a set of $k$1 full items, $k$2 is at most one partial item, and $k$3 is sample weight. Realization includes all full items and includes the partial item with probability $k$4, so

$k$5

The critical primitive is downsampling: if $k$6 is produced from $k$7 with weight $k$8, then for every item $k$9,

$u(k)\sim \mathrm{Uni}(0,1]$0

In the exponential-decay case, R-TBS maintains

$u(k)\sim \mathrm{Uni}(0,1]$1

and is proved to maximize expected sample size and minimize sample-size variance among valid samplers with the same maximal expected sample size (Hentschel et al., 2019). The earlier exponential-only treatment presents the same idea in terms of item weights

$u(k)\sim \mathrm{Uni}(0,1]$2

with inclusion law

$u(k)\sim \mathrm{Uni}(0,1]$3

That formulation emphasizes the bridge to classical reservoir sampling: when there is no decay and batches are singletons, it reduces to the classical uniform reservoir law (Hentschel et al., 2018).

For general decay functions, the later paper consolidates old batches into a single exponentially decaying latent sample and introduces a headroom parameter $u(k)\sim \mathrm{Uni}(0,1]$4. The resulting scheme trades off footprint, sample-size stability, and decay fidelity, while providing explicit controls $u(k)\sim \mathrm{Uni}(0,1]$5 and $u(k)\sim \mathrm{Uni}(0,1]$6 on approximation error and bounded footprint (Hentschel et al., 2019).

5. Reservoirs inside metric estimators and constrained candidate streams

ReSWD applies weighted reservoir sampling to the Monte Carlo estimator of Sliced Wasserstein Distance. At optimization step $u(k)\sim \mathrm{Uni}(0,1]$7, the reservoir stores tuples

$u(k)\sim \mathrm{Uni}(0,1]$8

where $u(k)\sim \mathrm{Uni}(0,1]$9 is a projection direction, $\mathrm{VAROPT}_k$00 its associated weight, $\mathrm{VAROPT}_k$01 its reservoir key, and $\mathrm{VAROPT}_k$02 its insertion time. Each candidate direction is scored by

$\mathrm{VAROPT}_k$03

and receives a weighted-reservoir key

$\mathrm{VAROPT}_k$04

Historical entries are decayed by

$\mathrm{VAROPT}_k$05

the next reservoir keeps the $\mathrm{VAROPT}_k$06 directions with smallest keys, and the loss is computed with the self-normalized estimator

$\mathrm{VAROPT}_k$07

The paper presents this as an unbiased Monte Carlo estimate, monitors

$\mathrm{VAROPT}_k$08

and resets the reservoir when $\mathrm{VAROPT}_k$09 with $\mathrm{VAROPT}_k$10. Empirically, ReSWD improves final matching score on synthetic benchmarks and improves several color-correction metrics relative to standard SWD, while adding modest overhead (Boss et al., 1 Oct 2025).

A different but related extension appears in sampling over joins. The generalized reservoir sampler with predicate maintains a uniform sample of $\mathrm{VAROPT}_k$11 real items from a stream that may also contain dummy items. It uses Li-style skipping with

$\mathrm{VAROPT}_k$12

but updates the reservoir only when the skipped-to item satisfies the predicate $\mathrm{VAROPT}_k$13. The paper proves exact uniformity over real items and an instance-optimal expected running time

$\mathrm{VAROPT}_k$14

when primitive access costs are constant. Its synthetic evaluation uses an edit-distance predicate over strings. This suggests a route for metric-thresholded reservoirs in which the admissible set is defined by a metric predicate and reservoir logic operates over a denser candidate stream that may contain non-eligible items (Dai et al., 2024).

6. Guarantees, limits, and conceptual boundaries

The strongest guarantees appear when the metric reduces to a fixed thresholdable weight or to a controlled decay law. $\mathrm{VAROPT}_k$15 gives “variance optimal unbiased estimation of subset sums,” preserves exact threshold marginals, and has no positive covariances (0803.0473). GPS proves unbiased edge and subgraph estimators through a martingale formulation, even when subgraph estimators are products of edge estimators computed at different points in the stream (Ahmed et al., 2017). PBA proves unbiased estimates of true aggregates under repeated keys (Duffield et al., 2017). Exponential R-TBS provides exact decay-controlled inclusion probabilities together with a guaranteed upper bound on sample size, and the later treatment proves optimality in expected sample size and sample-size stability (Hentschel et al., 2018, Hentschel et al., 2019).

The guarantees weaken when the metric is adaptive, model-dependent, or heuristic. CRS is motivated by replay saturation and margin dynamics, but the paper explicitly provides no theorem, proof of optimality, or isolated complexity analysis for the reservoir component (Chen et al., 2021). ReSWD repeatedly states that the estimator remains unbiased, but the manuscript does not provide a full theorem-proof derivation of unbiasedness for the exact self-normalized estimator (Boss et al., 1 Oct 2025). Time-weighted reservoir sampling for tracking is justified by adaptability and diversity, not by an exact inclusion law over the original stream (Li et al., 2012).

A further boundary concerns what counts as reservoir sampling at all. “A Simple Sampling Method for Metric Measure Spaces” defines

$\mathrm{VAROPT}_k$16

and studies $\mathrm{VAROPT}_k$17-nets, quasimetric metrization, and bilipschitz equivalence to sampling subsets of some $\mathrm{VAROPT}_k$18. It is a geometric sampling theory, not a one-pass bounded-memory reservoir algorithm (Saucan, 2011). Conversely, parallel weighted reservoir methods based on fixed exponential keys

$\mathrm{VAROPT}_k$19

are directly applicable when metric information can be encoded as fixed positive per-item weights at arrival time, but the same paper states that they do not directly solve adaptive diversity-aware settings in which weights depend on the current reservoir or on pairwise distances among sampled items (Hübschle-Schneider et al., 2019).

The literature therefore suggests a precise but plural understanding of metric reservoir sampling. In the most developed cases, it means fixed-size weighted or temporally weighted reservoir maintenance with explicit threshold formulas, mergeability, martingale unbiasedness, or variance optimality. In more application-specific cases, it means retaining the outer reservoir skeleton while replacing uniform eviction by a confidence, topology, or recency metric. And in metric-estimation problems such as SWD, it means storing and reusing metric evaluation components—projection directions rather than data items—inside a bounded reservoir to reduce variance.