Approximate Closest Pair Algorithms
- Approximate Closest Pair (CP) is defined as finding two points whose distance is within a prescribed multiplicative factor (e.g., 1+ε or c) of the true minimum, balancing precision and efficiency.
- Algorithmic paradigms like PM-LSH and MSPP use techniques such as dimensionality reduction, candidate filtering, and randomized hashing to accelerate computations in high-dimensional spaces.
- Research highlights metric-dependent performance, strong conditional lower bounds, and practical system designs that trade off between recall, running time, and preprocessing complexity.
Approximate Closest Pair (CP) is the family of problems in which one seeks a pair whose distance is within a prescribed multiplicative factor of the minimum inter-point distance, rather than the exact optimum. The formulation appears in monochromatic, bichromatic, colored, query, and stochastic settings; representative versions include -approximate Bichromatic Closest Pair, -approximate Closest Pair queries, color distance oracles, and -approximation of the expected closest-pair distance in uncertain tree metrics (Rubinstein, 2018, Zheng et al., 2021, Horowicz et al., 6 Jul 2025, Xue et al., 2016). Approximate CP is central precisely where exact high-dimensional CP becomes expensive, yet the research landscape is uneven: some models admit fast approximate algorithms, some exhibit exact-versus-approximate separations, and others carry strong conditional lower bounds even for approximation (Gold et al., 2016, Horowicz et al., 6 Jul 2025).
1. Formal problem variants
In the classical monochromatic setting, CP asks for
A multiplicative approximation returns a pair whose distance is at most a factor or above that minimum. In the high-dimensional Euclidean formulation used by PM-LSH, if is the exact closest pair with distance , then a -approximate closest pair query returns a pair 0 satisfying
1
A standard offline generalization is Bichromatic Closest Pair (BCP). Given two sets 2 of 3 vectors, the optimum value is
4
and a 5-approximation outputs 6 with
7
(Rubinstein, 2018). The literature repeatedly uses BCP as the offline or batch analogue of approximate nearest-neighbor search.
A colored formulation appears in color distance oracles. For a metric space 8, a colored point set 9, and color classes 0, the color distance between 1 and 2 is
3
which is exactly a bicolored closest-pair distance (Horowicz et al., 6 Jul 2025). Approximate CDO and AMCDOCH are therefore approximate colored CP data structures in the one-dimensional array metric.
A stochastic formulation replaces the fixed optimum by a random variable. In a tree metric with independent existential probabilities, the closest-pair distance of a realization 4 is 5, and the central approximation target becomes the expectation
6
where 7 is the 8-threshold probability (Xue et al., 2016). This is not an approximate pair-retrieval problem; it is an approximate computation of a closest-pair statistic under uncertainty.
These variants differ not only in output type but also in what approximation means. In monochromatic and bichromatic CP, the output is usually a pair. In colored and snippets-style problems, approximation is embedded in preprocessing–query tradeoffs. In stochastic settings, approximation concerns a scalar functional of the whole realization distribution rather than a witness pair.
2. Algorithmic paradigms
A persistent theme is that approximate CP in high dimensions is algorithmically easier than exact CP. One exact 9 paper states that, if one settles for approximate solutions, many efficient algorithms are known, particularly for nearest neighbor and CP under 0 norms, and that approximate algorithms are generally “easy” in high dimensions relative to exact ones: often near-linear or 1 time for a fixed approximation factor in various models (Gold et al., 2016). The same paper explicitly positions LSH-based methods and Johnson–Lindenstrauss dimensionality reduction as contextual prior work for approximation rather than as part of its exact contribution.
PM-LSH is a representative high-dimensional Euclidean framework that makes this general picture concrete. It projects each point 2 to
3
indexes the projected points in a PM-tree, and uses the fact that
4
to build confidence intervals connecting projected and original distances (Zheng et al., 2021). Its closest-pair component first defines a branch-and-bound search over PM-tree node pairs using a lower bound 5, but the practical algorithm is a radius-filtering method: it derives an upper bound 6 on the current 7-th smallest original distance, sets a projected threshold 8, and explores only nodes whose radius is below
9
The candidate cap is
0
and the stated complexity is 1 with 2 in practice (Zheng et al., 2021). The framework is explicitly tunable: larger 3, larger 4, or smaller 5 improve recall at higher cost.
MSPP uses a different approximation template for Euclidean distance and Pearson correlation. Each attribute is clustered into 6 one-dimensional clusters by 7-means++, then one-hot encoded, so every original point becomes a binary vector in 8. The algorithm repeatedly samples 9 random encoded coordinates, hashes points by those sampled bits, computes full Hamming distance only for colliding pairs, and keeps the top 0 candidates in a priority queue. In a second pass it recomputes the original Euclidean distance or Pearson correlation only for those candidates and outputs the top 1 pairs (Saha et al., 2020). Its analysis uses the collision estimate
2
and shows that
3
iterations suffice to capture a pair that agrees on 4 attributes with probability at least 5 (Saha et al., 2020). MSPP therefore approximates CP by first preserving coarse local agreement under discretization and then amplifying discovery probability through repeated random hashing.
The algorithmic landscape is therefore heterogeneous. One line, represented by PM-LSH, treats approximate CP as a projected metric-search problem with explicit probabilistic calibration. Another, represented by MSPP, treats it as large-scale similar-pairs mining through data-dependent discretization and repeated hash collisions. Both lines depart from low-dimensional geometric CP algorithms and target the regimes in which exact all-pairs distance evaluation is operationally infeasible.
3. Fine-grained complexity and hardness
Approximate CP is not uniformly easy. Strong conditional lower bounds are known for several variants. For BCP in Euclidean, Manhattan, Hamming, and edit distance, the main hardness result states that, unless SETH is false, for every 6 there exists a constant 7 such that computing a 8-approximation requires 9 time; for Euclidean, Manhattan, and Hamming this holds in dimension 0, and for edit distance in 1 (Rubinstein, 2018). The same paper derives an ANN corollary: assuming SETH, for every constants 2 there exists 3 such that no algorithm can preprocess 4 vectors in 5 time and answer 6-ANN queries in 7 time (Rubinstein, 2018).
For monochromatic CP, a separate SETH-based result shows that for every 8 there exist constants 9 and 0 such that no algorithm running in time 1 can solve 2-CP in the 3-metric when the dimension satisfies
4
(S. et al., 2018). The same work also establishes exact CP hardness in dimensions 5, showing that medium-dimensional approximation lower bounds and medium-dimensional exact lower bounds occupy distinct exponent regimes.
Metric dependence is sharp. For 6, it is OVH-hard to obtain an 7-time 8-approximation for CP in 9, and for 0 it is OVH-hard to obtain an 1-time 2-approximation (David et al., 2016). By contrast, in Euclidean space the same paper stresses that its polar-pair reduction does not yield comparable hardness because biclique representations in 3 require much higher dimension (David et al., 2016). This suggests that approximation hardness is substantially more metric-sensitive than the formal definitions alone might imply.
A different kind of separation arises in one-dimensional colored data structures. For exact CDO on points in an array, preprocessing 4 and query time 5 must satisfy
6
under the Strong-APSP hypothesis, while for 7-approximate CDO the FMM-based upper bound is
8
and
9
When 0, this becomes
1
which lies strictly below the exact barrier 2 for part of the tradeoff curve (Horowicz et al., 6 Jul 2025). In that model, the exact version is strictly harder than the approximate version.
Exact-versus-approximate asymmetry also appears in reductions. A paper comparing closest, furthest, and orthogonal pairs states explicitly that its conditional lower bounds only hold for exact solutions and that the reductions from OV to closest/furthest pair no longer work if one only has 3-approximations (Williams, 2017). This is a useful caution: approximation can evade exact fine-grained barriers, but only in some models, and not in the settings covered by the lower bounds above.
4. Colored, query, and oracle formulations
Approximate CP often appears not as a single optimization problem but as a query problem over structured families of subsets. The cleanest current example is the one-dimensional array metric, where a color distance oracle preprocesses 4 colored points so that a query on colors 5 returns an approximation to
6
This is a static approximate colored closest-pair data structure (Horowicz et al., 6 Jul 2025).
The main ACDO construction is a heavy-light decomposition. A color 7 is heavy if 8; otherwise it is light. For every color, the structure stores a one-dimensional nearest-neighbor data structure 9. For heavy colors it additionally precomputes an approximate matrix 00 of all-heavy color distances. Heavy-heavy queries become 01 lookups in 02, while if one queried color is light, the answer is computed exactly as
03
using at most 04 nearest-neighbor probes (Horowicz et al., 6 Jul 2025). The expensive part is building 05, which is done by partitioning the line into blocks of length 06, building Boolean matrices 07 and 08 across geometric scales 09, and multiplying them. The resulting preprocessing–query tradeoff is FMM-governed rather than purely combinatorial.
The same paper extends the construction to multi-colored points with a laminar color hierarchy, AMCDOCH, and then to the snippets problem on texts via the Kopelowitz–Krauthgamer reduction. Snippets preprocesses a text 10 so that, for patterns 11, one can approximate the distance between closest occurrences. The resulting query time is
12
after preprocessing time 13, with the same tradeoff curve as ACDO (Horowicz et al., 6 Jul 2025). In effect, approximate CP, approximate colored CP, and approximate closest-occurrence search in strings become equivalent under linear-time reductions in this one-dimensional regime.
| Problem | Model | Representative guarantee |
|---|---|---|
| ACDO | 1D array, colored points | 14 or 15 (Horowicz et al., 6 Jul 2025) |
| AMCDOCH | 1D array, hierarchical colors | Same preprocessing–query tradeoff as ACDO (Horowicz et al., 6 Jul 2025) |
| Snippets | Text 16, query patterns 17 | 18-approximate closest-occurrence distance in 19 (Horowicz et al., 6 Jul 2025) |
These oracle-style formulations matter because they expose approximation as a query-complexity resource rather than only as an optimization relaxation. They also provide one of the clearest exact-versus-approximate separations presently known for CP-type tasks.
5. Metric-dependent and stochastic variants
Approximate CP behaves differently across metric classes. In tree spaces with existential uncertainty, the problem becomes probabilistic rather than purely geometric. Given a stochastic point set 20 on a weighted tree, the threshold probability
21
can be computed exactly in
22
time for any fixed threshold 23, where 24 is the number of tree vertices after preprocessing (Xue et al., 2016). The same work gives an exact algorithm for 25 in
26
time and a 27-approximation in
28
time, using the fact that the expectation can be approximated via 29 threshold-probability queries (Xue et al., 2016). Here approximation is over a random closest-pair distance, not over a fixed witness pair.
At the opposite end of the spectrum, in constant doubling dimension exact CP is already easy. A randomized divide-and-conquer algorithm computes the exact closest-pair distance in 30 expected time in doubling metrics (Maheshwari et al., 2020). This suggests that, in sufficiently low-dimensional metric structure, approximation is not needed for asymptotic speed; its main value then lies in simplification, robustness, or engineering.
Range-query versions introduce another axis. In fixed-dimensional Euclidean space, exact range closest-pair data structures are known for orthogonal boxes, simplices, halfspaces, and balls. For orthogonal queries in 31, one result gives 32 space, 33 preprocessing, and 34 query time (Chan et al., 2019). The same work proves a conditional lower bound for exact orthogonal RCP in 35, via reductions from set intersection and color uniqueness, implying that linear-space exact orthogonal RCP cannot beat 36 query time under the stated conjecture (Chan et al., 2019). A plausible implication is that approximation is the natural route to polylogarithmic-query range CP in higher dimensions, although that paper itself develops only exact structures.
High-dimensional exact 37 CP offers a further benchmark. One exact paper states that its contribution is not to approximation, but it emphasizes that approximate algorithms based on LSH and JL are already abundant, whereas exact high-dimensional 38 CP remains difficult (Gold et al., 2016). Approximate CP is therefore best understood as metric-dependent: it ranges from unnecessary, to natural, to indispensable, depending on whether the ambient structure already admits near-linear exact algorithms.
6. Practical systems and empirical profiles
Practical approximate CP has developed into a systems topic as well as an algorithmic one. PM-LSH is an in-memory framework for high-dimensional approximate NN and CP search in Euclidean space. Its experimental closest-pair results are reported as 39. On the Audio dataset it achieves
40
compared with NLJ at 41s and exact ratio 42 (Zheng et al., 2021). On MNIST it reports
43
while NLJ takes 44s (Zheng et al., 2021). On larger datasets such as GIST, PM-LSH reports
45
again substantially below exact nested-loop time (Zheng et al., 2021). The key point is not merely speed but a tunable balance among projected candidate count, radius thresholding, and exact verification.
MSPP targets large Euclidean or Pearson-similarity datasets stored on disk. On the real gene-expression datasets D1.1–D1.6, its reported A-Rank is 46, meaning that across the reported runs the best returned pair is the true closest pair (Saha et al., 2020). In time-series experiments with up to 47 points of length 48, it also reports A-Rank 49, with Top-50 and Top-100 accuracy remaining near 50 for smaller instances and degrading gradually as the datasets grow (Saha et al., 2020). Against motif-mining baselines, the same paper reports substantial speedups; for example, with 51 million points and 52 dimensions, JUMP takes 53 minutes while MSPP takes 54 minutes (Saha et al., 2020).
These systems expose a persistent engineering pattern. First, approximation is often implemented as candidate-generation plus exact re-ranking. Second, the practical quality metric is frequently recall or rank rather than a worst-case multiplicative bound on distance. Third, the most effective methods are highly model-specific: PM-LSH exploits projected Euclidean geometry and PM-trees, while MSPP exploits per-attribute discretization and repeated hash collisions.
Approximate CP therefore occupies two distinct but connected roles. In theory, it is a family of optimization and query problems with nuanced exact-versus-approximate separations and strong lower bounds in several regimes. In practice, it is a high-dimensional systems problem in which randomized filtering, candidate compression, and selective exact verification are the dominant design principles.