Papers
Topics
Authors
Recent
Search
2000 character limit reached

misi: a Metric Inverted Sample Index

Published 27 Aug 2026 in cs.IR | (2608.27422v1)

Abstract: We present misi, an inverted index for approximate nearest-neighbor search over general metric spaces whose vocabulary is a random sample of the database, of size proportional to nn. Each object is represented by its kbk_b nearest sample points, found by a pluggable inner index over the sample; queries are answered by an idf-weighted shared-neighbor vote followed by exact verification of CC candidates. The construction generalizes the NAPP index from a constant number of pivots to a linear-size vocabulary, which keeps posting lists at constant expected length ρ=kb/αρ= k_b/α as nn grows and turns the index into a combinator: any high-recall index on αnαn points yields an index on nn points, for any metric. A probabilistic model gives a recall guarantee -- kbk_b logarithmic in nn over the overlap gap suffices, with a verification budget the index itself estimates -- and a matching limit: the vote cannot resolve overlap differences below order 1/kb1/\sqrt{k_b}. The design's strengths are structural: construction is nn independent searches -- embarrassingly parallel, deterministic, 5,2505{,}250 s for $108$ vectors on 64 cores, 3.7×3.7\times faster than a matched-recall graph build -- it streams under an enforced 3 GiB cap, and the portable artifact serves $108$ vectors from NVMe within an enforced 8 GB budget, below the working floor of the SSD-graph baseline. Its cost is query-time work: saturated graph baselines answer $6$-16×16\times faster in RAM, and the verification budget for 0.99 recall grows as n<sup>0.30n<sup>{0.30}. All results carry seeds, saturation sweeps and full configurations, are generated from run manifests, and include measured negative results. The intended applications weight construction cost, determinism, memory footprint, or black-box metrics over peak throughput: frequently rebuilt corpora, batch similarity workloads, constrained-memory serving.

Authors (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.