Low-Selectivity Filtered ANNS Techniques

• Low-selectivity filtered ANNS is defined for scenarios where only a tiny fraction (≤1%) of data satisfies structured filters, necessitating specialized indexing techniques.
• The approach addresses challenges inherent in traditional methods, such as graph disconnection and candidate explosion, by integrating filter-aware strategies.
• Recent advancements like Falconn++, Curator, and JAG demonstrate robust performance gains and improved recall through hybrid and partition-based indexing solutions.

Low-selectivity filtered approximate nearest neighbor search (ANNS) concerns the retrieval of nearest vector neighbors jointly subject to similarity and structured attribute predicates, in regimes where only a small fraction of the data (typically s ≤ 1%) passes the filter. This setting is prevalent in modern embedding-based search, recommendation, and vector database systems that must honor metadata, label, or range constraints alongside high-dimensional vector proximity. The low-selectivity regime fundamentally alters the performance characteristics and index design space, requiring dedicated techniques to prevent either coverage breakdown (as in graph-based methods) or prohibitive latency/candidate explosion (as in naive post-filtering approaches). Advancements in this domain include both algorithmic contributions (e.g., filter-integrated indexes, partitioning strategies) and empirical system-level findings on robust execution planning.

1. Formal Problem Definition and Selectivity Metrics

Let $S\subset \mathbb{R}^d$ be a dataset of $n$ vectors, each annotated with metadata $A_x$ (categorical, numerical, or multi-label attributes). For a filter predicate $\sigma$, let $$P_{(\sigma)}=\{x\in S:\ x\text{ satisfies }\sigma\}$$ be the filtered target subset, with selectivity $s=|P_{(\sigma)}|/n$. A filtered-ANNS query $(q, \sigma, k)$ seeks the $k$ nearest neighbors to query $q$ within $P_{(\sigma)}$, according to the desired similarity metric (e.g., Euclidean, angular).

Filter selectivity $\sigma$ formalizes the core difficulty: as $\sigma\rightarrow 0$, the fraction of qualifying vectors approaches zero. In vector database and IR literature, $\sigma\lesssim 1\%$ defines the "low-selectivity" regime, requiring algorithms to efficiently retrieve results from highly sparse subsets without full scans (Jin et al., 3 Jan 2026, Li et al., 22 Aug 2025, Amanbayev et al., 11 Feb 2026, Shi et al., 9 Sep 2025).

Candidate set size and recall metrics follow from standard ANNS definitions but must be understood relative to $P_{(\sigma)}$. Expected candidate set size after pure pre-filter is $E[|D_f|]=\sigma |D|$. Global-Local Selectivity (GLS) correlation, introduced as

$$\rho_q = \frac{\sigma_\ell/\sigma_g - 1}{\sigma_\ell/\sigma_g + 1}$$

with global selectivity $\sigma_g$ and local selectivity $\sigma_\ell$ for query $q$, further quantifies the spatial alignment (or depletion) of filter predicate with the geometric neighborhood (Amanbayev et al., 11 Feb 2026).

2. Challenges of Low-Selectivity Filtering in ANNS

Low selectivity poses distinct theoretical and practical challenges:

• Graph connectivity breakdown: In proximity-graph indices (HNSW, Vamana, etc.), inducing the subgraph on $P_{(\sigma)}$ typically produces disconnected or sparsely connected components when $s\rightarrow 0$. Maintaining adequate connectivity would necessitate increasing average degree to $m/s$, incurring quadratic or worse resource explosion (Jin et al., 3 Jan 2026, Amanbayev et al., 11 Feb 2026, Li et al., 22 Aug 2025).
• Candidate inefficiency in filtering sequences: In "post-filter" methods, ANNS is run unaware of the filter, necessitating large candidate pools to ensure at least $k$ valid results among $\sigma l\gtrsim k$, leading to $l\sim k/\sigma\rightarrow \infty$ and substantial slowdown (Shi et al., 9 Sep 2025).
• No universal index structure: Standard tree-, graph-, or hashing-based indexes exhibit differing points of failure under low selectivity: trees degenerate to $O(n\,s)$ leaf scans, graphs disconnect, and LSH or partition indexes see candidate set or probe growth exponential in $1/\sigma$ (Li et al., 22 Aug 2025).
• Dynamic, complex, or ad hoc predicates: Supporting arbitrary filters (multi-attribute, Boolean, or dynamically composed) exacerbates the problem, as most approaches are specialized for fixed-types or cannot pre-materialize indexes for all possible subpopulations (Jin et al., 3 Jan 2026, Xu et al., 10 Feb 2026).

3. Algorithmic Paradigms and Methodology Landscape

As systematized in (Shi et al., 9 Sep 2025), filtered ANNS strategies fall into three broad categories, with distinct behaviors under low selectivity:

Paradigm	Typical Indexing	Typical Query Behavior at Low $\sigma$
Filter-then-Search	Per-label listing; bitset/inverted index	Candidate set shrinks with $\sigma$; usually efficient; robust for containment/equality filters; can preclude graph methods
Search-then-Filter	Graph (HNSW), IVF	Required candidate set grows as $k/\sigma$; recall and QPS degrade sharply for small $\sigma$; major bottleneck for general filters
Hybrid-Search	Filter-aware graph or cluster	Built-in label/range constraints during index build/neighbor expansion; robust but often needs per-filter or multi-subgraph maintenance

Specialized techniques include:

• Pre-filter brute force for very small candidate pool ($|P_{(\sigma)}|<1000$): exact search is often optimal (Shi et al., 9 Sep 2025, Amanbayev et al., 11 Feb 2026).
• Attribute-aware entry points in graphs improve the probability of reachability for $C$ at low $s$ (Li et al., 22 Aug 2025).
• Partition- and tree-based dual indexes (e.g., Curator) build a shared base index with lightweight per-filter overlays to provide near-flat scaling with respect to $1/s$ (Jin et al., 3 Jan 2026).
• Hybrid edge-pruning strategies (Filtered-DiskANN, ACORN, etc.) partition or jointly prune neighbors to preserve navigability within valid regions (Li et al., 22 Aug 2025, Shi et al., 9 Sep 2025).
• Continuous filter/attribute distances and unified index construction (as in JAG) substitute hard binary filtering with continuous navigational gradients supporting robust connectivity for all predicate types (Xu et al., 10 Feb 2026).

4. Advances in Filter-Aware Indexing and Algorithms

4.1 Locality-Sensitive Filtering (Falconn++)

Falconn++ introduces a locality-sensitive filter for hashing-based ANNS. For cross-polytope LSH hash tables indexed by $h(q)=\pm r_{i*}$, the scheme filters bucket contents by only retaining vectors $x$ with $r_{i*}\cdot x\geq t$, thresholded to retain only the top $\alpha$-fraction (low selectivity) (Pham et al., 2022). Provably, for close/far point collisions, the probability of passing the filter for near neighbors is lower bounded, while far points are aggressively eliminated. The exponent $\rho'$ governing query time satisfies $\rho' < \rho$ (original Falconn), improving asymptotic performance. Empirically, speedups of $3\times$ to $10\times$ over Falconn, and superior multi-threaded scaling relative to HNSW, are reported at high recall ($\geq 90\%$).

4.2 Partition-Based Dual Indexing (Curator)

Curator applies hierarchical $k$-means to build a shared clustering tree, embedding per-label and per-predicate subindexes as buffers and Bloom filters. For a label or predicate of low selectivity $s$, search is restricted to leaves indicated by Bloom filter presence, yielding query time $O((1/s)^\theta\log n)$ for some $\theta<1$. The inclusion of on-the-fly construction for complex predicates (virtual labels) minimizes the overhead of arbitrary filter evaluation. Empirical measurements demonstrate up to $20.9\times$ query-latency reduction at $s=0.001$, with build and memory overheads below $6\%$ (Jin et al., 3 Jan 2026).

4.3 Filter-Agnostic Graph Methods (JAG)

JAG defines joint "filter" and "attribute" distances, leveraging lexicographic ordering and multi-threshold edge construction to ensure robust connectivity across all selectivity spectra and filter types (label, range, subset, Boolean). Instead of hard pre-filtering, the query traverses the graph greedily according to a continuous $d_F(a, f)$, ensuring search does not terminate prematurely even if valid points are sparse. Experimental results show that baselines stagnate at recall $<0.8$ in the extreme low-selectivity regime ($s<10^{-3}$), whereas JAG attains perfect recall at QPS values an order of magnitude higher ($QPS>1000$ at recall $0.8$) (Xu et al., 10 Feb 2026).

4.4 Hybrid Graph–Partition Approaches

Empirical benchmarking in FAISS, Milvus, and pgvector supports the partitioned index approach (e.g., IVFFlat), showing that for $\sigma_g\lesssim 5\%$, IVFFlat QPS exceeds that of HNSW by a factor of $2\times$, while recall is $0.60$ versus $0.40$ at $k=10$, $\sigma_g=1\%$ (Amanbayev et al., 11 Feb 2026). Systems with hybrid execution, e.g., Milvus’s adaptive brute-force fallback, achieve robust recall at the expense of a "latency floor." Cost-based optimizers in systems like pgvector may underperform unless filter attributes are indexed and plan selection is forced manually.

5. Empirical Trends and Best Practices for Low-Selectivity Queries

Across extensive benchmarks (Li et al., 22 Aug 2025, Shi et al., 9 Sep 2025, Amanbayev et al., 11 Feb 2026), several patterns hold in the $s\leq 1\%$ regime:

• Pre-filtering followed by brute-force search is optimal when $|C|$ is very small ($<1000$).
• Post-filter methods (HNSW, IVF-PQ, etc.) see recall and QPS degrade $\propto 1/s$ or worse as $s\rightarrow 0$, with recall ceilings often below $0.9$.
• Graph-based hybrid or filter-aware methods maintain higher recall, but only if edge pruning and entry-point selection are cognizant of attribute structure.
• Dual-index, partition, and tree overlays (e.g., Curator, IVFFlat with cluster filtering) provide near-flat or sublinear query-scaling with $1/s$, offering orders of magnitude better throughput.
• JAG and threshold-based graph methods avoid navigational dead-ends for all predicates, combining filter-robustness with vector similarity, thus yielding high recall across $s\in[10^{-5},1]$.
• Parameter tuning: Partition count, cluster size, beam width, and probe parameters must be (re-)tuned to target recall at low $s$; optimal values shift when $k$ grows or attribute–vector correlations change.

6. Practical Recommendations and System Integration

Key operational guidelines emerging from recent research:

• For $s\leq 1\%$, prefer partition-based indexes (IVFFlat, Curator) or per-filter overlays if predicates are known or can be cached (Jin et al., 3 Jan 2026, Amanbayev et al., 11 Feb 2026).
• Use filter-aware graph algorithms (e.g., JAG, Filtered-DiskANN, ACORN) only if connections preserving $k$-hop reachability in $P_{(\sigma)}$ can be maintained at manageable cost.
• For mixed or unknown selectivity, maintain hybrid indices, switch execution paths by estimating $\sigma$ at query time, or use adaptive fallback to exact scan below a threshold (Amanbayev et al., 11 Feb 2026).
• Pre-index filter attributes (e.g., B-trees in SQL systems) to exploit filter-first planning and avoid spurious recall/latency trade-offs (Amanbayev et al., 11 Feb 2026).
• Always monitor global-local selectivity correlation $\rho_q$ for challenging queries and dynamically tune execution plans or search parameters when $|\rho_q|\gg 0$ (Amanbayev et al., 11 Feb 2026).
• Evaluate and tune edge-pruning parameters, partition counts, and buffer capacities specifically for the low-selectivity workload profile (Li et al., 22 Aug 2025, Shi et al., 9 Sep 2025).

7. Limitations and Open Research Directions

Despite recent advances, several problems remain:

• Theorizing optimal query-time/space tradeoffs for arbitrary (dynamic, ad hoc) predicates and providing closed-form cost models $T(s)$ for practical index classes remains unresolved (Li et al., 22 Aug 2025).
• No index achieves worst-case sublinear performance with full coverage for arbitrary filters as $s\rightarrow 0$; most techniques incur switches to brute-force within the rarest subpopulations.
• Auto-tuning of all key hyperparameters (e.g., cluster/partition count, graph degree, probe width) under time-varying and workload-driven $s$ is unsolved at scale (Li et al., 22 Aug 2025).
• Ensuring robustness against adversarial or highly skewed attribute–vector correlations (GLS $\rho_q\ll 0$) is an open area, with only preliminary adaptivity in current systems (Amanbayev et al., 11 Feb 2026).
• Efficient support for complex, user-defined predicates (including composite Boolean logic and continuous attribute mixtures) without exponential subindex proliferation calls for data structures that combine partitioning, filter-aware graph augmentation, and perhaps continuous filter-distance models as in JAG (Xu et al., 10 Feb 2026).

Continued rigorous benchmarking (e.g., unified benchmarks (Shi et al., 9 Sep 2025), extensible system testbeds (Amanbayev et al., 11 Feb 2026)) and public algorithm implementations are facilitating comparative progress and hybrid deployments across the research and engineering spectrum.