BM25-V: Variants and Interpretations in IR
- BM25-V is a term describing a family of BM25-derived retrieval methods that vary by altering representations, scoring mechanisms, or modalities.
- These methods retain core features such as term frequency, inverse document frequency, and length normalization while incorporating semantic interpretation and query augmentation.
- BM25-V offers flexible, interpretable retrieval approaches with high fidelity to dense models, applicable across text, image, and latent feature retrieval.
Searching arXiv for BM4 OR \45-V and closely related usages to ground the article in papers. arxiv_search(query="4BM25-V OR \4"BM4 OR \45-V\"4 OR \4"BM4 OR \45 V\"4 OR \4"semantic variant of BM4 OR \45\"4 OR \4"visual words meet BM4 OR \45\"", max_results=4 OR \4BM25-V OR \4, sort_by="submittedDate") BM4 OR \45-V is a non-standard label used in recent retrieval literature for several technically distinct constructions. Taken together, these works suggest not a single canonical algorithm but a family of BM4 OR \45-related ideas that preserve some combination of term-frequency-like evidence, inverse document frequency, length normalization, sparse inverted-index retrieval, or BM4 OR \45-compatible interpretability while altering the representation being scored, the model being explained, or even the retrieval modality itself (&&&4BM25-V OR \4&&&, &&&4 OR \4&&&, &&&4 OR \4&&&, &&&4 OR \4&&&, Han et al., 6 Mar 2026). In some contexts, BM4 OR \45-V denotes a sparse surrogate explanation of dense ranking; in others, a semantic BM4 OR \45-like circuit identified inside a cross-encoder; in others still, a learned query-side augmentation of BM4 OR \45 or a visual-word image retriever. Conversely, some recent BM4 OR \45-based systems explicitly introduce no BM4 OR \45-V variant at all (Pokrywka, 2024).
4 OR \4. Terminological status and major senses
The literature does not treat BM4 OR \45-V as a standardized IR term with a single agreed formula. Instead, the same label has been attached to multiple different methods, each retaining a recognizable BM4 OR \45 core while changing what is matched, how the query is represented, or what explanatory role BM4 OR \45 plays.
| Sense of BM4 OR \45-V | Core mechanism | Representative paper |
|---|---|---|
| Sparse surrogate explanation | Optimize an equivalent sparse query so BM4 OR \45 approximates a dense ranked list | (&&&4BM25-V OR \4&&&) |
| Semantic BM4 OR \45 circuit | Identify soft-TF-, saturation-, length-, and IDF-like components inside a cross-encoder | (&&&4 OR \4&&&) |
| BM4 OR \45 score injection | Insert the BM4 OR \45 score as text into a cross-encoder input | (&&&4 OR \4&&&) |
| Learned sparse query augmentation | Predict sparse query expansion and re-weighting for BM4 OR \45 end-to-end | (&&&4 OR \4&&&) |
| Visual-word retrieval | Apply Okapi BM4 OR \45 to SAE-derived visual words from ViT patch features | (Han et al., 6 Mar 2026) |
This multiplicity matters because the label can easily be misread as referring to a single retrieval formula. Recent work on Polish passage retrieval, for example, uses standard OKAPI BM4 OR \45 as a first-stage retriever and explicitly does not introduce any BM4 OR \45-V or custom BM4 OR \45 formulation; BM4 OR \45 is used conventionally before reranking with an ensemble of cross-encoders (Pokrywka, 2024). A careful reading of context is therefore necessary whenever the term appears.
4 OR \4. BM4 OR \45-V as a sparse surrogate for dense ranking
In "Explain like I am BM4 OR \45," BM4 OR \45-V is best understood as a local interpretability method for dense retrieval rather than a new first-stage retriever (&&&4BM25-V OR \4&&&). The central object is an equivalent query PRESERVED_PLACEHOLDER_4BM25-V OR \4: a sparse query over the vocabulary extracted from the dense model’s top-PRESERVED_PLACEHOLDER_4 OR \4^ documents, chosen so that BM4 OR \45 reproduces the dense model’s ranked list as closely as possible. The optimization target is
PRESERVED_PLACEHOLDER_4 OR \4^
where PRESERVED_PLACEHOLDER_4 OR \4^ is the dense model’s top- list, is the sparse retriever, and is a ranked-list similarity measure. The paper uses Jaccard and especially Rank-Biased Overlap.
This formulation differs from pseudo-relevance feedback and RM4 OR \4^ in two ways. First, the objective is explicitly ranked-list fidelity to a target neural model, not generic expansion quality. Second, the resulting equivalent query may omit original query terms, because fidelity to the dense model’s behavior takes precedence over preserving the original wording. BM4 OR \45 becomes an interpretable sparse surrogate whose vocabulary-level behavior serves as a verbalization of the dense model’s implicit concept set.
Because the search over candidate sparse queries is NP-complete, the paper uses a best-first-search-style discrete exploration rather than exact optimization. The search starts from the empty query, explores states obtained by adding or removing terms, restricts the candidate vocabulary to the dense model’s top- documents, favors additions according to normalized RM4 OR \4^ weights, and discourages removing high-tf-idf terms. The method is evaluated on MS MARCO passage ranking with TREC DL 4 OR \4BM25-V OR \4 OR \49 topics and targets including ANCE, ColBERT, MonoT5, DeepCT + ColBERT, and ColBERT + BERT-based query expansion (&&&4BM25-V OR \4&&&).
The reported fidelity and effectiveness are substantial. BFS-based equivalent queries achieve RBO up to $0.5194$ and Jaccard up to $0.5327$ for MonoT5, and BM4 OR \45 run with the generated PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \4^ can retain up to about PRESERVED_PLACEHOLDER_4 OR \4 OR \4^ of the target model’s nDCG. The same paper also reports an average latency of about PRESERVED_PLACEHOLDER_4 OR \4 OR \4^ seconds and notes that failure cases arise when the vocabulary of the dense model’s top-PRESERVED_PLACEHOLDER_4 OR \4 OR \4^ neighborhood is too limited. BM4 OR \45-V in this sense is therefore a local, approximate, query-level explanation method: human-readable, model-specific, and tied to ranked-list agreement rather than internal token attributions.
4 OR \4. BM4 OR \45-V as a semantic BM4 OR \45 circuit inside a cross-encoder
A very different use of the term appears in "Cross-Encoder Rediscovers a Semantic Variant of BM4 OR \45" (&&&4 OR \4&&&). Here BM4 OR \45-V is not introduced as a separate benchmark algorithm; rather, it names the mechanistic claim that a MiniLM cross-encoder implements a semantic variant of BM4 OR \45. The paper argues that the model computes the classical BM4 OR \45 ingredients—term frequency, term saturation, document length normalization, and inverse document frequency—but in soft semantic form rather than through exact lexical counts.
The proposed circuit has localized functional components. Early-layer Matching Heads compute a Matching Score behaving like semantic TF while also reflecting term saturation and document-length effects. Two middle-layer Contextual Query Representation Heads, 8.4 OR \4BM25-V OR \4^ and 9.4 OR \4 OR \4, redistribute soft-TF information from higher-IDF query terms across the query representation. Four layer-4 OR \4BM25-V OR \4^ Relevance Scoring Heads, 4 OR \4BM25-V OR \4.4 OR \4, 4 OR \4BM25-V OR \4.4, 4 OR \4BM25-V OR \4.7, and 4 OR \4BM25-V OR \4.4 OR \4BM25-V OR \4, read out those signals in an IDF-sensitive way. The paper further identifies a dominant rank-4 OR \4^ embedding component, PRESERVED_PLACEHOLDER_4 OR \44, whose values correlate about PRESERVED_PLACEHOLDER_4 OR \45 with MS MARCO IDF values, leading the authors to interpret it as a one-dimensional IDF dictionary (&&&4 OR \4&&&).
The empirical support comes from path patching, attention-pattern analysis, axiom-based diagnostics, ablation, and linear reconstruction. On the TFC4 OR \4^ and STMC4 OR \4^ diagnostic datasets, the patching importance values for the identified relevance heads have correlation PRESERVED_PLACEHOLDER_4 OR \46, PRESERVED_PLACEHOLDER_4 OR \47, which the paper interprets as evidence that exact and semantic matches are processed similarly. Matching Heads show much stronger correlation between attention and semantic similarity than other heads, with average Pearson correlation PRESERVED_PLACEHOLDER_4 OR \48 versus PRESERVED_PLACEHOLDER_4 OR \49. Mean-ablation of Matching Heads causes large score drops: on TFC-perturbed samples, the average value drops from PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \4^ to PRESERVED_PLACEHOLDER_4 OR \4 OR \4; on STMC-perturbed samples, from PRESERVED_PLACEHOLDER_4 OR \4 OR \4^ to PRESERVED_PLACEHOLDER_4 OR \4 OR \4. A linear regression using PRESERVED_PLACEHOLDER_4 OR \44^ and Matching Scores reaches Pearson correlation PRESERVED_PLACEHOLDER_4 OR \45 with the cross-encoder’s relevance scores, exceeding BM4 OR \45 under the tuned parameters at PRESERVED_PLACEHOLDER_4 OR \46; across 4 OR \4 OR \4^ IR datasets, the paper reports median Pearson PRESERVED_PLACEHOLDER_4 OR \47, median Spearman PRESERVED_PLACEHOLDER_4 OR \48, and NDCG@4 OR \4BM25-V OR \4^ alignment PRESERVED_PLACEHOLDER_4 OR \49 (&&&4 OR \4&&&).
The significance of this usage is interpretive rather than procedural. BM4 OR \45-V denotes a mechanistically localized semantic scoring circuit, which suggests that at least one cross-encoder has not simply learned an arbitrary ranking function but has rediscovered BM4 OR \45-like relevance computation in a semantically softened form.
4. Query-side BM4 OR \45-V constructions
Two additional lines of work use BM4 OR \45-V to denote explicitly query-side modifications rather than document-side or model-internal reinterpretations.
In "Injecting the BM4 OR \45 Score as Text Improves BERT-Based Re-rankers," the relevant model family is CEPRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \4, which inserts the BM4 OR \45 score directly into the cross-encoder input as text (&&&4 OR \4&&&). The standard cross-encoder input
PRESERVED_PLACEHOLDER_4 OR \4 OR \4^
is changed to PRESERVED_PLACEHOLDER_4 OR \4 OR \4. The paper studies several representations of the score and finds that global Min-Max normalization followed by integer conversion works best. On MSMARCO dev, the injected model improves all four tested cross-encoders: BERT-Base rises from MRR@4 OR \4BM25-V OR \4^ PRESERVED_PLACEHOLDER_4 OR \4 OR \4^ to PRESERVED_PLACEHOLDER_4 OR \44, BERT-Large from PRESERVED_PLACEHOLDER_4 OR \45 to PRESERVED_PLACEHOLDER_4 OR \46, DistilBERT from PRESERVED_PLACEHOLDER_4 OR \47 to PRESERVED_PLACEHOLDER_4 OR \48, and MiniLM from PRESERVED_PLACEHOLDER_4 OR \49 to 4BM25-V OR \4. In the exact-matching probe where non-query passage words are masked, BM4 OR \45 scores 4 OR \4, BERT-Base CAT scores 4 OR \4, and BERT-Base BM4 OR \45CAT scores 4 OR \4. Integrated Gradients also assigns the BM4 OR \45 token high attribution, with mode rank 4, indicating that the model actively uses the injected lexical score (&&&4 OR \4&&&).
In "BM4 OR \45 Query Augmentation Learned End-to-End," BM4 OR \45-V refers to a learned sparse query expansion and re-weighting framework that preserves BM4 OR \45’s inverted-index behavior (&&&4 OR \4&&&). Standard BM4 OR \45 is written as 5, where 6 is the IDF vector and 7 is the BM4 OR \45 document term-frequency vector. The learned model predicts an augmentation vector 8 and a term-weight vector 9, producing the score
4BM25-V OR \4^
The augmentation is learned end-to-end with a contrastive retrieval objective and a frequency-weighted sparsity regularizer. Using distilbert-base-uncased, the method improves over BM4 OR \45 while staying close to BM4 OR \45 latency: on Natural Questions, Acc@5 rises from 4 OR \4^ for BM4 OR \45 (Pyserini) to 4 OR \4; on EntityQuestions, from 4 OR \4^ to 4; on MSMARCO, NDCG@4 OR \4BM25-V OR \4^ rises from 5 to 6 and Recall@4 OR \4BM25-V OR \4BM25-V OR \4^ from 7 to 8, with latency 9s versus 4BM25-V OR \4s for BM4 OR \45 (Pyserini) (&&&4 OR \4&&&).
These two query-side constructions are methodologically unrelated, but both retain BM4 OR \45 as a sparse lexical substrate while giving the query additional structure. One exposes BM4 OR \45 to the reranker as an explicit tokenized numeric signal; the other learns a richer sparse query representation before retrieval.
5. BM4 OR \45-V beyond lexical text: visual and latent vocabularies
The most explicit non-textual instantiation appears in "Visual Words Meet BM4 OR \45: Sparse Auto-Encoder Visual Word Scoring for Image Retrieval" (Han et al., 6 Mar 2026). BM4 OR \45-V here is a sparse image retrieval method that applies Okapi BM4 OR \45 to visual words derived from SAE activations on frozen ViT patch features. The backbone uses final-layer SigLIP4 OR \4^ patch features 4 OR \4^ with 4 OR \4^ and 4 OR \4. An SAE with expansion factor 4 yields a visual vocabulary of 5 dimensions; patch-level sparsity is 6, and post-pooling sparsity is also 7. The pooled sparse image vector is treated as a bag of visual words, with term frequency given by visual-word activation, document length by 8, and document frequency by the number of reference images activating the corresponding SAE dimension (Han et al., 6 Mar 2026).
The key empirical justification is that these visual words exhibit a Zipfian-like document-frequency distribution. Across seven datasets, the paper reports power-law fits with 9 and exponents 4BM25-V OR \4. It also notes that head dimensions fire in more than 4 OR \4^ of images, only about 4 OR \4–4 OR \4^ of active dimensions are stop-word-like pervasive dimensions, and 4–5 of active dimensions have IDF 6. BM4 OR \45-V serves as the first stage of a two-stage system: it retrieves candidates sparsely, then reranks the top 7 with dense cosine similarity from the same frozen backbone. First-stage recall is high—Recall@4 OR \4BM25-V OR \4BM25-V OR \4^ ranges from 8 to 9, and Recall@4 OR \4BM25-V OR \4BM25-V OR \4^ is at least $0.5194$4BM25-V OR \4^ across all seven benchmarks. After reranking, average R@4 OR \4^ is $0.5194$4 OR \4^ versus a dense baseline of $0.5194$4 OR \4, a drop of about $0.5194$4 OR \4^ percentage points on average; on DTD and Flowers-4 OR \4BM25-V OR \4 OR \4, the two-stage system improves dense retrieval by $0.5194$4 and $0.5194$5, respectively. The sparse representation is also reported as about $0.5194$6 smaller than float4 OR \4 OR \4^ dense embeddings when $0.5194$7 (Han et al., 6 Mar 2026).
A closely related but separately named development is "Latent Terms," which shows that dense retrievers contain trivially extractable BM4 OR \45-ready latent vocabularies (&&&4 OR \44&&&). There, a frozen dense retriever is paired with a Sparse Autoencoder of latent vocabulary size $0.5194$8 and top-$0.5194$9 sparsity $0.5327$4BM25-V OR \4, trained only with reconstruction loss on unlabeled text. The resulting latent features have approximately Zipfian collection statistics and can be scored effectively with BM4 OR \45 after sum-pooling and a square-root transform. A plausible implication is that the visual-word formulation of BM4 OR \45-V belongs to a broader movement in which BM4 OR \45 is increasingly applied to learned sparse vocabularies rather than only to surface words.
6. Relation to standard BM4 OR \45, neighboring variants, and recurrent misconceptions
One recurrent misconception is that BM4 OR \45-V denotes any modern BM4 OR \45-based retrieval pipeline. The literature does not support that reading. In the Poleval 4 OR \4BM25-V OR \4 OR \4 OR \4^ winning system for Polish passage retrieval, BM4 OR \45 is simply standard OKAPI BM4 OR \45 with $0.5327$4 OR \4, $0.5327$4 OR \4, and $0.5327$4 OR \4, preceded by tokenization with nltk.tokenize.word_tokenize, lowercasing, stemming with pystempel using the Polimorf stemmer, and Polish stopword removal (Pokrywka, 2024). BM4 OR \45 is used both for inference-time candidate generation and for drawing $0.5327$4 negative query-passage pairs per positive passage from the top $0.5327$5 BM4 OR \45 results during reranker training. Candidate pools are domain-specific—top $0.5327$6 for wiki-trivia, top $0.5327$7 for legal-questions, and all $0.5327$8 passages for allegro-faq—and BM4 OR \45 alone scores $0.5327$9 NDCG@4 OR \4BM25-V OR \4^ on test-A and PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \4BM25-V OR \4^ on test-B, while the final cross-encoder ensemble reaches PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \4 OR \4^ and PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \4 OR \4, respectively. The paper explicitly does not propose a BM4 OR \45-V variant (Pokrywka, 2024).
Another source of ambiguity is that other genuine BM4 OR \45 modifications are usually named differently. On BRIGHT, "Lighting the Way for BRIGHT" shows that a major reproduction discrepancy comes from query representation: standard Anserini/Pyserini BM4 OR \45 uses a bag-of-words query vector, whereas BRIGHT’s published baseline applies BM4 OR \45 weighting on the query side itself (&&&4 OR \47&&&). The overall average nDCG@4 OR \4BM25-V OR \4^ is PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \4 OR \4^ for BoW, PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \44^ for BoW accurate, PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \45 for query-side BM4 OR \45, PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \46 for query-side BM4 OR \45 accurate, and PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \47 for BRIGHT original BM4 OR \45. The paper concludes that query-side weighting matters more than Lucene’s approximate versus exact length normalization in this long-query regime, especially for roughly PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \48–PRESERVED_PLACEHOLDER_4 OR \4BM25-V OR \49-token queries. This is a meaningful BM4 OR \45 variant, but it is called query-side BM4 OR \45, not BM4 OR \45-V (&&&4 OR \47&&&).
Likewise, "BMX" is an explicit extension of BM4 OR \45 rather than a BM4 OR \45-V paper (&&&4 OR \49&&&). It augments the BM4 OR \45 TF-IDF backbone with entropy-weighted similarity and semantic enhancement through weighted query augmentation. The method introduces parameters PRESERVED_PLACEHOLDER_4 OR \4 OR \4BM25-V OR \4^ and PRESERVED_PLACEHOLDER_4 OR \4 OR \4 OR \4, a token entropy term PRESERVED_PLACEHOLDER_4 OR \4 OR \4 OR \4, a similarity term PRESERVED_PLACEHOLDER_4 OR \4 OR \4 OR \4, and an augmented-query scoring function that aggregates the original query with LLM-generated related queries. BMPRESERVED_PLACEHOLDER_4 OR \4 OR \44^ is thus a formally named BM4 OR \45 extension in its own right, not a synonym for BM4 OR \45-V (&&&4 OR \49&&&).
The overall lesson is terminological as much as technical. BM4 OR \45-V is best treated as a context-dependent label whose meaning must be recovered from the specific paper: sparse surrogate explanation, semantic BM4 OR \45 circuit, query-side neural augmentation, or visual-word retrieval are all attested uses, whereas many strong BM4 OR \45 systems and several important BM4 OR \45 variants do not use the term at all.