---
title: Orthogonal Vectors Problem (OV)
url: https://www.emergentmind.com/topics/orthogonal-vectors-problem-ov
type: topic
---

# Orthogonal Vectors Problem (OV)

Searching arXiv for Orthogonal Vectors and related recent work.
Searching arXiv for exact paper 1811.12017.
The Orthogonal Vectors problem, usually abbreviated \(\textsf{OV}\), is a Boolean-vector decision problem that asks whether a given collection contains a pair of vectors with inner product zero. In its standard red–blue formulation, the input consists of two sets \(A,B \subseteq \{0,1\}^d\) of size \(n\), and the task is to decide whether there exists \((a,b)\in A\times B\) such that \(a\cdot b=0\) [1811.12017]. In the low-dimensional regime \(d=c\log n\), \(\textsf{OV}\) is a central benchmark in fine-grained complexity because a naive algorithm runs in \(O(n^2 d)\), hence \(O(n^2\log n)\), while the Orthogonal Vectors Conjecture posits that no truly subquadratic algorithm exists in this regime [1811.12017]. The problem serves simultaneously as a canonical hardness source, a hub for equivalence results, a target for data-structure lower bounds, and a testbed for average-case, circuit, and low-dimensional algorithmic techniques [1811.12017][1709.05294].

## 1. Formal definition and parameter regimes

The monochromatic formulation of \(\textsf{OV}\) asks, given \(v_1,\dots,v_n \in \{0,1\}^d\), whether there exist \(i\neq j\) such that
\[
\langle v_i,v_j\rangle = \sum_{k=1}^d v_i[k]v_j[k] = 0.
\]
Equivalently, two vectors are orthogonal when they have no coordinate where both entries are \(1\) [1811.12017]. The red–blue formulation, used extensively in reductions, takes two sets \(A,B \subseteq \{0,1\}^d\) with \(|A|=|B|=n\) and asks whether some \(a\in A\) and \(b\in B\) satisfy \(a\cdot b=0\) [1811.12017].

The literature distinguishes several dimensional regimes. The low-dimensional or sparse regime is \(d=c\log n\) for arbitrary constant \(c\), or more generally \(d=n^{o(1)}\) in geometric variants [1811.12017]. A moderate-dimensional regime takes \(d=n^\delta\) for constant \(\delta>0\) [1811.12017][1805.08554]. These regimes matter because both algorithms and conjectured lower bounds are highly sensitive to \(d\). The naive algorithm checks all \(n^2\) pairs and computes each inner product in \(O(d)\), giving \(O(n^2d)\) time, which becomes \(O(n^2\log n)\) for \(d=O(\log n)\) [1811.12017].

A standard fine-grained notion is “truly subquadratic time”: a problem is solvable in truly subquadratic time if there exists \(\delta>0\) such that for every constant \(c\), instances with \(d=c\log n\) can be solved in \(O(n^{2-\delta})\) time [1811.12017]. In geometric settings, the analogous notion is a \((1+\varepsilon)\)-approximation in \(O(n^{2-\delta})\) time when dimension and coordinate bit-length are \(n^{o(1)}\) [1811.12017].

The \(k\)-OV generalization takes \(k\) sets \(L_1,\dots,L_k\) of \(n\) binary vectors and asks whether there is a tuple \(v_1\in L_1,\dots,v_k\in L_k\) whose coordinatewise product is zero in every coordinate [2503.21951][2507.11098]. This higher-arity variant is important in average-case hardness and low-dimensional algorithms, but the classical fine-grained literature centers on the \(k=2\) case.

## 2. Orthogonal Vectors Conjecture and its fine-grained role

The Orthogonal Vectors Conjecture, or OVC, is commonly stated as follows: for some \(\varepsilon>0\) and all sufficiently large \(n\), there is no algorithm solving \(\textsf{OV}\) on \(n\) vectors in dimension \(d=\Theta(\log n)\) in time \(O(n^{2-\varepsilon})\) [1811.12017]. A broader formulation says that for \(d=\omega(\log n)\), \(\textsf{OV}\) requires \(n^{2-o(1)}\) time [1709.05294].

OVC is implied by the Strong Exponential Time Hypothesis. The standard chain is
\[
\text{SETH} \Rightarrow \text{low-dimensional OVC} \Rightarrow \text{moderate-dimensional OVC},
\]
with reductions due to Williams and later work [1811.12017][1805.08554]. In moderate dimensions, the conjecture states that there are no \(\varepsilon,\delta>0\) such that \(\textsf{OV}\) with \(D=N^\delta\) can be solved in \(O(N^{2-\varepsilon})\mathrm{poly}(D)\) time [1805.08554].

Within fine-grained complexity, \(\textsf{OV}\) functions as a hardness core for quadratic-time phenomena. Many conditional lower bounds for problems in strings, graphs, computational geometry, formal languages, and dynamic algorithms reduce from \(\textsf{OV}\) [1805.08554]. Before large equivalence results were known, \(\textsf{OV}\) was mainly used in one direction: if a target problem admitted a truly subquadratic algorithm, then OVC would fail. Subsequent work showed that in low dimensions, many apparently harder inner-product and geometric problems are in fact equivalent to \(\textsf{OV}\) under truly-subquadratic reductions [1811.12017].

The importance of \(\textsf{OV}\) is not limited to worst-case running time. The problem also appears in data structures, where the online query version becomes equivalent to Partial Match and related tasks [1811.12017][1710.00586][2605.04798]. It appears in circuit complexity as an explicit function with near-optimal branching-program and formula lower bounds [1709.05294]. It also appears in average-case fine-grained hardness through parity variants and planted distributions [2503.21951][2505.00206].

## 3. Equivalence classes around OV

A central development is the identification of a broad equivalence class around low-dimensional \(\textsf{OV}\). The paper "An Equivalence Class for Orthogonal Vectors" shows that, in dimension \(d=O(\log n)\), the following problems are either all solvable in truly subquadratic time or none are: \(\textsf{OV}\), \(\textsf{Min-IP}\), \(\textsf{Max-IP}\), \(\textsf{Exact-IP}\), constant-factor approximate \(\textsf{Min-IP}\) and \(\textsf{Max-IP}\), additive approximate \(\textsf{Max-IP}\), additive approximate Jaccard-Index-Pair, approximate bichromatic \(\ell_p\)-Closest Pair for constant \(p\in[1,2]\), and approximate \(\ell_p\)-Furthest Pair in dimension \(n^{o(1)}\) [1811.12017].

The Boolean inner-product problems are defined on red–blue sets \(A,B\subseteq\{0,1\}^d\). For example,
\[
\textsf{Exact-IP}_{n,d}:\ \exists (a,b)\in A\times B\text{ with }a\cdot b = m?
\]
and
\[
\textsf{Max-IP}_{n,d} = \max_{a\in A,b\in B} a\cdot b,\qquad
\textsf{Min-IP}_{n,d} = \min_{a\in A,b\in B} a\cdot b
\]
[1811.12017]. Since \(\textsf{OV}\) is equivalent to deciding whether \(\mathrm{Min}(A,B)=0\), reductions among these problems are immediate in one direction. The nontrivial direction is showing that \(\textsf{Exact-IP}\), \(\textsf{Max-IP}\), and approximation variants reduce back to \(\textsf{OV}\) in the same low-dimensional regime [1811.12017].

Two reduction frameworks underpin these equivalences. The first uses efficient \(\Sigma_2^{cc}\) communication protocols. If a Boolean predicate \(F(x,y)\) has a small \(\Sigma_2\) communication protocol, then the corresponding satisfying-pair problem can be reduced to a small number of \(\textsf{OV}\) instances, with only \(n^{o(1)}\) blowup and dimension preserved at \(O(\log n)\) [1811.12017]. Inner-product equality admits such a protocol, yielding \(\textsf{Exact-IP}\to\textsf{OV}\), and from there the rest of the Boolean IP family follows [1811.12017].

The second framework uses locality-sensitive hashing. If a metric or similarity predicate admits a \((p_1,p_2)\)-sensitive LSH family with gap \(\Delta=p_1-p_2\), then the corresponding satisfying-pair problem reduces to additive \((\Delta/8)\cdot d\) approximation to \(\textsf{Max-IP}\) in dimension \(O(\Delta^{-2}\log n)\) [1811.12017]. Since \(\ell_p\) metrics for \(p\in[1,2]\) and Jaccard index admit LSH families, approximate closest pair, furthest pair, and Jaccard pair become equivalent to additive \(\textsf{Max-IP}\), hence to \(\textsf{OV}\) [1811.12017].

The same paper also establishes a data-structure equivalence: there is a \(\mathrm{poly}(n)\)-space, \(n^{1-\delta}\)-query-time data structure for Partial Match on \(\{0,1\}^{O(\log n)}\) if and only if such a data structure exists for \((1+\varepsilon)\)-approximate nearest neighbor search in \(\ell_p\), \(p\in[1,2]\) [1811.12017]. This situates \(\textsf{OV}\) at the center of a larger online/offline equivalence landscape.

In moderate dimensions, the equivalence picture becomes more fragmented. The same work shows that moderate-dimensional \(\textsf{OV}\) is truly-subquadratically equivalent to moderate-dimensional approximate \(\textsf{Min-IP}\), while \(\textsf{Max-IP}\), \(\textsf{Min-IP}\), and \(\textsf{Exact-IP}\) form another equivalence class [1811.12017]. Whether these moderate-dimensional classes fully merge remains open in that paper.

## 4. Algorithms and parameterized improvements

The classical brute-force baseline for \(\textsf{OV}\) is \(O(n^2 d)\), or \(O(n^2\log n)\) in low dimension [1811.12017]. For small \(d\), folklore algorithms also exploit enumeration over all \(2^d\) subsets, giving \(O(2^d n)\) time in the set formulation [2507.11098]. A significant line of work aims to reduce the \(2^d\) dependence in low dimension and to improve the exponent on \(n\) in the \(d=c\log n\) regime.

For low-dimensional \(2\)-OV, Williams gave a \(\tilde O(1.35^d \cdot n)\)-time algorithm via a succinct equality-rank decomposition of the disjointness matrix [2507.11098]. A later combinatorial algorithm improves this to randomized \(\tilde O(1.25^d n)\), and with computer-aided parameter optimization to \(O(1.16^d n)\) [2507.11098]. The algorithm uses a representation-method style certificate search. The universe \([d]\) is partitioned into blocks, random families of subsets are sampled in each block, and a tuple of sampled subsets serves as a certificate if one input vector is contained blockwise while another is disjoint blockwise. Entropy estimates bound the number of certificates that need to be enumerated, producing the \(1.25^d\) and \(1.16^d\) bases [2507.11098].

The same paper generalizes this to \(k\)-OV. For every fixed \(k\ge 2\), there exists \(\varepsilon_k>0\) such that \(k\)-OV can be solved in time
\[
O(2^{(1-\varepsilon_k)d}\cdot n)
\]
[2507.11098]. The algorithm combines two ideas. First, a down-closure inclusion–exclusion method counts orthogonal \(k\)-tuples in time proportional to the total size of the down-closures of the input set families. Second, if some sets are large, the algorithm guesses them and recurses on lower-arity OV over the remaining intersection. A conditional lower bound based on the Set Cover Conjecture shows that for any \(\varepsilon>0\), there exists \(k\) such that a \(2^{(1-\varepsilon)d}n^{O(1)}\)-time algorithm for \(k\)-OV would contradict Set Cover, suggesting that \(\varepsilon_k\to 0\) as \(k\) grows is unavoidable [2507.11098].

For average-case OV, a 2024 paper studies inputs where each coordinate is independently \(1\) with probability \(p\) and gives a new algorithm running in
\[
n^{2-\Omega(\log\log c/\log c)}
\]
for dimension \(d=c\log n\), for any \(p\in(0,1)\) [2410.22477]. This improves on the prior worst-case exponent \(2-\Omega(1/\log c)\) of Abboud–Williams–Yu in the hardest parameter regime where \(p\) may depend on \(d\) [2410.22477]. The key idea is to use the simple real polynomial
\[
Q(z) = (z - p^2 d)^q
\]
and sum its evaluations over blocks of vectors. Orthogonal pairs contribute \((p^2 d)^q\), while typical random pairs have inner product concentrated around \(p^2d\), making their total contribution small with high probability [2410.22477]. The analysis tracks how polynomial values degrade as inner products move away from orthogonality.

In another direction, "Kronecker Powers, Orthogonal Vectors, and the Asymptotic Spectrum" gives deterministic algorithms for moderate-dimensional \(\textsf{OV}\) based on depth-2 circuits for the disjointness matrix \(R_d = R_1^{\otimes d}\), where
\[
R_1 = \begin{bmatrix}1 & 1 \\ 1 & 0\end{bmatrix}
\]
[2509.14489]. The paper shows that decision OV can be solved in deterministic time \(\tilde O(n\cdot 1.155^d)\), derandomizing an earlier algorithm of Nederlof and Węgrzycki, and counting OV in \(\tilde O(n\cdot 1.26^d)\), improving Williams’ \(\tilde O(n\cdot 1.35^d)\) counting algorithm [2509.14489]. The central framework reduces sparse vector–matrix–vector multiplication with \(R_d\) to evaluating low-degree depth-2 circuits for Kronecker powers. For decision OV, OR-circuits suffice and give asymptotic degree \(2/\sqrt{3}\approx 1.155\); for counting, partition circuits give asymptotic degree \(2^{1/3}\approx 1.26\) [2509.14489].

The same circuit perspective also yields modular variants \(\#\textsf{OV}_{\mathbb{Z}_m}\), and ties improvements in disjointness circuit degree directly to improved OV algorithms [2509.14489]. This suggests a close interaction between low-dimensional OV algorithms and nontrivial depth-2 circuit constructions.

A specialized but notable algorithmic connection appears in the Subset Sum literature. "Improving Schroeppel and Shamir's Algorithm for Subset Sum via Orthogonal Vectors" reduces worst-case Subset Sum to a structured OV instance where vectors have fixed Hamming weight, notably support size \(d/4\), and gives an OV algorithm running in time
\[
\tilde O\!\left((|\mathcal A|+|\mathcal B|)\cdot \frac{2^d}{\binom{d}{d/4}}\right)
\]
for such instances [2010.08576]. This reduction yields a Subset Sum algorithm with \(\mathcal O^\star(2^{0.5n})\) time and \(\mathcal O^\star(2^{0.249999n})\) space, the first improvement over Schroeppel–Shamir’s longstanding space bound [2010.08576]. A plausible implication is that even restricted fixed-weight OV can encode barriers for classical exponential-time algorithms.

## 5. Data structures and the online variant

The online or indexing version of OV asks for preprocessing a set \(S\subseteq \{0,1\}^d\) of \(n\) vectors so that a query vector \(q\) can be tested quickly for orthogonality against some stored vector [1710.00586][2605.04798]. In fine-grained terms, this is \(\textsf{OnlineOV}_{n,d}\). Earlier work on "Orthogonal Vectors Indexing" focused on the regime \(d=c\log n\) and studied space–query tradeoffs [1710.00586].

That paper gives several explicit data structures. The simplest divide-by-ones strategy partitions vectors into those with few ones and those with many ones, using arrays indexed by coordinate blocks and bitmap acceleration for heavy buckets [1710.00586]. More sophisticated query-graph constructions yield truly sublinear query time with space about \(\tilde O(n^{c-0.3})\) in the \(d=c\log n\) regime [1710.00586]. It also shows a general tradeoff: for any \(\epsilon>0\), one can achieve query time \(\tilde O(n^\epsilon)\) with space \(\tilde O(n^{c-\gamma})\) for some \(\gamma>0\) [1710.00586]. On random input vectors, the same paper improves the space to \(O(n^{c-1+\epsilon})\) for any \(\epsilon>0\), since bucket sizes in the query graph concentrate to \(O(\log n)\) [1710.00586].

A 2026 revisit of OnlineOV substantially refines this picture [2605.04798]. In low dimensions \(d=c\log n\), it gives a deterministic data structure with almost-linear space \(O(n^{1+\delta})\) and query time \(n^{1-\Omega(1/(c\log c))}\), matching the best known randomized low-dimensional performance up to constant factors in the exponent while removing randomness [2605.04798]. In moderate dimensions \(d=n^\varepsilon\), it improves the older Charikar–Indyk–Panigrahy bounds, obtaining query time \(n^{1-\varepsilon}d\) and space
\[
n^{1-\varepsilon} d \cdot 2^{O(\varepsilon d \log(1/\varepsilon))}
\]
[2605.04798]. For \(d=n^{o(1)}\), this gives sublinear query time and subexponential-in-\(d\) space, constituting the first deterministic refutation of a hardness conjecture proposed by Goldstein, Lewenstein, and Porat for \(\textsf{OnlineOV}\) [2605.04798].

The main technical tool in that paper is a structure-versus-randomness decomposition. The input set is partitioned into a pseudorandom part, where every projection onto \(t\) coordinates yields only small candidate lists, and structured blocks where many vectors share zeros on a fixed coordinate set, permitting a recursive dimension reduction [2605.04798]. This decomposition extends to Partial Match, Orthogonal Range Search, DNF Evaluation, and related online problems via standard reductions [2605.04798].

On the lower-bound side, under the Non-Uniform Strong Exponential Time Hypothesis, the same paper proves that for any constants \(c,\alpha>0\) and \(\delta,\gamma\in(0,1)\), there exists a constant sparsity \(w\) such that no batch data structure with polynomial space \(n^c\) and amortized query time \(n^{1-\gamma}\) exists for \(w\)-Sparse-\(\textsf{OnlineOV}_{n,d}\) with \(d=n^\delta\), even with computationally unbounded preprocessing [2605.04798]. Through reductions, these lower bounds extend to Partial Match, Subset Query, DNF Evaluation, Orthogonal Range Search, and approximate nearest neighbors in polylogarithmic dimension [2605.04798]. This gives an unusually strong conditional separation between preprocessing space and query complexity in online OV-like tasks.

## 6. Average-case, planted, and parity versions

The classical OVC is worst-case. Several recent works investigate whether \(\textsf{OV}\) remains hard on natural or planted distributions.

One line concerns parity counting. "Average-Case Hardness of Parity Problems: Orthogonal Vectors, \(k\)-SUM and More" studies parity-\(k\)-OV, which asks for the parity of the number of orthogonal \(k\)-tuples [2503.21951]. The paper gives explicit distributions under which parity-\(K\)-OV is average-case hard. In particular, for constant \(K\), it proves that parity-\(K\)-OV in dimension \(\Theta(K\log N)\) requires at least \(N^{\Omega(\sqrt K)}\) time on average under rETH, and \(N^{K^{1/3}/4-o(1)}\) time on average under \(k\)-XOR or \(k\)-SUM hypotheses [2503.21951]. The method proceeds through factored versions of \(k\)-OV, low-degree polynomial representations, worst-case-to-average-case reductions, and a factored-to-unfactored gadget that maps factored OV instances to standard \(K\)-OV instances [2503.21951].

A different average-case direction studies planted instances. "The Planted Orthogonal Vectors Problem" defines a planted distribution for \(k\)-OV where a unique orthogonal \(k\)-tuple is embedded among \(p\)-biased random vectors in dimension \(d=\alpha(n)\log n\) with \(\alpha(n)=\omega(1)\) [2505.00206]. The planted coordinate distribution is engineered so that any subset of fewer than \(k\) planted vectors has exactly the same marginal distribution as in the unplanted model, while the full \(k\)-tuple is orthogonal [2505.00206]. This \((k-1)\)-wise indistinguishability allows average-case search-to-decision reductions: a fast decision algorithm for distinguishing planted from unplanted instances yields a fast algorithm for recovering the planted tuple [2505.00206]. The paper conjectures that these planted instances still require \(n^{k-o(1)}\) time on average [2505.00206].

The average-case landscape is subtle because some random distributions actually make OV easy. Kane and Williams showed that for every fixed \(p\in(0,1)\), i.i.d. Bernoulli-\(p\) OV instances can be solved by \(\mathsf{AC}^0\) formulas of size \(n^{2-\epsilon_p}\) on all but an \(o_n(1)\) fraction of instances, demonstrating that standard independent random restrictions do not capture worst-case hardness [1709.05294]. The 2024 average-case algorithm of Alman, Andoni, and Zhang then strengthens the algorithmic side, showing that even in the hardest \(p\)-dependent regime, random OV is easier than worst-case OV [2410.22477]. This suggests that average-case hardness for OV, if it holds, likely depends on carefully planted or structured distributions rather than simple product distributions.

## 7. Circuit, communication, and broader complexity connections

Beyond algorithms and reductions, \(\textsf{OV}\) has become a proxy for understanding the limits of current lower-bound techniques. The paper "The Orthogonal Vectors Conjecture for Branching Programs and Formulas" proves that in several nonuniform models, OVC is effectively true unconditionally [1709.05294]. Specifically, OV on \(n\) vectors in dimension \(d\) has branching-program complexity, constant fan-in formula complexity, and symmetric-gate formula wire complexity
\[
\tilde \Theta(n\cdot \min(n,2^d))
\]
up to polylogarithmic factors [1709.05294]. In the regime \(d=\Theta(\log n)\) or larger, this yields essentially quadratic lower bounds, matching the strongest known explicit lower bounds for any function in those models [1709.05294]. The proof uses carefully structured restrictions rather than independent random restrictions, and the same framework extends to Batch Partial Match and related OV-hard problems [1709.05294].

The paper also shows a limitation of common lower-bound methods: under i.i.d. Bernoulli-\(p\) input distributions, OV becomes easy for small-depth formulas, so independent random restrictions cannot prove worst-case hardness here [1709.05294]. This resonates with later average-case algorithmic results and suggests that any robust unconditional progress on general OV lower bounds must use more structured arguments.

Communication complexity appears prominently in the equivalence-class work [1811.12017]. Efficient \(\Sigma_2^{cc}\) protocols for predicates such as exact inner product equality yield reductions to OV, turning communication upper bounds into fine-grained equivalences [1811.12017]. Conversely, LSH transforms metric proximity problems into approximate \(\textsf{Max-IP}\), and hence to OV [1811.12017]. This duality between communication protocols and fine-grained reductions has become one of the standard conceptual tools around OV.

Circuit complexity also reappears in the 2025 asymptotic-spectrum paper. There, the decision and counting OV algorithms arise from depth-2 linear circuits for Kronecker powers of the disjointness matrix, and OVC implies that the Walsh–Hadamard matrix and the disjointness matrix cannot have \(N^{1+o(1)}\)-size depth-2 circuits of certain types [2509.14489]. Proving such circuit lower bounds would also imply breakthroughs for threshold circuits, indicating that stronger lower bounds in this direction are difficult for reasons already familiar from classical circuit complexity [2509.14489].

Finally, OV connects to quantum complexity. "Fine-grained quantum supremacy based on Orthogonal Vectors, 3-SUM and All-Pairs Shortest Paths" encodes low-dimensional OV into the acceptance probability of specific quantum circuits [1902.08382]. Under OV or gap-OV conjectures, exact or multiplicative-error classical simulation of those circuits is impossible in certain exponential times as a function of the number of qubits \(N\) [1902.08382]. In the QRAM model, the circuits have linear size in \(N\), and the lower bound on classical simulation time is
\[
2^{\frac{(2-\delta)(N-7)}{3(c+1)}}
\]
for suitable \(c\) from the OV conjecture [1902.08382]. This places OV alongside 3-SUM and APSP as a polynomial-time fine-grained assumption capable of supporting quantum-supremacy style claims.

A related consequence appears in "More Consequences of Falsifying SETH and the Orthogonal Vectors Conjecture" [1805.08554]. That paper shows that if the moderate-dimensional OV conjecture fails, then for all \(d\) and large enough \(k\), weighted \(k\)-Clique and Min-Weight-\(k\)-Clique on \(d\)-hypergraphs admit \(O(n^{(1-\varepsilon)k})\)-time algorithms, and sparse threshold-circuit SAT obtains unexpected sub-\(2^n\) algorithms [1805.08554]. It also proves that the Weighted Clique conjecture implies the moderate-dimensional OV conjecture [1805.08554]. This situates OV inside a larger hierarchy of conjectures tied to weighted clique, APSP, and sparse circuit satisfiability.

Orthogonal Vectors therefore occupies a distinctive position. It is simple enough to encode as disjointness over subsets, strong enough to underpin dozens of fine-grained lower bounds, flexible enough to admit equivalence results across combinatorial, geometric, and data-structure problems, and rich enough to support advances in average-case complexity, circuit lower bounds, and exponential-time algorithm design [1811.12017][1709.05294][2509.14489]. The persistent tension between its deceptively elementary definition and the breadth of its implications is the reason it remains one of the central benchmark problems in modern fine-grained complexity.

Source: https://www.emergentmind.com/topics/orthogonal-vectors-problem-ov