Papers
Topics
Authors
Recent
Search
2000 character limit reached

Bad Science Matrix Problem

Updated 10 July 2026
  • Bad Science Matrix Problem is defined as maximizing the average largest coordinate of Ax over all sign-vectors x with each row of A constrained to unit ℓ2-norm.
  • The analysis employs probabilistic bounds, concentration, and anti-concentration inequalities to establish the asymptotic behavior, notably the √(2 log n) growth rate.
  • Explicit constructions using inductive techniques and almost-Hadamard matrices reveal structured, low-dimensional extremizers that nearly attain optimal performance.

The Bad Science Matrix Problem is the extremal question of maximizing the average largest coordinate of AxAx over all sign-vectors x{±1}nx\in\{\pm1\}^n, subject to the constraint that every row of ARn×nA\in\mathbb{R}^{n\times n} has unit 2\ell^2-norm. In Steinerberger’s formulation, if the rows are a1,,ana_1,\dots,a_n, then

F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,

and later papers write the same quantity as

β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].

The problem asks how large this average can be under the row-normalization constraint ai2=1\|a_i\|_2=1 for all ii (Steinerberger, 2024).

1. Formal optimization problem and statistical analogy

The admissible class is

Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},

and the extremal value is

x{±1}nx\in\{\pm1\}^n0

Geometrically, x{±1}nx\in\{\pm1\}^n1 maps the discrete cube x{±1}nx\in\{\pm1\}^n2 to x{±1}nx\in\{\pm1\}^n3 points in x{±1}nx\in\{\pm1\}^n4, and x{±1}nx\in\{\pm1\}^n5 is the average of the largest-coordinate magnitudes of those image points (Albors et al., 2024). Steinerberger also describes these matrices as corresponding to affine transformations of the discrete unit cube to points with, on average, at least one large coordinate (Steinerberger, 2024).

The name of the problem comes from a statistical analogy. One interprets x{±1}nx\in\{\pm1\}^n6 as the outcomes of x{±1}nx\in\{\pm1\}^n7 independent fair coin tosses. A single test is given by a unit vector x{±1}nx\in\{\pm1\}^n8, with test statistic x{±1}nx\in\{\pm1\}^n9. By Hoeffding’s inequality, ARn×nA\in\mathbb{R}^{n\times n}0 is sub-Gaussian, so large values are unlikely under the null. A “dishonest” scientist instead fixes ARn×nA\in\mathbb{R}^{n\times n}1 tests ARn×nA\in\mathbb{R}^{n\times n}2, observes ARn×nA\in\mathbb{R}^{n\times n}3, and reports ARn×nA\in\mathbb{R}^{n\times n}4. The quantity ARn×nA\in\mathbb{R}^{n\times n}5 or ARn×nA\in\mathbb{R}^{n\times n}6 is exactly the expected size of this maximal test statistic, and therefore measures the extent to which the maximum over many fair tests typically produces an atypical large value (Steinerberger, 2024).

A recurring misconception is to treat the problem as only a metaphor about ARn×nA\in\mathbb{R}^{n\times n}7-hacking. The papers formulate it as a precise extremal problem in discrete probability, convex geometry, and high-dimensional analysis; the “bad scientist” language is an interpretation of the optimization objective, not a substitute for it (Steinerberger, 2024).

2. Asymptotic growth and proof mechanisms

The central asymptotic theorem is that

ARn×nA\in\mathbb{R}^{n\times n}8

Equivalently,

ARn×nA\in\mathbb{R}^{n\times n}9

as (n\to\infty) (Steinerberger, 2024, Sinha, 11 Sep 2025).

The upper bound is obtained by concentration. For any fixed row 2\ell^20 with 2\ell^21, the random variable 2\ell^22 satisfies

2\ell^23

Taking 2\ell^24 gives 2\ell^25. A union bound over the 2\ell^26 rows yields

2\ell^27

and splitting the expectation into the typical event 2\ell^28 and the rare tail gives the desired asymptotic upper bound (Steinerberger, 2024).

The lower bound is established probabilistically. If 2\ell^29 has iid entries a1,,ana_1,\dots,a_n0, then each row has unit a1,,ana_1,\dots,a_n1-norm. For fixed a1,,ana_1,\dots,a_n2, each coordinate a1,,ana_1,\dots,a_n3 is a rescaled Binomial random variable. Using an anti-concentration result identified as Tusnády’s lemma, Steinerberger shows that for any small a1,,ana_1,\dots,a_n4,

a1,,ana_1,\dots,a_n5

for some a1,,ana_1,\dots,a_n6. Independence of rows then implies that

a1,,ana_1,\dots,a_n7

and a double-counting or Fubini argument over all a1,,ana_1,\dots,a_n8 sign-vectors produces a single matrix a1,,ana_1,\dots,a_n9 for which all but F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,0 of the F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,1 satisfy the same lower bound on F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,2 (Steinerberger, 2024).

The scale F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,3 is the classical scale for the maximum of F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,4 approximately independent Gaussians. Steinerberger explicitly notes that F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,5, which explains why the same growth appears here (Steinerberger, 2024).

3. Explicit constructions and low-dimensional extremizers

Beyond existential lower bounds, explicit constructions are known. Albors, Bhatti, Ganjoo, Guo, Kunisky, Mukherjee, Stepin, and Zeng construct explicit F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,6 matrices F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,7 with

F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,8

and describe this as only F(A)=12nx{1,1}nAx,F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,9 smaller than the asymptotic rate (Albors et al., 2024). Their construction is inductive. Starting from

β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].0

if β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].1 has β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].2, they define

β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].3

and prove that β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].4. Iterating yields explicit matrices β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].5 with

β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].6

hence β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].7 (Albors et al., 2024).

Exact optima are known for β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].8, while for β(A)=12nx{±1}nAx=Ex{±1}n[max1inai,x].\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty =\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].9 the literature gives candidate maximizers and best known values. The following values all appear in the cited papers (Steinerberger, 2024, Albors et al., 2024).

ai2=1\|a_i\|_2=10 Value Status
ai2=1\|a_i\|_2=11 ai2=1\|a_i\|_2=12 exact
ai2=1\|a_i\|_2=13 ai2=1\|a_i\|_2=14 exact
ai2=1\|a_i\|_2=15 ai2=1\|a_i\|_2=16 exact
ai2=1\|a_i\|_2=17 ai2=1\|a_i\|_2=18 exact
ai2=1\|a_i\|_2=19 ii0 candidate / best known lower bound
ii1 ii2 candidate / best known lower bound
ii3 ii4 candidate / best known lower bound
ii5 ii6 candidate / best known lower bound

Several low-dimensional matrices have especially rigid forms. For ii7, the maximizer is unique up to rotation by ii8, namely

ii9

and it maps the square corners to Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},0 and Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},1 (Steinerberger, 2024). For Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},2, one optimal matrix is

Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},3

for which half of the cube vertices are sent to max-coordinate Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},4 and half to Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},5 (Steinerberger, 2024, Albors et al., 2024). For Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},6, exact optima include matrices that ignore one coordinate and satisfy Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},7; Steinerberger also records an orthogonal maximizer with Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},8 that sends every sign-vector to an image with Sn={ARn×n: each row ai satisfies ai2=1},S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},9 (Steinerberger, 2024, Albors et al., 2024). For x{±1}nx\in\{\pm1\}^n00, the transpose of the discrete Haar-wavelet transform of size x{±1}nx\in\{\pm1\}^n01 sends each of the x{±1}nx\in\{\pm1\}^n02 sign-vectors to one of the x{±1}nx\in\{\pm1\}^n03 basis directions at coordinate x{±1}nx\in\{\pm1\}^n04, giving x{±1}nx\in\{\pm1\}^n05 (Steinerberger, 2024).

The small-x{±1}nx\in\{\pm1\}^n06 examples are notable because they are not generic random sign matrices. Steinerberger emphasizes that the extremizers up to x{±1}nx\in\{\pm1\}^n07 appear highly structured, often combinatorial or wavelet-like, and in dimensions x{±1}nx\in\{\pm1\}^n08 the best found matrices can have entire columns of zeros while still outperforming random matrices numerically up to x{±1}nx\in\{\pm1\}^n09 (Steinerberger, 2024).

4. Algebraic and combinatorial structure of extremizers

A structural theorem in (Albors et al., 2024) gives an explicit description of the rows of an extremal matrix. If x{±1}nx\in\{\pm1\}^n10 maximizes x{±1}nx\in\{\pm1\}^n11, and if for each row x{±1}nx\in\{\pm1\}^n12 one defines

x{±1}nx\in\{\pm1\}^n13

then

x{±1}nx\in\{\pm1\}^n14

The proof rewrites x{±1}nx\in\{\pm1\}^n15 by partitioning the cube into the x{±1}nx\in\{\pm1\}^n16, applies Cauchy–Schwarz on each block, and shows that any strict inequality can be improved by rescaling the corresponding row (Albors et al., 2024).

A direct corollary is algebraicity. Since each x{±1}nx\in\{\pm1\}^n17 has integer coordinates, every entry of x{±1}nx\in\{\pm1\}^n18 is of the form

x{±1}nx\in\{\pm1\}^n19

so extremal entries are square-roots of rationals (Albors et al., 2024). The abstract of the same paper summarizes this by stating that every entry of any optimal matrix is a square root of a rational number (Albors et al., 2024).

This characterization turns the continuous optimization problem into a finite combinatorial problem once the winning sets x{±1}nx\in\{\pm1\}^n20 are specified. That reduction underlies the finite-state computer-assisted search proving exact optimality for x{±1}nx\in\{\pm1\}^n21 (Albors et al., 2024). A plausible implication is that the qualitative rigidity observed in small dimensions is not accidental: the extremal rows are constrained to be normalized centroids of discrete subsets of the cube.

5. Geometric, Fourier-analytic, and Gaussian reformulations

Subsequent work gives a more geometric description of near-extremizers. For each row index x{±1}nx\in\{\pm1\}^n22, define the full winning cell

x{±1}nx\in\{\pm1\}^n23

and the positive half

x{±1}nx\in\{\pm1\}^n24

After a small perturbation, the sets x{±1}nx\in\{\pm1\}^n25 form a partition of the cube (Sinha, 11 Sep 2025).

The same paper introduces the level-1 Fourier weight

x{±1}nx\in\{\pm1\}^n26

for Boolean functions x{±1}nx\in\{\pm1\}^n27, and proves the bound

x{±1}nx\in\{\pm1\}^n28

This reformulates the optimization problem in terms of a partition of the cube whose cells have large level-1 Fourier mass (Sinha, 11 Sep 2025).

The structural stability theorem in (Sinha, 11 Sep 2025) states that if x{±1}nx\in\{\pm1\}^n29 achieves the asymptotic maximum x{±1}nx\in\{\pm1\}^n30, then the cells x{±1}nx\in\{\pm1\}^n31 all have nearly equal volume,

x{±1}nx\in\{\pm1\}^n32

each row vector x{±1}nx\in\{\pm1\}^n33 almost coincides with the normalized centroid of x{±1}nx\in\{\pm1\}^n34, and for all but x{±1}nx\in\{\pm1\}^n35 indices x{±1}nx\in\{\pm1\}^n36, the set x{±1}nx\in\{\pm1\}^n37 is nearly isoperimetrically extremal for level-1 weight: x{±1}nx\in\{\pm1\}^n38 The paper summarizes this by saying that asymptotic extremizers induce “nearly uniform, centroidal Voronoi tessellations” of the cube (Sinha, 11 Sep 2025).

The same work also recasts the problem through a high-dimensional central limit theorem. If the rows are rescaled to Euclidean norm x{±1}nx\in\{\pm1\}^n39 via x{±1}nx\in\{\pm1\}^n40, and x{±1}nx\in\{\pm1\}^n41 are iid Rademacher variables, then

x{±1}nx\in\{\pm1\}^n42

and x{±1}nx\in\{\pm1\}^n43. Under mild nondegeneracy of x{±1}nx\in\{\pm1\}^n44 and bounded-entry hypotheses, a high-dimensional CLT gives

x{±1}nx\in\{\pm1\}^n45

so the extremal problem is closely tied to Gaussian maxima (Sinha, 11 Sep 2025).

6. Deterministic near-extremizers and open questions

The Gaussian viewpoint leads to sharper asymptotics and new deterministic constructions. For x{±1}nx\in\{\pm1\}^n46 with iid standard-Normal coordinates,

x{±1}nx\in\{\pm1\}^n47

and comparison theorems imply that among all covariance matrices with unit diagonal, the identity gives the largest x{±1}nx\in\{\pm1\}^n48 (Sinha, 11 Sep 2025).

For random sign matrices, the Gram off-diagonals satisfy

x{±1}nx\in\{\pm1\}^n49

and the CLT analysis yields

x{±1}nx\in\{\pm1\}^n50

with high probability (Sinha, 11 Sep 2025). This refines the earlier statement that random iid x{±1}nx\in\{\pm1\}^n51 matrices attain the optimal leading-order rate (Steinerberger, 2024).

The same paper constructs deterministic “Orthonormal Almost-Hadamard” matrices. One truncates a Hadamard matrix of order x{±1}nx\in\{\pm1\}^n52 to its top-left x{±1}nx\in\{\pm1\}^n53 block x{±1}nx\in\{\pm1\}^n54, normalizes by x{±1}nx\in\{\pm1\}^n55, and applies QR to obtain x{±1}nx\in\{\pm1\}^n56 with x{±1}nx\in\{\pm1\}^n57. Since all entries of x{±1}nx\in\{\pm1\}^n58 are x{±1}nx\in\{\pm1\}^n59, the CLT applies with x{±1}nx\in\{\pm1\}^n60, and

x{±1}nx\in\{\pm1\}^n61

Under Hadamard’s conjecture, this gives for all sufficiently large x{±1}nx\in\{\pm1\}^n62

x{±1}nx\in\{\pm1\}^n63

and the paper states that such matrices exist for infinitely many x{±1}nx\in\{\pm1\}^n64 unconditionally (Sinha, 11 Sep 2025).

Several open problems remain explicit in the literature. One is whether the gap between explicit constructions and the asymptotic optimum can be fully closed. Another is whether the lifting matrices are optimal when x{±1}nx\in\{\pm1\}^n65. A third is the exact determination of x{±1}nx\in\{\pm1\}^n66 for x{±1}nx\in\{\pm1\}^n67, where only highly structured candidates are currently available. The 2024 structural paper also asks about non-square and x{±1}nx\in\{\pm1\}^n68-variants, noting that only x{±1}nx\in\{\pm1\}^n69 are fully understood (Albors et al., 2024). These questions indicate that the problem now lies at the intersection of explicit combinatorial design, extremal Fourier analysis on the cube, and Gaussian comparison theory.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (3)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Bad Science Matrix Problem.