Bad Science Matrix Problem
- Bad Science Matrix Problem is defined as maximizing the average largest coordinate of Ax over all sign-vectors x with each row of A constrained to unit ℓ2-norm.
- The analysis employs probabilistic bounds, concentration, and anti-concentration inequalities to establish the asymptotic behavior, notably the √(2 log n) growth rate.
- Explicit constructions using inductive techniques and almost-Hadamard matrices reveal structured, low-dimensional extremizers that nearly attain optimal performance.
The Bad Science Matrix Problem is the extremal question of maximizing the average largest coordinate of over all sign-vectors , subject to the constraint that every row of has unit -norm. In Steinerberger’s formulation, if the rows are , then
and later papers write the same quantity as
The problem asks how large this average can be under the row-normalization constraint for all (Steinerberger, 2024).
1. Formal optimization problem and statistical analogy
The admissible class is
and the extremal value is
0
Geometrically, 1 maps the discrete cube 2 to 3 points in 4, and 5 is the average of the largest-coordinate magnitudes of those image points (Albors et al., 2024). Steinerberger also describes these matrices as corresponding to affine transformations of the discrete unit cube to points with, on average, at least one large coordinate (Steinerberger, 2024).
The name of the problem comes from a statistical analogy. One interprets 6 as the outcomes of 7 independent fair coin tosses. A single test is given by a unit vector 8, with test statistic 9. By Hoeffding’s inequality, 0 is sub-Gaussian, so large values are unlikely under the null. A “dishonest” scientist instead fixes 1 tests 2, observes 3, and reports 4. The quantity 5 or 6 is exactly the expected size of this maximal test statistic, and therefore measures the extent to which the maximum over many fair tests typically produces an atypical large value (Steinerberger, 2024).
A recurring misconception is to treat the problem as only a metaphor about 7-hacking. The papers formulate it as a precise extremal problem in discrete probability, convex geometry, and high-dimensional analysis; the “bad scientist” language is an interpretation of the optimization objective, not a substitute for it (Steinerberger, 2024).
2. Asymptotic growth and proof mechanisms
The central asymptotic theorem is that
8
Equivalently,
9
as (n\to\infty) (Steinerberger, 2024, Sinha, 11 Sep 2025).
The upper bound is obtained by concentration. For any fixed row 0 with 1, the random variable 2 satisfies
3
Taking 4 gives 5. A union bound over the 6 rows yields
7
and splitting the expectation into the typical event 8 and the rare tail gives the desired asymptotic upper bound (Steinerberger, 2024).
The lower bound is established probabilistically. If 9 has iid entries 0, then each row has unit 1-norm. For fixed 2, each coordinate 3 is a rescaled Binomial random variable. Using an anti-concentration result identified as Tusnády’s lemma, Steinerberger shows that for any small 4,
5
for some 6. Independence of rows then implies that
7
and a double-counting or Fubini argument over all 8 sign-vectors produces a single matrix 9 for which all but 0 of the 1 satisfy the same lower bound on 2 (Steinerberger, 2024).
The scale 3 is the classical scale for the maximum of 4 approximately independent Gaussians. Steinerberger explicitly notes that 5, which explains why the same growth appears here (Steinerberger, 2024).
3. Explicit constructions and low-dimensional extremizers
Beyond existential lower bounds, explicit constructions are known. Albors, Bhatti, Ganjoo, Guo, Kunisky, Mukherjee, Stepin, and Zeng construct explicit 6 matrices 7 with
8
and describe this as only 9 smaller than the asymptotic rate (Albors et al., 2024). Their construction is inductive. Starting from
0
if 1 has 2, they define
3
and prove that 4. Iterating yields explicit matrices 5 with
6
hence 7 (Albors et al., 2024).
Exact optima are known for 8, while for 9 the literature gives candidate maximizers and best known values. The following values all appear in the cited papers (Steinerberger, 2024, Albors et al., 2024).
| 0 | Value | Status |
|---|---|---|
| 1 | 2 | exact |
| 3 | 4 | exact |
| 5 | 6 | exact |
| 7 | 8 | exact |
| 9 | 0 | candidate / best known lower bound |
| 1 | 2 | candidate / best known lower bound |
| 3 | 4 | candidate / best known lower bound |
| 5 | 6 | candidate / best known lower bound |
Several low-dimensional matrices have especially rigid forms. For 7, the maximizer is unique up to rotation by 8, namely
9
and it maps the square corners to 0 and 1 (Steinerberger, 2024). For 2, one optimal matrix is
3
for which half of the cube vertices are sent to max-coordinate 4 and half to 5 (Steinerberger, 2024, Albors et al., 2024). For 6, exact optima include matrices that ignore one coordinate and satisfy 7; Steinerberger also records an orthogonal maximizer with 8 that sends every sign-vector to an image with 9 (Steinerberger, 2024, Albors et al., 2024). For 00, the transpose of the discrete Haar-wavelet transform of size 01 sends each of the 02 sign-vectors to one of the 03 basis directions at coordinate 04, giving 05 (Steinerberger, 2024).
The small-06 examples are notable because they are not generic random sign matrices. Steinerberger emphasizes that the extremizers up to 07 appear highly structured, often combinatorial or wavelet-like, and in dimensions 08 the best found matrices can have entire columns of zeros while still outperforming random matrices numerically up to 09 (Steinerberger, 2024).
4. Algebraic and combinatorial structure of extremizers
A structural theorem in (Albors et al., 2024) gives an explicit description of the rows of an extremal matrix. If 10 maximizes 11, and if for each row 12 one defines
13
then
14
The proof rewrites 15 by partitioning the cube into the 16, applies Cauchy–Schwarz on each block, and shows that any strict inequality can be improved by rescaling the corresponding row (Albors et al., 2024).
A direct corollary is algebraicity. Since each 17 has integer coordinates, every entry of 18 is of the form
19
so extremal entries are square-roots of rationals (Albors et al., 2024). The abstract of the same paper summarizes this by stating that every entry of any optimal matrix is a square root of a rational number (Albors et al., 2024).
This characterization turns the continuous optimization problem into a finite combinatorial problem once the winning sets 20 are specified. That reduction underlies the finite-state computer-assisted search proving exact optimality for 21 (Albors et al., 2024). A plausible implication is that the qualitative rigidity observed in small dimensions is not accidental: the extremal rows are constrained to be normalized centroids of discrete subsets of the cube.
5. Geometric, Fourier-analytic, and Gaussian reformulations
Subsequent work gives a more geometric description of near-extremizers. For each row index 22, define the full winning cell
23
and the positive half
24
After a small perturbation, the sets 25 form a partition of the cube (Sinha, 11 Sep 2025).
The same paper introduces the level-1 Fourier weight
26
for Boolean functions 27, and proves the bound
28
This reformulates the optimization problem in terms of a partition of the cube whose cells have large level-1 Fourier mass (Sinha, 11 Sep 2025).
The structural stability theorem in (Sinha, 11 Sep 2025) states that if 29 achieves the asymptotic maximum 30, then the cells 31 all have nearly equal volume,
32
each row vector 33 almost coincides with the normalized centroid of 34, and for all but 35 indices 36, the set 37 is nearly isoperimetrically extremal for level-1 weight: 38 The paper summarizes this by saying that asymptotic extremizers induce “nearly uniform, centroidal Voronoi tessellations” of the cube (Sinha, 11 Sep 2025).
The same work also recasts the problem through a high-dimensional central limit theorem. If the rows are rescaled to Euclidean norm 39 via 40, and 41 are iid Rademacher variables, then
42
and 43. Under mild nondegeneracy of 44 and bounded-entry hypotheses, a high-dimensional CLT gives
45
so the extremal problem is closely tied to Gaussian maxima (Sinha, 11 Sep 2025).
6. Deterministic near-extremizers and open questions
The Gaussian viewpoint leads to sharper asymptotics and new deterministic constructions. For 46 with iid standard-Normal coordinates,
47
and comparison theorems imply that among all covariance matrices with unit diagonal, the identity gives the largest 48 (Sinha, 11 Sep 2025).
For random sign matrices, the Gram off-diagonals satisfy
49
and the CLT analysis yields
50
with high probability (Sinha, 11 Sep 2025). This refines the earlier statement that random iid 51 matrices attain the optimal leading-order rate (Steinerberger, 2024).
The same paper constructs deterministic “Orthonormal Almost-Hadamard” matrices. One truncates a Hadamard matrix of order 52 to its top-left 53 block 54, normalizes by 55, and applies QR to obtain 56 with 57. Since all entries of 58 are 59, the CLT applies with 60, and
61
Under Hadamard’s conjecture, this gives for all sufficiently large 62
63
and the paper states that such matrices exist for infinitely many 64 unconditionally (Sinha, 11 Sep 2025).
Several open problems remain explicit in the literature. One is whether the gap between explicit constructions and the asymptotic optimum can be fully closed. Another is whether the lifting matrices are optimal when 65. A third is the exact determination of 66 for 67, where only highly structured candidates are currently available. The 2024 structural paper also asks about non-square and 68-variants, noting that only 69 are fully understood (Albors et al., 2024). These questions indicate that the problem now lies at the intersection of explicit combinatorial design, extremal Fourier analysis on the cube, and Gaussian comparison theory.