---
title: Bad Science Matrix Problem
url: https://www.emergentmind.com/topics/bad-science-matrix-problem
type: topic
---

# Bad Science Matrix Problem

The Bad Science Matrix Problem is the extremal question of maximizing the average largest coordinate of \(Ax\) over all sign-vectors \(x\in\{\pm1\}^n\), subject to the constraint that every row of \(A\in\mathbb{R}^{n\times n}\) has unit \(\ell^2\)-norm. In Steinerberger’s formulation, if the rows are \(a_1,\dots,a_n\), then
\[
F(A)=\frac1{2^n}\sum_{x\in\{-1,1\}^n}\|Ax\|_\infty,
\]
and later papers write the same quantity as
\[
\beta(A)=\frac1{2^n}\sum_{x\in\{\pm1\}^n}\|Ax\|_\infty
=\mathbb{E}_{x\sim\{\pm1\}^n}\bigl[\max_{1\le i\le n}|\langle a_i,x\rangle|\bigr].
\]
The problem asks how large this average can be under the row-normalization constraint \(\|a_i\|_2=1\) for all \(i\) [2402.03205].

## 1. Formal optimization problem and statistical analogy

The admissible class is
\[
S_n=\{A\in\mathbb{R}^{n\times n}:\text{ each row }a_i\text{ satisfies }\|a_i\|_2=1\},
\]
and the extremal value is
\[
\beta(n)=\max_{A\in S_n}\beta(A).
\]
Geometrically, \(A\) maps the discrete cube \(\{\pm1\}^n\) to \(2^n\) points in \(\mathbb{R}^n\), and \(\beta(A)\) is the average of the largest-coordinate magnitudes of those image points [2408.00933]. Steinerberger also describes these matrices as corresponding to affine transformations of the discrete unit cube to points with, on average, at least one large coordinate [2402.03205].

The name of the problem comes from a statistical analogy. One interprets \(x\in\{\pm1\}^n\) as the outcomes of \(n\) independent fair coin tosses. A single test is given by a unit vector \(a\), with test statistic \(X_a=\langle a,x\rangle\). By Hoeffding’s inequality, \(X_a\) is sub-Gaussian, so large values are unlikely under the null. A “dishonest” scientist instead fixes \(n\) tests \(a_1,\dots,a_n\), observes \(x\), and reports \(\max_i |X_{a_i}|\). The quantity \(F(A)\) or \(\beta(A)\) is exactly the expected size of this maximal test statistic, and therefore measures the extent to which the maximum over many fair tests typically produces an atypical large value [2402.03205].

A recurring misconception is to treat the problem as only a metaphor about \(p\)-hacking. The papers formulate it as a precise extremal problem in discrete probability, convex geometry, and high-dimensional analysis; the “bad scientist” language is an interpretation of the optimization objective, not a substitute for it [2402.03205].

## 2. Asymptotic growth and proof mechanisms

The central asymptotic theorem is that
\[
\max_{A\in\mathbb{R}^{n\times n},\,\|a_i\|_2=1}F(A)
=(1+o(1))\sqrt{2\log n}
\qquad (n\to\infty).
\]
Equivalently,
\[
\max_{\|a_i\|_2=1}\beta(A)=(1+o(1))\sqrt{2\log n}
\]
as \(n\to\infty) [2402.03205, 2509.10580].

The upper bound is obtained by concentration. For any fixed row \(a\) with \(\|a\|_2=1\), the random variable \(X=\langle a,x\rangle\) satisfies
\[
\mathbb{P}(|X|\ge t)\le 2e^{-t^2/2}.
\]
Taking \(t=\sqrt{(2+\varepsilon)\log n}\) gives \(\mathbb{P}(|X|\ge t)\le 2n^{-1-\varepsilon/2}\). A union bound over the \(n\) rows yields
\[
\mathbb{P}\!\left(\max_{i\le n}|(Ax)_i|\ge t\right)\le 2n^{-\varepsilon/2},
\]
and splitting the expectation into the typical event \(\{\|Ax\|_\infty\le t\}\) and the rare tail gives the desired asymptotic upper bound [2402.03205].

The lower bound is established probabilistically. If \(A\) has iid entries \(\pm1/\sqrt n\), then each row has unit \(\ell^2\)-norm. For fixed \(x_0\in\{\pm1\}^n\), each coordinate \((Ax_0)_i\) is a rescaled Binomial random variable. Using an anti-concentration result identified as Tusnády’s lemma, Steinerberger shows that for any small \(\delta>0\),
\[
\mathbb{P}\!\left((Ax_0)_i\ge \sqrt{(2-\delta)\log n}\right)\ge c(n)n^{-1+\delta}
\]
for some \(c(n)>0\). Independence of rows then implies that
\[
\mathbb{P}\!\left(\|Ax_0\|_\infty<\sqrt{(2-\delta)\log n}\right)\le \exp(-c'n^\delta),
\]
and a double-counting or Fubini argument over all \(2^n\) sign-vectors produces a single matrix \(A\) for which all but \(o(2^n)\) of the \(x_0\) satisfy the same lower bound on \(\|Ax_0\|_\infty\) [2402.03205].

The scale \(\sqrt{2\log n}\) is the classical scale for the maximum of \(n\) approximately independent Gaussians. Steinerberger explicitly notes that \(\mathbb{E}[\max_{1\le i\le n}N_i]=\sqrt{2\log n}(1+o(1))\), which explains why the same growth appears here [2402.03205].

## 3. Explicit constructions and low-dimensional extremizers

Beyond existential lower bounds, explicit constructions are known. Albors, Bhatti, Ganjoo, Guo, Kunisky, Mukherjee, Stepin, and Zeng construct explicit \(n\times n\) matrices \(A\) with
\[
\beta(A)\ge \sqrt{\log_2(n+1)},
\]
and describe this as only \(18\%\) smaller than the asymptotic rate [2408.00933]. Their construction is inductive. Starting from
\[
A_2=\frac1{\sqrt2}\begin{bmatrix}1&1\\1&-1\end{bmatrix},
\qquad \beta(A_2)=\sqrt2,
\]
if \(A\in S_n\) has \(\beta(A)=B\), they define
\[
B'=\frac1{\sqrt{B^2+1}}
\begin{bmatrix}
BA&I_n\\
BA&-I_n
\end{bmatrix}\in S_{2n},
\]
and prove that \(\beta(B')=\sqrt{B^2+1}\). Iterating yields explicit matrices \(A_{2^k}\) with
\[
\beta(A_{2^k})=\sqrt{k+1}=\sqrt{\log_2(2^k)+1},
\]
hence \(\beta(n)\ge \sqrt{\log_2(n+1)}\) [2408.00933].

Exact optima are known for \(n\le 4\), while for \(5\le n\le 8\) the literature gives candidate maximizers and best known values. The following values all appear in the cited papers [2402.03205, 2408.00933].

| \(n\) | Value | Status |
|---|---:|---|
| \(1\) | \(1\) | exact |
| \(2\) | \(\sqrt2\) | exact |
| \(3\) | \(\frac{\sqrt2+\sqrt3}{2}\) | exact |
| \(4\) | \(\sqrt3\) | exact |
| \(5\) | \(\frac{2+3\sqrt3}{4}\) | candidate / best known lower bound |
| \(6\) | \(\frac{2+\sqrt3}{2}\) | candidate / best known lower bound |
| \(7\) | \(\frac{6+\sqrt3}{4}\) | candidate / best known lower bound |
| \(8\) | \(2\) | candidate / best known lower bound |

Several low-dimensional matrices have especially rigid forms. For \(n=2\), the maximizer is unique up to rotation by \(\pm45^\circ\), namely
\[
\frac1{\sqrt2}\begin{bmatrix}1&1\\1&-1\end{bmatrix},
\]
and it maps the square corners to \((\pm\sqrt2,0)\) and \((0,\pm\sqrt2)\) [2402.03205]. For \(n=3\), one optimal matrix is
\[
\frac12
\begin{bmatrix}
-1&-1&\sqrt2\\
-\sqrt2&0&\sqrt2\\
1&1&\sqrt2
\end{bmatrix},
\]
for which half of the cube vertices are sent to max-coordinate \(\sqrt3\) and half to \(\sqrt2\) [2402.03205, 2408.00933]. For \(n=4\), exact optima include matrices that ignore one coordinate and satisfy \(\beta_4=\sqrt3\); Steinerberger also records an orthogonal maximizer with \(AA^\top=I\) that sends every sign-vector to an image with \(\|Ax\|_\infty=\sqrt3\) [2402.03205, 2408.00933]. For \(n=8\), the transpose of the discrete Haar-wavelet transform of size \(8\times 8\) sends each of the \(256\) sign-vectors to one of the \(8\) basis directions at coordinate \(\pm2\), giving \(\beta_8=2\) [2402.03205].

The small-\(n\) examples are notable because they are not generic random sign matrices. Steinerberger emphasizes that the extremizers up to \(n\le 8\) appear highly structured, often combinatorial or wavelet-like, and in dimensions \(5,6,7\) the best found matrices can have entire columns of zeros while still outperforming random matrices numerically up to \(n=7\) [2402.03205].

## 4. Algebraic and combinatorial structure of extremizers

A structural theorem in [2408.00933] gives an explicit description of the rows of an extremal matrix. If \(A^*\in S_n\) maximizes \(\beta(A)\), and if for each row \(i\) one defines
\[
W_i=\{x\in\{\pm1\}^n:\|A^*x\|_\infty=\langle a_i^*,x\rangle\},
\]
then
\[
a_i^*=\frac{\sum_{x\in W_i}x}{\left\|\sum_{x\in W_i}x\right\|_2}.
\]
The proof rewrites \(\beta(A)\) by partitioning the cube into the \(W_i\), applies Cauchy–Schwarz on each block, and shows that any strict inequality can be improved by rescaling the corresponding row [2408.00933].

A direct corollary is algebraicity. Since each \(\sum_{x\in W_i}x\) has integer coordinates, every entry of \(a_i^*\) is of the form
\[
\frac{m}{\sqrt N}
\qquad (m,N\in\mathbb{Z}),
\]
so extremal entries are square-roots of rationals [2408.00933]. The abstract of the same paper summarizes this by stating that every entry of any optimal matrix is a square root of a rational number [2408.00933].

This characterization turns the continuous optimization problem into a finite combinatorial problem once the winning sets \(W_i\) are specified. That reduction underlies the finite-state computer-assisted search proving exact optimality for \(n\le 4\) [2408.00933]. A plausible implication is that the qualitative rigidity observed in small dimensions is not accidental: the extremal rows are constrained to be normalized centroids of discrete subsets of the cube.

## 5. Geometric, Fourier-analytic, and Gaussian reformulations

Subsequent work gives a more geometric description of near-extremizers. For each row index \(i\), define the full winning cell
\[
C_i(A)=\{x\in\{\pm1\}^n:|\langle a_i,x\rangle|=\max_{1\le j\le n}|\langle a_j,x\rangle|\},
\]
and the positive half
\[
S_i(A)=\{x\in C_i(A):\langle a_i,x\rangle\ge 0\}.
\]
After a small perturbation, the sets \(\{S_i,-S_i\}_{i=1}^n\) form a partition of the cube [2509.10580].

The same paper introduces the level-1 Fourier weight
\[
W_1[f]=\sum_{k=1}^n\bigl(\mathbb{E}_x[f(x)x_k]\bigr)^2
\]
for Boolean functions \(f:\{\pm1\}^n\to\{0,1\}\), and proves the bound
\[
\beta(A)\le 2\sum_{i=1}^n \sqrt{W_1[\mathbf{1}_{S_i(A)}]}.
\]
This reformulates the optimization problem in terms of a partition of the cube whose cells have large level-1 Fourier mass [2509.10580].

The structural stability theorem in [2509.10580] states that if \(A\) achieves the asymptotic maximum \((1+o(1))\sqrt{2\ln n}\), then the cells \(S_i(A)\) all have nearly equal volume,
\[
\left|\frac{|S_i|}{2^n}-\frac1{2n}\right|=o(1/\sqrt n),
\]
each row vector \(a_i\) almost coincides with the normalized centroid of \(S_i\), and for all but \(o(n)\) indices \(i\), the set \(S_i\) is nearly isoperimetrically extremal for level-1 weight:
\[
\sqrt{W_1[\mathbf{1}_{S_i}]}\approx\frac{|S_i|}{2^n}\sqrt{2\ln\!\left(\frac1{|S_i|/2^n}\right)}.
\]
The paper summarizes this by saying that asymptotic extremizers induce “nearly uniform, centroidal Voronoi tessellations” of the cube [2509.10580].

The same work also recasts the problem through a high-dimensional central limit theorem. If the rows are rescaled to Euclidean norm \(\sqrt n\) via \(\tilde a_i=\sqrt n\,a_i\), and \(\varepsilon_1,\dots,\varepsilon_n\) are iid Rademacher variables, then
\[
S_n=\frac1{\sqrt n}\sum_{i=1}^n \varepsilon_i\,\tilde a_i\in\mathbb{R}^n,
\qquad
\mathbb{E}[S_nS_n^\top]=\Sigma=\frac1n AA^\top,
\]
and \(\beta(A)=\mathbb{E}\|S_n\|_\infty\). Under mild nondegeneracy of \(\Sigma\) and bounded-entry hypotheses, a high-dimensional CLT gives
\[
\sup_{t\in\mathbb{R}}\left|\Pr(\|S_n\|_\infty>t)-\Pr(\|Z\|_\infty>t)\right|=o(1),
\qquad Z\sim N(0,\Sigma),
\]
so the extremal problem is closely tied to Gaussian maxima [2509.10580].

## 6. Deterministic near-extremizers and open questions

The Gaussian viewpoint leads to sharper asymptotics and new deterministic constructions. For \(Z\) with iid standard-Normal coordinates,
\[
\mathbb{E}\Bigl[\max_{i\le n}|Z_i|\Bigr]
=
\sqrt{2\ln(2n)}
-\frac{\ln\ln(2n)+\ln(4\pi)}{2\sqrt{2\ln(2n)}}
+o\bigl((\ln n)^{-1/2}\bigr),
\]
and comparison theorems imply that among all covariance matrices with unit diagonal, the identity gives the largest \(\mathbb{E}\|Z\|_\infty\) [2509.10580].

For random sign matrices, the Gram off-diagonals satisfy
\[
\Sigma_{jk}=O\!\left(\sqrt{\frac{\ln n}{n}}\right),
\]
and the CLT analysis yields
\[
\beta(A)
=
\sqrt{2\ln(2n)}
-\frac{\ln\ln(2n)}{2\sqrt{2\ln(2n)}}
+o\bigl((\ln n)^{-1/2}\bigr)
\]
with high probability [2509.10580]. This refines the earlier statement that random iid \(\pm1/\sqrt n\) matrices attain the optimal leading-order rate [2402.03205].

The same paper constructs deterministic “Orthonormal Almost-Hadamard” matrices. One truncates a Hadamard matrix of order \(m\ge n\) to its top-left \(n\times n\) block \(U\), normalizes by \(\sqrt m\), and applies QR to obtain \(Q\) with \(QQ^\top=I_n\). Since all entries of \(Q\) are \(O(n^{-1/2})\), the CLT applies with \(\Sigma=I_n\), and
\[
\beta(Q)
=
\sqrt{2\ln(2n)}
-\frac{\ln\ln(2n)}{2\sqrt{2\ln(2n)}}
+o\bigl((\ln n)^{-1/2}\bigr).
\]
Under Hadamard’s conjecture, this gives for all sufficiently large \(n\)
\[
\beta(Q_n)\ge
\left(1-\frac{\ln\ln(2n)}{4\ln(2n)}\right)\sqrt{2\ln(2n)},
\]
and the paper states that such matrices exist for infinitely many \(n\) unconditionally [2509.10580].

Several open problems remain explicit in the literature. One is whether the gap between explicit constructions and the asymptotic optimum can be fully closed. Another is whether the lifting matrices are optimal when \(n=2^k\). A third is the exact determination of \(\beta(n)\) for \(5\le n\le 8\), where only highly structured candidates are currently available. The 2024 structural paper also asks about non-square and \(\ell^p\)-variants, noting that only \(p=1,2\) are fully understood [2408.00933]. These questions indicate that the problem now lies at the intersection of explicit combinatorial design, extremal Fourier analysis on the cube, and Gaussian comparison theory.

Source: https://www.emergentmind.com/topics/bad-science-matrix-problem