Information-computation gap for planted linear regression
Determine whether planted linear regression has an information-computation gap in the regime d+1 \le m \ll d^{3/4}n^{1/4}, specifically whether recovering the coefficient vector \beta exactly or with error asymptotically smaller than the ordinary least-squares rate \sqrt{d/n} requires superpolynomial time despite being information-theoretically possible.
References
In the regime $d + 1 \le m \ll d{3/4}n{1/4}$, recovering $\beta$ is information-theoretically possible, yet we know no polynomial-time algorithm; we conjecture that this is an information-computation gap, and we prove a statistical query (SQ) lower bound in support of this claim (\cref{thm:SQ}).
The work of conjectures that any polynomial-time algorithm requires $m = \Omega(\sqrt{nd})$ to exactly recover $\beta$, and they provide Statistical Query (SQ) lower bounds to support their claim (the SQ lower bounds are not yet tight to their conjecture, this is left as an open problem).
The work of conjectures that any polynomial-time algorithm requires $m = \Omega(\sqrt{nd})$ to exactly recover $\beta$, and they provide Statistical Query (SQ) lower bounds to support their claim (the SQ lower bounds are not yet tight to their conjecture, this is left as an open problem).