Non-asymptotic multiplicative bounds for LASSO and matrix compressed sensing
Develop rigorous non-asymptotic multiplicative bounds for the excess risk in LASSO regression and nuclear-norm regularized matrix compressed sensing, demonstrating that performance provably tracks the AMP/state-evolution predictions to within constant factors across finite-sample regimes beyond proportional asymptotics.
Sponsor
References
Nonetheless, establishing non-asymptotic multiplicative bounds for LASSO and matrix compressed sensing remains a challenging open problem. Our results provide both motivation and supporting evidence for this direction, which we leave for future work.
— Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime
(2509.24882 - Defilippis et al., 29 Sep 2025) in Section Non-asymptotic state evolution