Dice Question Streamline Icon: https://streamlinehq.com

Removing the sub-Gaussian assumption in the dependent CGMT

Determine whether Theorem CGMT_2 (the dependent Convex Gaussian Min-Max Theorem under low-rank dependence) holds without the sub-Gaussian assumption on the covariate vectors, by establishing the theorem under weaker tail conditions (e.g., sub-exponential or heavy-tailed distributions) and precisely characterizing any additional requirements needed for the result.

Information Square Streamline Icon: https://streamlinehq.com

Background

The theoretical development of the dependent CGMT (Theorem CGMT_2) and the universality results assume sub-Gaussian covariates for technical convenience. However, the authors’ simulations show universality behavior across distributions with heavier tails (e.g., exponential, gamma, and t-distribution with 3 degrees of freedom), suggesting the sub-Gaussian assumption may not be essential.

The authors explicitly conjecture that sub-Gaussianity is not necessary for the dependent CGMT, motivating a formal extension of Theorem CGMT_2 to broader distribution classes and a precise delineation of conditions under which the theorem remains valid.

References

Indeed in our proof, sub-Gaussianity is only assumed for convenience, and we conjecture that this is not a necessary assumption for \Cref{thm:CGMT_2}.

Universality of High-Dimensional Logistic Regression and a Novel CGMT under Dependence with Applications to Data Augmentation (2502.15752 - Mallory et al., 10 Feb 2025) in Appendix, Section "Simulation Details" (Universality of risks)