Fitting an ellipsoid to a quadratic number of random points (2307.01181v2)
Abstract: We consider the problem $(\mathrm{P})$ of fitting $n$ standard Gaussian random vectors in $\mathbb{R}d$ to the boundary of a centered ellipsoid, as $n, d \to \infty$. This problem is conjectured to have a sharp feasibility transition: for any $\varepsilon > 0$, if $n \leq (1 - \varepsilon) d2 / 4$ then $(\mathrm{P})$ has a solution with high probability, while $(\mathrm{P})$ has no solutions with high probability if $n \geq (1 + \varepsilon) d2 /4$. So far, only a trivial bound $n \geq d2 / 2$ is known on the negative side, while the best results on the positive side assume $n \leq d2 / \mathrm{polylog}(d)$. In this work, we improve over previous approaches using a key result of Bartl & Mendelson (2022) on the concentration of Gram matrices of random vectors under mild assumptions on their tail behavior. This allows us to give a simple proof that $(\mathrm{P})$ is feasible with high probability when $n \leq d2 / C$, for a (possibly large) constant $C > 0$.
- Radosław Adamczak. A note on the Hanson-Wright inequality for random vectors with dependencies. Electronic Communications in Probability, 20:1 – 13, 2015.
- Living on the edge: Phase transitions in convex programs with random data. Information and Inference: A Journal of the IMA, 3(3):224–294, 2014.
- Restricted isometry property of matrices with independent columns and neighborly polytopes by random sampling. Constructive Approximation, 34:61–88, 2011.
- Random embeddings with an almost Gaussian distortion. Advances in Mathematics, 400:108261, 2022.
- Sum-of-squares lower bounds for Sherrington-Kirkpatrick via planted affine planes. In 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS), pages 954–965. IEEE, 2020.
- Yehoram Gordon. On Milman’s inequality and random subspaces which escape through a mesh in ℝnsuperscriptℝ𝑛\mathbb{R}^{n}blackboard_R start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT. In Geometric Aspects of Functional Analysis: Israel Seminar (GAFA) 1986–87, pages 84–106. Springer, 1988.
- Ellipsoid fitting up to a constant. In 50th International Colloquium on Automata, Languages, and Programming (ICALP 2023). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2023.
- Moment inequalities for sums of certain independent symmetric random variables. Studia Math, 123(1):15–42, 1997.
- A nearly tight bound for fitting an ellipsoid to gaussian random points. arXiv preprint arXiv:2212.11221, 2022.
- Stochastic ordering of classical discrete distributions. Advances in Applied probability, 42(2):392–410, 2010.
- Adaptive estimation of a quadratic functional by model selection. Annals of Statistics, pages 1302–1338, 2000.
- Probability and computing: Randomization and probabilistic techniques in algorithms and data analysis. Cambridge university press, 2017.
- Overcomplete independent component analysis via SDP. In The 22nd International Conference on Artificial Intelligence and Statistics, pages 2583–2592. PMLR, 2019.
- Near-optimal fitting of ellipsoids to random points. arXiv preprint arXiv:2208.09493, 2022.
- James James Francis Saunderson. Subspace identification via convex optimization. PhD thesis, Massachusetts Institute of Technology, 2011.
- Diagonal and low-rank matrix decompositions, correlation matrices, and ellipsoid fitting. SIAM Journal on Matrix Analysis and Applications, 33(4):1395–1416, 2012.
- Diagonal and low-rank decompositions and fitting ellipsoids to random points. In 52nd IEEE Conference on Decision and Control, pages 6031–6036. IEEE, 2013.
- Michel Talagrand. The supremum of some canonical processes. American Journal of Mathematics, 116(2):283–325, 1994.
- Roman Vershynin. High-dimensional probability: An introduction with applications in data science, volume 47. Cambridge university press, 2018.