Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Fitting an ellipsoid to a quadratic number of random points (2307.01181v2)

Published 3 Jul 2023 in math.PR, cs.DS, cs.LG, math.ST, stat.ML, and stat.TH

Abstract: We consider the problem $(\mathrm{P})$ of fitting $n$ standard Gaussian random vectors in $\mathbb{R}d$ to the boundary of a centered ellipsoid, as $n, d \to \infty$. This problem is conjectured to have a sharp feasibility transition: for any $\varepsilon > 0$, if $n \leq (1 - \varepsilon) d2 / 4$ then $(\mathrm{P})$ has a solution with high probability, while $(\mathrm{P})$ has no solutions with high probability if $n \geq (1 + \varepsilon) d2 /4$. So far, only a trivial bound $n \geq d2 / 2$ is known on the negative side, while the best results on the positive side assume $n \leq d2 / \mathrm{polylog}(d)$. In this work, we improve over previous approaches using a key result of Bartl & Mendelson (2022) on the concentration of Gram matrices of random vectors under mild assumptions on their tail behavior. This allows us to give a simple proof that $(\mathrm{P})$ is feasible with high probability when $n \leq d2 / C$, for a (possibly large) constant $C > 0$.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (19)
  1. Radosław Adamczak. A note on the Hanson-Wright inequality for random vectors with dependencies. Electronic Communications in Probability, 20:1 – 13, 2015.
  2. Living on the edge: Phase transitions in convex programs with random data. Information and Inference: A Journal of the IMA, 3(3):224–294, 2014.
  3. Restricted isometry property of matrices with independent columns and neighborly polytopes by random sampling. Constructive Approximation, 34:61–88, 2011.
  4. Random embeddings with an almost Gaussian distortion. Advances in Mathematics, 400:108261, 2022.
  5. Sum-of-squares lower bounds for Sherrington-Kirkpatrick via planted affine planes. In 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS), pages 954–965. IEEE, 2020.
  6. Yehoram Gordon. On Milman’s inequality and random subspaces which escape through a mesh in ℝnsuperscriptℝ𝑛\mathbb{R}^{n}blackboard_R start_POSTSUPERSCRIPT italic_n end_POSTSUPERSCRIPT. In Geometric Aspects of Functional Analysis: Israel Seminar (GAFA) 1986–87, pages 84–106. Springer, 1988.
  7. Ellipsoid fitting up to a constant. In 50th International Colloquium on Automata, Languages, and Programming (ICALP 2023). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2023.
  8. Moment inequalities for sums of certain independent symmetric random variables. Studia Math, 123(1):15–42, 1997.
  9. A nearly tight bound for fitting an ellipsoid to gaussian random points. arXiv preprint arXiv:2212.11221, 2022.
  10. Stochastic ordering of classical discrete distributions. Advances in Applied probability, 42(2):392–410, 2010.
  11. Adaptive estimation of a quadratic functional by model selection. Annals of Statistics, pages 1302–1338, 2000.
  12. Probability and computing: Randomization and probabilistic techniques in algorithms and data analysis. Cambridge university press, 2017.
  13. Overcomplete independent component analysis via SDP. In The 22nd International Conference on Artificial Intelligence and Statistics, pages 2583–2592. PMLR, 2019.
  14. Near-optimal fitting of ellipsoids to random points. arXiv preprint arXiv:2208.09493, 2022.
  15. James James Francis Saunderson. Subspace identification via convex optimization. PhD thesis, Massachusetts Institute of Technology, 2011.
  16. Diagonal and low-rank matrix decompositions, correlation matrices, and ellipsoid fitting. SIAM Journal on Matrix Analysis and Applications, 33(4):1395–1416, 2012.
  17. Diagonal and low-rank decompositions and fitting ellipsoids to random points. In 52nd IEEE Conference on Decision and Control, pages 6031–6036. IEEE, 2013.
  18. Michel Talagrand. The supremum of some canonical processes. American Journal of Mathematics, 116(2):283–325, 1994.
  19. Roman Vershynin. High-dimensional probability: An introduction with applications in data science, volume 47. Cambridge university press, 2018.
Citations (7)

Summary

We haven't generated a summary for this paper yet.