Accurate Analysis of Sparse Random Projections
Abstract: There has been recently a lot of research on sparse variants of random projections, faster adaptations of the state-of-the-art dimensionality reduction technique originally due to Johsnon and Lindenstrauss. Although the construction is very simple, its analyses are notoriously complicated. Meeting the demand for both simplicity and accuracy, this work establishes sharp sub-poissonian tail bounds for the distribution of sparse random projections. Compared to other works, this analysis provide superior numerical guarantees (exactly matching impossibility results) while being arguably less complicated (the technique resembles Bennet's Inequality and is of independent interest).
- Rademacher chaos, random eulerian graphs and the sparse Johnson-Lindenstrauss transform. arXiv preprint arXiv:1011.2590, 2010.
- Optimal bounds for johnson-lindenstrauss transformations. The Journal of Machine Learning Research, 19(1):2920–2941, 2018.
- Michael B Cohen. Nearly tight oblivious subspace embeddings by trace inequalities. In Proceedings of the twenty-seventh annual ACM-SIAM symposium on Discrete algorithms, pages 278–287. SIAM, 2016.
- Simple analyses of the sparse Johnson-Lindenstrauss transform. In 1st Symposium on Simplicity in Algorithms (SOSA 2018). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2018.
- A sparse Johnson-Lindenstrauss transform. In Proceedings of the forty-second ACM symposium on Theory of computing, pages 341–350, 2010.
- Negative association of random variables with applications. The Annals of Statistics, pages 286–295, 1983.
- Almost optimal explicit johnson-lindenstrauss families. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques, pages 628–639. Springer, 2011.
- A derandomized sparse Johnson-Lindenstrauss transform. Electron. Colloquium Comput. Complex., 17:98, 2010. URL: http://dblp.uni-trier.de/db/journals/eccc/eccc17.html#KaneN10.
- Sparser Johnson-Lindenstrauss transforms. In Society for Industrial and Applied Mathematics and Association for Computing Machinery. Proceeding of the ACM-SIAM Symposium on Discrete Algorithms, page 1195. Society for Industrial and Applied Mathematics, 2012.
- David Pollard. Mini empirical. Manuscript. http://www. stat. yale. edu/pollard/Books/Mini, 2015.
Paper Prompts
Sign up for free to create and run prompts on this paper.