Papers
Topics
Authors
Recent
Search
2000 character limit reached

Matrix Multiplication Reductions

Published 11 Apr 2024 in cs.DS | (2404.08085v1)

Abstract: In this paper we study a worst case to average case reduction for the problem of matrix multiplication over finite fields. Suppose we have an efficient average case algorithm, that given two random matrices $A,B$ outputs a matrix that has a non-trivial correlation with their product $A \cdot B$. Can we transform it into a worst case algorithm, that outputs the correct answer for all inputs without incurring a significant overhead in the running time? We present two results in this direction. (1) Two-sided error in the high agreement regime: We begin with a brief remark about a reduction for high agreement algorithms, i.e., an algorithm which agrees with the correct output on a large (say $>0.9$) fraction of entries, and show that the standard self-correction of linearity allows us to transform such algorithms into algorithms that work in worst case. (2) One-sided error in the low agreement regime: Focusing on average case algorithms with one-sided error, we show that over $\mathbb{F}_2$ there is a reduction that gets an $O(T)$ time average case algorithm that given a random input $A,B$ outputs a matrix that agrees with $A \cdot B$ on at least $51\%$ of the entries (i.e., has only a slight advantage over the trivial algorithm), and transforms it into an $\widetilde{O}(T)$ time worst case algorithm, that outputs the correct answer for all inputs with high probability.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. Quantum Worst-Case to Average-Case Reductions for All Linear Problems, pages 2535–2567.
  2. Worst-case to average-case reductions via additive combinatorics. In STOC 2022, pages 00–00. ACM, 2022.
  3. Josh Alman and Virginia Vassilevska Williams. A refined laser method and faster matrix multiplication. In SODA 2021, pages 522–539. SIAM, 2021.
  4. O(n2.7799) complexity for n × n approximate matrix multiplication. Information Processing Letters, 8(5):234–235, 1979.
  5. On the theory of average case complexity. Journal of Computer and System Sciences, 44(2):193–219, 1992.
  6. Self-testing/correcting with applications to numerical problems. In STOC 1990, pages 73–83. ACM, 1990.
  7. Average-case complexity. Found. Trends Theor. Comput. Sci., 2(1):1–106, oct 2006.
  8. Mei-Chu Chang. A polynomial bound in Freiman’s theorem. Duke Mathematical Journal, 113(3):399 – 419, 2002.
  9. Matrix multiplication via arithmetic progressions. Journal of Symbolic Computation, 9(3):251–280, 1990. Computational algebraic complexity editorial.
  10. Faster matrix multiplication via asymmetric hashing. In 64th IEEE Annual Symposium on Foundations of Computer Science, FOCS 2023, Santa Cruz, CA, USA, November 6-9, 2023, pages 2129–2138. IEEE, 2023.
  11. Oded Goldreich, editor. Studies in complexity and cryptography: miscellanea on the interplay between randomness and computation. Springer-Verlag, Berlin, Heidelberg, 2011.
  12. Hardness self-amplification: Simplified, optimized, and unified. In Proceedings of the 55th Annual ACM Symposium on Theory of Computing, STOC 2023, page 70–83. Association for Computing Machinery, 2023.
  13. No better ways to generate hard NP instances than picking uniformly at random. In 31st Annual Symposium on Foundations of Computer Science, St. Louis, Missouri, USA, October 22-24, 1990, Volume II, pages 812–821. IEEE Computer Society, 1990.
  14. Russell Impagliazzo. A personal view of average-case complexity. Proceedings of Structure in Complexity Theory. Tenth Annual IEEE Conference, pages 134–147, 1995.
  15. Russell Impagliazzo. Relativized separations of worst-case and average-case complexities for NP. In Proceedings of the 26th Annual IEEE Conference on Computational Complexity, CCC 2011, San Jose, California, USA, June 8-10, 2011, pages 104–114. IEEE Computer Society, 2011.
  16. Leonid A. Levin. Average case complete problems. SIAM Journal on Computing, 15(1):285–286, 1986.
  17. François Le Gall. Powers of tensors and fast matrix multiplication. In Proceedings of the 39th International Symposium on Symbolic and Algebraic Computation, ISSAC ’14, page 296–303, New York, NY, USA, 2014. Association for Computing Machinery.
  18. V. Ya. Pan. Strassen’s algorithm is not optimal trilinear technique of aggregating, uniting and canceling for constructing fast algorithms for matrix operations. In 19th Annual Symposium on Foundations of Computer Science (SFCS 1978), pages 166–176, 1978.
  19. Francesco Romani. Some properties of disjoint sums of tensors related to matrix multiplication. SIAM Journal on Computing, 11(2):263–267, 1982.
  20. A. Schönhage. Partial and total matrix multiplication. SIAM Journal on Computing, 10(3):434–455, 1981.
  21. Andrew James Stothers. On the complexity of matrix multiplication. 2010.
  22. Volker Strassen. Gaussian elimination is not optimal. Numerische Mathematik, 13(4):354–356, 1969.
  23. V. Strassen. The asymptotic spectrum of tensors and the exponent of matrix multiplication. In 27th Annual Symposium on Foundations of Computer Science (sfcs 1986), pages 49–54, 1986.
  24. Virginia Vassilevska Williams. Multiplying matrices faster than coppersmith-winograd. In Proceedings of the Forty-Fourth Annual ACM Symposium on Theory of Computing, STOC ’12, page 887–898, New York, NY, USA, 2012. Association for Computing Machinery.

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.