Optimizing Tensor Contraction Paths: A Greedy Algorithm Approach With Improved Cost Functions (2405.09644v1)

Abstract: Finding efficient tensor contraction paths is essential for a wide range of problems, including model counting, quantum circuits, graph problems, and LLMs. There exist several approaches to find efficient paths, such as the greedy and random greedy algorithm by Optimized Einsum (opt_einsum), and the greedy algorithm and hypergraph partitioning approach employed in cotengra. However, these algorithms require a lot of computational time and resources to find efficient contraction paths. In this paper, we introduce a novel approach based on the greedy algorithm by opt_einsum that computes efficient contraction paths in less time. Moreover, with our approach, we are even able to compute paths for large problems where modern algorithms fail.