Learning-Augmented Dynamic Submodular Maximization (2311.13006v2)
Abstract: In dynamic submodular maximization, the goal is to maintain a high-value solution over a sequence of element insertions and deletions with a fast update time. Motivated by large-scale applications and the fact that dynamic data often exhibits patterns, we ask the following question: can predictions be used to accelerate the update time of dynamic submodular maximization algorithms? We consider the model for dynamic algorithms with predictions where predictions regarding the insertion and deletion times of elements can be used for preprocessing. Our main result is an algorithm with an $O(poly(\log \eta, \log w, \log k))$ amortized update time over the sequence of updates that achieves a $1/2 - \epsilon$ approximation in expectation for dynamic monotone submodular maximization under a cardinality constraint $k$, where the prediction error $\eta$ is the number of elements that are not inserted and deleted within $w$ time steps of their predicted insertion and deletion times. This amortized update time is independent of the length of the stream and instead depends on the prediction error.
- Learning-augmented mechanism design: Leveraging predictions for facility location. EC, 2022.
- Private algorithms with private predictions. arXiv preprint arXiv:2210.11222, 2022.
- Learning to hash robustly, guaranteed. In International Conference on Machine Learning, pages 599–618. PMLR, 2022.
- Secretary and online matching problems with machine learned advice. NeurIPS, 2020.
- The primal-dual method for learning augmented algorithms. In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.
- Online nash social welfare maximization with predictions. In Proceedings of the 2022 ACM-SIAM Symposium on Discrete Algorithms, SODA 2022. SIAM, 2022.
- Dynamic constrained submodular optimization with polylogarithmic update time. ICML, 2023.
- Dynamic algorithms for matroid submodular maximization. In Proceedings of the 2024 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 3485–3533. SIAM, 2024.
- Jeff Bilmes. Submodularity in machine learning and artificial intelligence. arXiv preprint arXiv:2202.00132, 2022.
- On dynamic graph algorithms with predictions. In Proceedings of the 2024 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 3534–3557. SIAM, 2024.
- Xi Chen and Binghui Peng. On the complexity of dynamic submodular maximization. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing, pages 1685–1698, 2022.
- Faster matchings via learned duals. Advances in Neural Information Processing Systems, 34:10393–10406, 2021.
- Fully dynamic submodular maximization over matroids. In Proceedings of the 40th International Conference on Machine Learning, pages 8821–8835, 2023.
- Secretaries with advice. In Proceedings of the 22nd ACM Conference on Economics and Computation, pages 409–429, 2021.
- Learning-augmented k𝑘kitalic_k-means clustering. In International Conference on Learning Representations, 2021.
- Streaming submodular maximization under matroid constraints. In 49th International Colloquium on Automata, Languages, and Programming (ICALP 2022). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2022.
- On the complexity of algorithms with predictions for dynamic graph problems. In 15th Innovations in Theoretical Computer Science Conference (ITCS 2024). Schloss-Dagstuhl-Leibniz Zentrum für Informatik, 2024.
- Online knapsack with frequency predictions. Advances in Neural Information Processing Systems, 34, 2021.
- Scalable deletion-robust submodular maximization: Data summarization with privacy and fairness constraints. In Jennifer G. Dy and Andreas Krause, editors, Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmässan, Stockholm, Sweden, July 10-15, 2018, volume 80 of Proceedings of Machine Learning Research, pages 2549–2558. PMLR, 2018.
- Maximizing the spread of influence through a social network. In KDD, 2003.
- Submodular function maximization. Tractability, 3:71–104, 2014.
- Online scheduling via learned weights. In Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pages 1859–1877. SIAM, 2020a.
- Fully dynamic algorithm for constrained submodular optimization. Advances in Neural Information Processing Systems, 33:12923–12933, 2020b.
- The predicted-deletion dynamic model: Taking advantage of ml predictions, for free. arXiv preprint arXiv:2307.08890, 2023.
- Competitive caching with machine learned advice. J. ACM, 68(4):24:1–24:25, 2021.
- Michael Mitzenmacher. Scheduling with predictions and the price of misprediction. In 11th Innovations in Theoretical Computer Science Conference (ITCS 2020). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2020.
- Morteza Monemizadeh. Dynamic submodular maximization. In Advances in Neural Information Processing Systems, 2020.
- Best algorithms for approximating the maximum of a submodular set function. Mathematics of operations research, 3(3):177–188, 1978.
- An analysis of approximations for maximizing submodular set functions i. Mathematical programming, 14(1):265–294, 1978.
- Binghui Peng. Dynamic influence maximization. Advances in Neural Information Processing Systems, 34:10718–10731, 2021.
- Fully-dynamic-to-incremental reductions with known deletion order (eg sliding window). In Symposium on Simplicity in Algorithms (SOSA), pages 261–271. SIAM, 2023.
- Improving online algorithms via ML predictions. In Advances in Neural Information Processing Systems, pages 9661–9670, 2018.
- Yaron Singer. Budget feasible mechanisms. In 2010 IEEE 51st Annual Symposium on foundations of computer science, pages 765–774. IEEE, 2010.
- Online algorithms for multi-shop ski rental with machine learned advice. Advances in Neural Information Processing Systems, 33, 2020.
- Mechanism design with predictions. In Lud De Raedt, editor, Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, pages 571–577. International Joint Conferences on Artificial Intelligence Organization, 2022.