Unified Projection-Free Algorithms for Adversarial DR-Submodular Optimization (2403.10063v2)
Abstract: This paper introduces unified projection-free Frank-Wolfe type algorithms for adversarial continuous DR-submodular optimization, spanning scenarios such as full information and (semi-)bandit feedback, monotone and non-monotone functions, different constraints, and types of stochastic queries. For every problem considered in the non-monotone setting, the proposed algorithms are either the first with proven sub-linear $\alpha$-regret bounds or have better $\alpha$-regret bounds than the state of the art, where $\alpha$ is a corresponding approximation bound in the offline setting. In the monotone setting, the proposed approach gives state-of-the-art sub-linear $\alpha$-regret bounds among projection-free algorithms in 7 of the 8 considered cases while matching the result of the remaining case. Additionally, this paper addresses semi-bandit and bandit feedback for adversarial DR-submodular optimization, advancing the understanding of this optimization area.
- Optimal algorithms for online convex optimization with multi-point bandit feedback. In Proceedings of the 23rd Annual Conference on Learning Theory, 2010.
- Continuous DR-submodular maximization: Structure and algorithms. In Advances in Neural Information Processing Systems, 2017a.
- Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domains. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, April 2017b.
- Optimal continuous DR-submodular maximization and applications to provable mean field inference. In Proceedings of the 36th International Conference on Machine Learning, June 2019.
- Conditional Gradient Methods. arXiv preprint arXiv:2211.14103, November 2022.
- Projection-free online optimization with stochastic gradient: From convexity to submodularity. In Proceedings of the 35th International Conference on Machine Learning, July 2018a.
- Online continuous submodular maximization. In Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics, April 2018b.
- Black box submodular maximization: Discrete and continuous settings. In Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics, August 2020.
- Continuous non-monotone DR-submodular maximization with down-closed convex constraint. arXiv preprint arXiv:2307.09616, July 2023.
- Following the perturbed leader for online structured learning. In Proceedings of the 32nd International Conference on Machine Learning, July 2015.
- From map to marginals: Variational inference in Bayesian submodular models. Advances in Neural Information Processing Systems, 2014.
- Donglei Du. Lyapunov function approach for approximation algorithm design and analysis: with applications in submodular maximization. arXiv preprint arXiv:2205.12442, 2022.
- An improved approximation algorithm for maximizing a DR-submodular function over a convex set. arXiv preprint arXiv:2203.14740, 2022.
- Non-monotone DR-submodular maximization: Approximation and regret guarantees. arXiv preprint arXiv:1905.09595, 2019.
- Uriel Feige. A threshold of ln n for approximating set cover. Journal of the ACM, 45(4):634–652, July 1998.
- Online convex optimization in the bandit setting: gradient descent without a gradient. In Proceedings of the sixteenth annual ACM-SIAM symposium on Discrete algorithms, pp. 385–394, 2005.
- Submodular maximization by simulated annealing. In Proceedings of the Twenty-Second Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1098–1116, January 2011.
- Profit maximization in social networks and non-monotone DR-submodular maximization. Theoretical Computer Science, 957:113847, 2023.
- Gradient methods for submodular maximization. In Advances in Neural Information Processing Systems, 2017.
- Elad Hazan et al. Introduction to online convex optimization. Foundations and Trends® in Optimization, 2(3-4):157–325, 2016.
- Large-scale price optimization via network flow. Advances in Neural Information Processing Systems, 2016.
- Efficient algorithms for online decision problems. Journal of Computer and System Sciences, 71(3):291–307, 2005.
- Stochastic continuous greedy ++: When upper and lower bounds match. In Advances in Neural Information Processing Systems, 2019.
- Experimental design networks: A paradigm for serving heterogeneous learners under networking constraints. IEEE/ACM Transactions on Networking, 2023.
- Improved Projection-free Online Continuous Submodular Maximization. arXiv preprint arXiv:2305.18442, May 2023.
- Submodular+ concave. Advances in Neural Information Processing Systems, 2021.
- Stochastic conditional gradient methods: From convex minimization to submodular maximization. The Journal of Machine Learning Research, 21(1):4232–4280, 2020.
- Resolving the approximability of offline and online non-monotone DR-submodular maximization over general convex sets. In Proceedings of The 26th International Conference on Artificial Intelligence and Statistics, April 2023.
- Optimal algorithms for continuous non-monotone submodular and DR-submodular maximization. The Journal of Machine Learning Research, 21(1):4937–4967, 2020.
- Online learning via offline greedy algorithms: Applications in market design and optimization. Management Science, 69(7):3797–3817, July 2023.
- A unified approach for maximizing continuous DR-submodular functions. Advances in Neural Information Processing Systems, December 2023.
- Ohad Shamir. An optimal algorithm for bandit and zero-order convex optimization with two-point feedback. Journal of Machine Learning Research, 18(52):1–11, 2017.
- An online algorithm for maximizing submodular functions. In Proceedings of the 21st International Conference on Neural Information Processing Systems, pp. 1577–1584, December 2008.
- Online non-monotone DR-submodular maximization. Proceedings of the AAAI Conference on Artificial Intelligence, May 2021.
- Jan Vondrák. Symmetry and approximability of submodular maximization problems. SIAM Journal on Computing, 42(1):265–304, 2013.
- Bandit multi-linear dr-submodular maximization and its applications on adversarial submodular bandits. In International Conference on Machine Learning, 2023.
- Online continuous submodular maximization: From full-information to bandit feedback. In Advances in Neural Information Processing Systems, volume 32, 2019.
- Stochastic continuous submodular maximization: Boosting via non-oblivious function. In Proceedings of the 39th International Conference on Machine Learning, 2022.
- Online learning for non-monotone DR-submodular maximization: From full information to bandit feedback. In Proceedings of The 26th International Conference on Artificial Intelligence and Statistics, April 2023.