2000 character limit reached
Liquid Democracy for Low-Cost Ensemble Pruning (2401.17443v1)
Published 30 Jan 2024 in cs.LG, cs.AI, and cs.MA
Abstract: We argue that there is a strong connection between ensemble learning and a delegative voting paradigm -- liquid democracy -- that can be leveraged to reduce ensemble training costs. We present an incremental training procedure that identifies and removes redundant classifiers from an ensemble via delegation mechanisms inspired by liquid democracy. Through both analysis and extensive experiments we show that this process greatly reduces the computational cost of training compared to training a full ensemble. By carefully selecting the underlying delegation mechanism, weight centralization in the classifier population is avoided, leading to higher accuracy than some boosting methods. Furthermore, this work serves as an exemplar of how frameworks from computational social choice literature can be applied to problems in nontraditional domains.
- “How Should We Vote? A Comparison of Voting Systems within Social Networks” In Thirty-First International Joint Conference on Artificial Intelligence (IJCAI), 2022, pp. 1734–1740
- “On the Limited Applicability of Liquid Democracy” In 3rd Games, Agents, and Incentives Workshop at the 20th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2021
- “When Can Liquid Democracy Unveil the Truth?” In arXiv preprint arXiv:2104.01828, 2021
- Daan Bloembergen, Davide Grossi and Martin Lackner “On Rational Delegations in Liquid Democracy” In Proceedings of the AAAI Conference on Artificial Intelligence 33, 2019, pp. 1796–1803
- Andrea Campagner, Davide Ciucci and Federico Cabitza “Ensemble Learning, Social Choice and Collective Intelligence: An Experimental Comparison of Aggregation Techniques” In Modeling Decisions for Artificial Intelligence: 17th International Conference, MDAI 2020, Sant Cugat, Spain, September 2–4, 2020 17, 2020, pp. 53–65 Springer
- “A Contribution to the Critique of Liquid Democracy.” In Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI), 2019, pp. 116–122
- “Binary Voting with Delegable Proxy: An Analysis of Liquid Democracy” In arXiv preprint arXiv:1707.08741, 2017
- “Voting with Random Classifiers (VORACE): Theoretical and Experimental Analysis” In 19th International Conference on Autonomous Agents and Multiagent Systems (AAMAS) 35.2 Springer, 2021, pp. 22
- Yoav Freund and Robert E Schapire “A Decision-Theoretic Generalization of Online Learning and an Application to Boosting” In European Conference on Computational Learning Theory, 1995, pp. 23–37 Springer
- “In Defense of Liquid Democracy” In Twenty-fourth ACM Conference on Electronic Commerce, 2023
- Anson Kahng, Simon Mackenzie and Ariel D Procaccia “Liquid Democracy: An Algorithmic Perspective” In Proceedings of the AAAI Conference on Artificial Intelligence, 2018
- M Kelly, R Longjohn and K Nottingham “The UCI Machine Learning Repository” In URL https://archive. ics. uci. edu, 2023
- Ludmila I Kuncheva and Christopher J Whitaker “Measures of Diversity in Classifier Ensembles and their Relationship with the Ensemble Accuracy” In Machine Learning 51 Springer, 2003, pp. 181–207
- Jean Antoine Nicolas “Essai sur l’Application de l’Analyse à la Probabilité des Decisions Rendues à la Pluralité des Voix. Par m. le Marquis de Condorcet,…” de l’Imprimerie Royale, 1785
- “Out-of-Core Learning” Accessed: 2023-01-30 In Saturn Cloud URL: https://saturncloud.io/glossary/outofcore-learning/
- “Carbon Emissions and Large Neural Network Training” In arXiv preprint arXiv:2104.10350, 2021
- Alois Paulin “An Overview of Ten Years of Liquid Democracy Research” In The 21st Annual International Conference on Digital Government Research, 2020, pp. 116–121
- “Scikit-learn: Machine Learning in Python” In Journal of Machine Learning Research 12, 2011, pp. 2825–2830
- “Ensemble Learning: A Survey” In Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 8.4 Wiley Online Library, 2018, pp. e1249
- “On the Boosting Pruning Problem” In Machine Learning: ECML 2000: 11th European Conference on Machine Learning Barcelona, Catalonia, Spain, May 31–June 2, 2000, 2000, pp. 404–412 Springer
- “Generalizing from a Few Examples: A Survey on Few-Shot Learning” In ACM Computing Surveys 53.3 ACM New York, NY, USA, 2020, pp. 1–34
- Qiang-Li Zhao, Yan-Huang Jiang and Ming Xu “Incremental Learning Based on Ensemble Pruning” In Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) 1, 2011, pp. 377–381 IEEE
- “Domain Adaptive Ensemble Learning” In IEEE Transactions on Image Processing 30 IEEE, 2021, pp. 8008–8018
- Zhi-Hua Zhou, Jianxin Wu and Wei Tang “Ensembling Neural Networks: Many Could be Better Than All” In Artificial intelligence 137.1-2 Elsevier, 2002, pp. 239–263
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.