2000 character limit reached
The Impossibility of Parallelizing Boosting (2301.09627v3)
Published 23 Jan 2023 in cs.LG, cs.CC, and cs.DS
Abstract: The aim of boosting is to convert a sequence of weak learners into a strong learner. At their heart, these methods are fully sequential. In this paper, we investigate the possibility of parallelizing boosting. Our main contribution is a strong negative result, implying that significant parallelization of boosting requires an exponential blow-up in the total computing resources needed for training.