MultIOD: Rehearsal-free Multihead Incremental Object Detector (2309.05334v3)
Abstract: Class-Incremental learning (CIL) refers to the ability of artificial agents to integrate new classes as they appear in a stream. It is particularly interesting in evolving environments where agents have limited access to memory and computational resources. The main challenge of incremental learning is catastrophic forgetting, the inability of neural networks to retain past knowledge when learning a new one. Unfortunately, most existing class-incremental methods for object detection are applied to two-stage algorithms such as Faster-RCNN, and rely on rehearsal memory to retain past knowledge. We argue that those are not suitable in resource-limited environments, and more effort should be dedicated to anchor-free and rehearsal-free object detection. In this paper, we propose MultIOD, a class-incremental object detector based on CenterNet. Our contributions are: (1) we propose a multihead feature pyramid and multihead detection architecture to efficiently separate class representations, (2) we employ transfer learning between classes learned initially and those learned incrementally to tackle catastrophic forgetting, and (3) we use a class-wise non-max-suppression as a post-processing technique to remove redundant boxes. Results show that our method outperforms state-of-the-art methods on two Pascal VOC datasets, while only saving the model in its current state, contrary to other distillation-based counterparts.
- RODEO: replay for online object detection. In 31st British Machine Vision Conference 2020, BMVC 2020, Virtual Event, UK, September 7-10, 2020. BMVA Press, 2020.
- Expert gate: Lifelong learning with a network of experts. In 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017, pages 7120–7129. IEEE Computer Society, 2017.
- A comprehensive study of real-time object detection networks across multiple domains: A survey. CoRR, abs/2208.10895, 2022.
- Deesil: Deep-shallow incremental learning. In Computer Vision - ECCV 2018 Workshops - Munich, Germany, September 8-14, 2018, Proceedings, Part II, pages 151–157. Springer, 2018.
- A comprehensive study of class incremental learning algorithms for visual tasks. CoRR, abs/2011.01844, 2020.
- A training algorithm for optimal margin classifiers. In Proceedings of the Fifth Annual ACM Conference on Computational Learning Theory, COLT 1992, Pittsburgh, PA, USA, July 27-29, 1992, pages 144–152. ACM, 1992.
- A study on crowd detection and density analysis for safety control. International journal of computer sciences and engineering, 6:424–428, 2018.
- Incremental detection of remote sensing objects with feature pyramid and knowledge distillation. IEEE Trans. Geosci. Remote. Sens., 60:1–13, 2022.
- A new knowledge distillation for incremental object detection. In International Joint Conference on Neural Networks, IJCNN 2019 Budapest, Hungary, July 14-19, 2019, pages 1–7. IEEE, 2019.
- Deformable convolutional networks. In IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017, pages 764–773. IEEE Computer Society, 2017.
- The pascal visual object classes (VOC) challenge. Int. J. Comput. Vis., 88(2):303–338, 2010.
- Predictive distillation method of anchor-free object detection model for continual learning. Applied Sciences, 12(13):6419, 2022.
- Take goods from shelves: A dataset for class-incremental object detection. In Proceedings of the 2019 on International Conference on Multimedia Retrieval, ICMR 2019, Ottawa, ON, Canada, June 10-13, 2019, pages 271–278. ACM, 2019a.
- An end-to-end architecture for class-incremental object detection with knowledge distillation. In IEEE International Conference on Multimedia and Expo, ICME 2019, Shanghai, China, July 8-12, 2019, pages 1–6. IEEE, 2019b.
- Deep residual learning for image recognition. CoRR, abs/1512.03385, 2015.
- Multitask-centernet (MCN): efficient and diverse multitask learning using an anchor free approach. In IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2021, Montreal, BC, Canada, October 11-17, 2021, pages 997–1005. IEEE, 2021.
- Incremental object detection via meta-learning. CoRR, abs/2003.08798, 2020.
- Towards open world object detection. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021, pages 5830–5840. Computer Vision Foundation / IEEE, 2021.
- A continual learning survey: Defying forgetting in classification tasks. IEEE Trans. Pattern Anal. Mach. Intell., 44(7):3366–3385, 2022.
- Mnist handwritten digit database. http://yann.lecun.com/exdb/mnist/, 2010.
- RILOD: near real-time incremental learning for object detection at the edge. In Proceedings of the 4th ACM/IEEE Symposium on Edge Computing, SEC 2019, Arlington, Virginia, USA, November 7-9, 2019, pages 113–126. ACM, 2019.
- Incremental learning of single-stage detectors with mining memory neurons. In 2018 IEEE 4th International Conference on Computer and Communications (ICCC), pages 1981–1985. IEEE, 2018.
- Learning without forgetting. In Computer Vision - ECCV 2016 - 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part IV, pages 614–629. Springer, 2016.
- Microsoft COCO: common objects in context. In Computer Vision - ECCV 2014 - 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V, pages 740–755. Springer, 2014.
- Feature pyramid networks for object detection. CoRR, abs/1612.03144, 2016.
- Incdet: In defense of elastic weight consolidation for incremental object detection. IEEE Trans. Neural Networks Learn. Syst., 32(6):2306–2319, 2021.
- SSD: single shot multibox detector. CoRR, abs/1512.02325, 2015.
- Multi-task incremental learning for object detection. arXiv preprint arXiv:2002.05347, 2020.
- Learning efficient convolutional networks through network slimming. CoRR, abs/1708.06519, 2017.
- Catastrophic interference in connectionist networks: The sequential learning problem. The Psychology of Learning and Motivation, 24:104–169, 1989.
- Continual object detection: A review of definitions, strategies, and challenges. CoRR, abs/2205.15445, 2022.
- Continual semantic segmentation via repulsion-attraction of sparse and disentangled latent representations. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021, pages 1114–1124. Computer Vision Foundation / IEEE, 2021.
- Faster ilod: Incremental learning for object detectors based on faster rcnn. Pattern Recognition Letters, 2020.
- SID: incremental learning for anchor-free object detection via selective and inter-related distillation. Comput. Vis. Image Underst., 210:103229, 2021.
- Relationship matters: Relation guided knowledge transfer for incremental learning of object detectors. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR Workshops 2020, Seattle, WA, USA, June 14-19, 2020, pages 1009–1018. Computer Vision Foundation / IEEE, 2020.
- icarl: Incremental classifier and representation learning. In Conference on Computer Vision and Pattern Recognition, 2017.
- You only look once: Unified, real-time object detection. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016, pages 779–788. IEEE Computer Society, 2016.
- Faster R-CNN: towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7-12, 2015, Montreal, Quebec, Canada, pages 91–99, 2015.
- Continual learning strategy in one-stage object detection framework based on experience replay for autonomous driving vehicle. Sensors, 20(23):6777, 2020.
- Incremental learning of object detectors without catastrophic forgetting. In IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017, pages 3420–3429. IEEE Computer Society, 2017.
- Efficientnet: Rethinking model scaling for convolutional neural networks. In Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, pages 6105–6114. PMLR, 2019.
- FCOS: fully convolutional one-stage object detection. In 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, pages 9626–9635. IEEE, 2019.
- An incremental learning of yolov3 without catastrophic forgetting for smart city applications. IEEE Consumer Electron. Mag., 11(5):56–63, 2022.
- Detecting everything in the open world: Towards universal object detection. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023, pages 11433–11443. IEEE, 2023.
- RD-IOD: two-level residual-distillation-based triple-network for incremental object detection. ACM Trans. Multim. Comput. Commun. Appl., 18(1):18:1–18:23, 2022a.
- Multi-view correlation distillation for incremental object detection. Pattern Recognit., 131:108863, 2022b.
- Objects in semantic topology. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022c.
- Class-incremental learning via deep model consolidation. In IEEE Winter Conference on Applications of Computer Vision, WACV 2020, Snowmass Village, CO, USA, March 1-5, 2020, pages 1120–1129. IEEE, 2020.
- Incremental learning of object detection with output merging of compact expert detectors. In 2021 4th International Conference on Intelligent Autonomous Systems (ICoIAS), pages 1–7. IEEE, 2021.
- Lifelong object detection. CoRR, abs/2009.01129, 2020.
- Objects as points. CoRR, abs/1904.07850, 2019.
- Eden Belouadah (10 papers)
- Arnaud Dapogny (33 papers)
- Kevin Bailly (30 papers)