AdaProj: Adaptively Scaled Angular Margin Subspace Projections for Anomalous Sound Detection with Auxiliary Classification Tasks
Abstract: The state-of-the-art approach for semi-supervised anomalous sound detection is to first learn an embedding space by using auxiliary classification tasks based on meta information or self-supervised learning and then estimate the distribution of normal data. In this work, AdaProj a novel loss function for training the embedding model is presented. In contrast to commonly used angular margin losses, which project data of each class as close as possible to their corresponding class centers, AdaProj learns to project data onto class-specific subspaces while still ensuring an angular margin between classes. By doing so, the resulting distributions of the embeddings belonging to normal data are not required to be as restrictive as other loss functions allowing a more detailed view on the data. In experiments conducted on the DCASE2022 and DCASE2023 anomalous sound detection datasets, it is shown that using AdaProj to learn an embedding space significantly outperforms other commonly used loss functions.
- C. Aggarwal, Outlier Analysis, Springer, 2nd edition, 2017.
- K. Dohi et al., “Description and discussion on DCASE 2022 challenge task 2: Unsupervised anomalous sound detection for machine condition monitoring applying domain generalization techniques,” in DCASE. 2022, pp. 26–30, Tampere University.
- K. Dohi et al., “Description and discussion on DCASE 2023 challenge task 2: First-shot unsupervised anomalous sound detection for machine condition monitoring,” in DCASE. 2023, pp. 31–35, Tampere University.
- “Generalizing to unseen domains: A survey on domain generalization,” in IJCAI. 2021, pp. 4627–4635, ijcai.org.
- K. Wilkinghoff and F. Kurth, “Why do angular margin losses work well for semi-supervised anomalous sound detection?,” IEEE/ACM TASLP, vol. 32, pp. 608–622, 2024.
- “Self-supervised classification for detecting anomalous sounds,” in DCASE, 2020, pp. 46–50.
- “A speaker recognition approach to anomaly detection,” in DCASE, 2020, pp. 96–99.
- T. Inoue et al., “Detection of anomalous sounds for machine condition monitoring using classification confidence,” in DCASE, 2020, pp. 66–70.
- “Improved domain generalization via disentangled multi-task learning in unsupervised anomalous sound detection,” in DCASE. 2022, pp. 196–200, Tampere University.
- “Anomalous sound detection based on machine activity detection,” in EUSIPCO. 2022, pp. 269–273, IEEE.
- Y. Deng et al., “Ensemble of multiple anomalous sound detectors,” in DCASE. 2022, Tampere University.
- H. Chen et al., “An effective anomalous sound detection method based on representation learning with simulated anomalies,” in ICASSP. IEEE, 2023.
- “Deep anomaly detection with outlier exposure,” in ICLR. 2019, OpenReview.net.
- “Anomalous sound detection as a simple binary classification problem with careful selection of proxy outlier examples,” in DCASE, 2020, pp. 170–174.
- “Additive margin softmax for face verification,” IEEE SPL, vol. 25, no. 7, pp. 926–930, 2018.
- L. Ruff et al., “Deep one-class classification,” in ICML. 2018, vol. 80 of Proceedings of Machine Learning Research, pp. 4390–4399, PMLR.
- P. Perera and V. M. Patel, “Learning deep features for one-class classification,” IEEE TIP, vol. 28, no. 11, pp. 5450–5463, 2019.
- “A discriminative feature learning approach for deep face recognition,” in ECCV. Springer, 2016, pp. 499–515.
- “Ensemble of complementary anomaly detectors under domain shifted conditions,” in DCASE, 2021, pp. 11–15.
- “ArcFace: Additive angular margin loss for deep face recognition,” in CVPR. 2019, pp. 4690–4699, IEEE.
- “An ensemble approach to anomalous sound detection based on conformer-based autoencoder and binary classifier incorporated with metric learning,” in DCASE, 2021, pp. 110–114.
- K. Wilkinghoff, “Combining multiple distributions based on sub-cluster adacos for anomalous sound detection under domain shifted conditions,” in DCASE, 2021, pp. 55–59.
- K. Wilkinghoff, “Design choices for learning embeddings from auxiliary tasks for domain generalization in anomalous sound detection,” in ICASSP. 2023, IEEE.
- “AdaCos: Adaptively scaling cosine logits for effectively learning deep face representations,” in CVPR. 2019, pp. 10823–10832, IEEE.
- K. Wilkinghoff, “Sub-cluster AdaCos: Learning representations for anomalous sound detection,” in IJCNN. 2021, IEEE.
- “Autoencoder framework based on orthogonal projection constraints improves anomalies detection,” Neurocomputing, vol. 450, pp. 372–388, 2021.
- “Learnable subspace orthogonal projection for semi-supervised image classification,” in ACCV. 2022, vol. 13843 of Lecture Notes in Computer Science, pp. 477–490, Springer.
- “Approximation with random bases: Pro et contra,” Information Sciences, vol. 364-365, pp. 129–145, 2016.
- S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in ICML, 2015, vol. 37, pp. 448–456.
- “ToyADMOS2: Another dataset of miniature-machine operating sounds for anomalous sound detection under domain shift conditions,” in DCASE, 2021, pp. 1–5.
- K. Dohi et al., “MIMII DG: sound dataset for malfunctioning industrial machine investigation and inspection for domain generalization task,” in DCASE. 2022, pp. 26–30, Tampere University.
- “ToyADMOS2+: New toyadmos data and benchmark results of the first-shot anomalous sound event detection baseline,” in DCASE. 2023, pp. 41–45, Tampere University.
- D. Katzman McClish, “Analyzing a portion of the ROC curve,” Medical decision making, vol. 9, no. 3, pp. 190–195, 1989.
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in ICLR, Yoshua Bengio and Yann LeCun, Eds., 2015.
- X. Glorot and Y. Bengio, “Understanding the difficulty of training deep feedforward neural networks,” in AISTATS. 2010, vol. 9 of JMLR Proceedings, pp. 249–256, JMLR.org.
- “Mixup: Beyond empirical risk minimization,” in ICLR. 2018, OpenReview.net.
- K. Wilkinghoff, “Fraunhofer FKIE submission for task 2: First-shot unsupervised anomalous sound detection for machine condition monitoring,” Tech. Rep., DCASE2023 Challenge, 2023.
- Kevin Wilkinghoff, “Self-supervised learning for anomalous sound detection,” arXiv:2312.09578, 2024.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.