2000 character limit reached
Fine-Grained Engine Fault Sound Event Detection Using Multimodal Signals (2403.11037v1)
Published 16 Mar 2024 in eess.AS and cs.SD
Abstract: Sound event detection (SED) is an active area of audio research that aims to detect the temporal occurrence of sounds. In this paper, we apply SED to engine fault detection by introducing a multimodal SED framework that detects fine-grained engine faults of automobile engines using audio and accelerometer-recorded vibration. We first introduce the problem of engine fault SED on a dataset collected from a large variety of vehicles with expertly-labeled engine fault sound events. Next, we propose a SED model to temporally detect ten fine-grained engine faults that occur within vehicle engines and further explore a pretraining strategy using a large-scale weakly-labeled engine fault dataset. Through multiple evaluations, we show our proposed framework is able to effectively detect engine fault sound events. Finally, we investigate the interaction and characteristics of each modality and show that fusing features from audio and vibration improves overall engine fault SED capabilities.
- T. Denton, Advanced Automotive Fault Diagnosis, Taylor & Francis, 2006.
- “Review of automatic fault diagnosis systems using audio and vibration signals,” IEEE Transactions on systems, man, and cybernetics: Systems, vol. 44, no. 5, 2013.
- Wail M Adaileh, “Engine fault diagnosis using acoustic signals,” Applied Mechanics and Materials, vol. 295, 2013.
- “Intelligent fault diagnosis of diesel engines via extreme gradient boosting and high-accuracy time–frequency information of vibration signals,” Sensors, vol. 19, no. 15, pp. 3280, 2019.
- “Vibro-acoustic condition monitoring of internal combustion engines: A critical review of existing techniques,” Mechanical Systems and Signal Processing, vol. 99, pp. 661–683, 2018.
- “Large-scale acoustic automobile fault detection: Diagnosing engines through sound,” in Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2022, pp. 2871–2881.
- “Real-time abnormality detection and classification in diesel engine operations with convolutional neural network,” Expert Systems with Applications, vol. 192, pp. 116233, 2022.
- “Fault detection and diagnosis in electric motors using 1d convolutional neural networks with multi-channel vibration signals,” Measurement, vol. 190, pp. 110759, 2022.
- “Sound event detection in domestic environments with weakly labeled data and soundscape synthesis,” in Workshop on Detection and Classification of Acoustic Scenes and Events, 2019.
- “Scaper: A library for soundscape synthesis and augmentation,” in 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA). IEEE, 2017, pp. 344–348.
- “Tut database for acoustic scene classification and sound event detection,” in 2016 24th European Signal Processing Conference (EUSIPCO). IEEE, 2016, pp. 1128–1132.
- Lu JiaKai, “Mean teacher convolution system for dcase 2018 task 4,” Tech. Rep., DCASE2018 Challenge, September 2018.
- “A multi-resolution crnn-based approach for semi-supervised sound event detection in dcase 2020 challenge,” IEEE Access, vol. 9, pp. 89029–89042, 2021.
- “Subband dependency modeling for sound event detection,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023, pp. 1–5.
- “Forward-backward convolutional recurrent neural networks and tag-conditioned convolutional neural networks for weakly labeled semi-supervised sound event detection,” arXiv preprint arXiv:2103.06581, 2021.
- “Weakly-supervised sound event detection with self-attention,” in ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2020.
- “Ast-sed: An effective sound event detection method based on audio spectrogram transformer,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023.
- “Temporal contrastive-loss for audio event detection,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 326–330.
- “Towards duration robust weakly supervised sound event detection,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 29, pp. 887–900, 2021.
- “Large-scale weakly labeled semi-supervised sound event detection in domestic environments,” arXiv preprint arXiv:1807.10501, 2018.
- “Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results,” Advances in neural information processing systems, vol. 30, 2017.
- “Decoupled weight decay regularization,” arXiv preprint arXiv:1711.05101, 2017.
- “Contrastive representation learning: A framework and review,” Ieee Access, vol. 8, pp. 193907–193934, 2020.
- “Supervised contrastive learning,” Advances in neural information processing systems, vol. 33, 2020.
- “Multi-label image classification with contrastive learning,” arXiv preprint arXiv:2107.11626, 2021.
- “A framework for the robust evaluation of sound event detection,” in ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2020, pp. 61–65.
- “Threshold independent evaluation of sound event detection scores,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 1021–1025.
- “Metrics for polyphonic sound event detection,” Applied Sciences, vol. 6, no. 6, pp. 162, 2016.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.