Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Multi-scale Quaternion CNN and BiGRU with Cross Self-attention Feature Fusion for Fault Diagnosis of Bearing (2405.16114v1)

Published 25 May 2024 in cs.AI, cs.CV, and cs.LG

Abstract: In recent years, deep learning has led to significant advances in bearing fault diagnosis (FD). Most techniques aim to achieve greater accuracy. However, they are sensitive to noise and lack robustness, resulting in insufficient domain adaptation and anti-noise ability. The comparison of studies reveals that giving equal attention to all features does not differentiate their significance. In this work, we propose a novel FD model by integrating multi-scale quaternion convolutional neural network (MQCNN), bidirectional gated recurrent unit (BiGRU), and cross self-attention feature fusion (CSAFF). We have developed innovative designs in two modules, namely MQCNN and CSAFF. Firstly, MQCNN applies quaternion convolution to multi-scale architecture for the first time, aiming to extract the rich hidden features of the original signal from multiple scales. Then, the extracted multi-scale information is input into CSAFF for feature fusion, where CSAFF innovatively incorporates cross self-attention mechanism to enhance discriminative interaction representation within features. Finally, BiGRU captures temporal dependencies while a softmax layer is employed for fault classification, achieving accurate FD. To assess the efficacy of our approach, we experiment on three public datasets (CWRU, MFPT, and Ottawa) and compare it with other excellent methods. The results confirm its state-of-the-art, which the average accuracies can achieve up to 99.99%, 100%, and 99.21% on CWRU, MFPT, and Ottawa datasets. Moreover, we perform practical tests and ablation experiments to validate the efficacy and robustness of the proposed approach. Code is available at https://github.com/mubai011/MQCCAF.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (52)
  1. Rolling bearing fault diagnosis method based on self-calibrated coordinate attention mechanism and multi-scale convolutional neural network under small samples. IEEE Sensors Journal, 23(9):10206–10214, 2023.
  2. Fault diagnosis of planetary gears based on intrinsic feature extraction and deep transfer learning. Measurement Science and Technology, 34(1):014009, 2022.
  3. Fault diagnosis of bearing-rotor system based on infrared thermography: Respp with multi-scaled training method. Measurement Science and Technology, 34(12):125030, 2023.
  4. Deep learning aided data-driven fault diagnosis of rotatory machine: A comprehensive review. Energies, 14(16):5150, 2021.
  5. Fault diagnosis of bearing based on convolutional neural network using multi-domain features. KSII Transactions on Internet and Information Systems (TIIS), 15(5):1610–1629, 2021.
  6. Fisher discriminative sparse representation based on dbn for fault diagnosis of complex system. Applied Sciences, 8(5):795, 2018.
  7. 1dcnn fault diagnosis based on cubic spline interpolation pooling. Shock and Vibration, 2020:1–13, 2020.
  8. Fault diagnosis of rotating machinery based on recurrent neural networks. Measurement, 171:108774, 2021.
  9. Stator turn fault diagnosis and severity assessment in converter-fed induction motor using flat diagnosis structure based on deep learning approach. IEEE Journal of Emerging and Selected Topics in Power Electronics, 11(6):5649–5657, 2023.
  10. A fault diagnosis method based on wavelet denoising and 2dcnn under background noise. In 2023 IEEE 12th Data Driven Control and Learning Systems Conference (DDCLS), pages 530–535, 2023.
  11. A muti-stage selection filter based on wavelet packet and 2dcnn for fault diagnosis of rotating machinery. In 2023 42nd Chinese Control Conference (CCC), pages 4951–4955, 2023.
  12. A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors, 17(2):425, 2017.
  13. Multiscale convolutional neural networks for fault diagnosis of wind turbine gearbox. IEEE Transactions on Industrial Electronics, 66(4):3196–3207, 2018.
  14. Fault detection and diagnosis in electric motors using 1d convolutional neural networks with multi-channel vibration signals. Measurement, 190:110759, 2022.
  15. Intelligent fault diagnosis of rolling bearings using an improved deep recurrent neural network. Measurement Science and Technology, 29(6):065107, 2018.
  16. Fault diagnosis of wind turbine based on long short-term memory networks. Renewable energy, 133:422–432, 2019.
  17. Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders. ISA transactions, 77:167–178, 2018.
  18. A novel method for bearing fault diagnosis based on bilstm neural networks. The International Journal of Advanced Manufacturing Technology, 125(3-4):1477–1492, 2023.
  19. Fault diagnosis of rolling bearing based on empirical mode decomposition and convolutional recurrent neural network. In IOP Conference Series: Materials Science and Engineering, volume 1043, page 042015. IOP Publishing, 2021.
  20. Bearing fault diagnosis base on multi-scale cnn and lstm model. Journal of Intelligent Manufacturing, 32:971–987, 2021.
  21. A cnn-lstm–based model to fault diagnosis for cpr1000. Nuclear Technology, pages 1–8, 2023.
  22. Fault diagnosis for small samples based on attention mechanism. Measurement, 187:110242, 2022.
  23. Deep quaternion networks. In 2018 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2018.
  24. Attention-embedded quadratic network (qttention) for effective and interpretable bearing fault diagnosis. IEEE Transactions on Instrumentation and Measurement, 72:1–13, 2023.
  25. Rolling element bearing diagnostics using the case western reserve university data: A benchmark study. Mechanical Systems and Signal Processing, 64:100–131, 2015.
  26. Huan Huang. Bearing vibration data under time-varying rotational speed conditions, 2019.
  27. Convolutional neural net and bearing fault analysis. 2016.
  28. Speech emotion recognition using quaternion convolutional neural networks. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 6309–6313, 2021.
  29. Learning speech emotion representations in the quaternion domain. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31:1200–1212, 2023.
  30. Intermittent fault diagnosis for electronics-rich analog circuit systems based on multi-scale enhanced convolution transformer network with novel token fusion strategy. Expert Systems with Applications, 238:121964, 2024.
  31. Adaptive multi-scale attention convolution neural network for cross-domain fault diagnosis. Expert Systems with Applications, 236:121216, 2024.
  32. Liconvformer: A lightweight fault diagnosis framework using separable multiscale convolution and broadcast self-attention. Expert Systems with Applications, 237:121338, 2024.
  33. Quaternion-valued correlation learning for few-shot semantic segmentation. IEEE Transactions on Circuits and Systems for Video Technology, 2022.
  34. Quaternion attention multi-scale widening network for endoscopy image super-resolution. Physics in Medicine & Biology, 68(7):075012, 2023.
  35. Quaternion-based machine learning on topological quantum systems. Machine Learning: Science and Technology, 4(1):015032, 2023.
  36. Multi-component seismic data random noise attenuation via quaternion wavelet transform. In Journal of Physics: Conference Series, volume 2651, page 012054. IOP Publishing, 2023.
  37. Remaining useful life prediction of bearings based on multi-head self-attention mechanism, multi-scale temporal convolutional network and convolutional neural network. In 2023 35th Chinese Control and Decision Conference (CCDC), pages 3027–3032. IEEE, 2023.
  38. Enhanced self-attention network for remote sensing building change detection. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2023.
  39. Rolling bearing fault diagnosis method based on self-calibrated coordinate attention mechanism and multi-scale convolutional neural network under small samples. IEEE Sensors Journal, 2023.
  40. Bayesian variational transformer: A generalizable model for rotating machinery fault diagnosis. Mechanical Systems and Signal Processing, 207:110936, 2024.
  41. The fault frequency priors fusion deep learning framework with application to fault diagnosis of offshore wind turbines. Renewable Energy, 202:143–153, 2023.
  42. A review of real-time fault diagnosis methods for industrial smart manufacturing. Processes, 11(2):369, 2023.
  43. Application of deep learning to fault diagnosis of rotating machineries. Measurement Science and Technology, 35(4):042003, 2024.
  44. A review of the application of deep learning in intelligent fault diagnosis of rotating machinery. Measurement, 206:112346, 2023.
  45. A dual attention mechanism network with self-attention and frequency channel attention for intelligent diagnosis of multiple rolling bearing fault types. Measurement Science and Technology, 35(3):036112, 2023.
  46. A fault diagnosis algorithm of the dedicated equipment based on lstm mechanism. In 2023 62nd Annual Conference of the Society of Instrument and Control Engineers (SICE), pages 31–36, 2023.
  47. Fault diagnosis of asynchronous motors based on 2dcnn-gru network optimization. In 2023 CAA Symposium on Fault Detection, Supervision and Safety for Technical Processes (SAFEPROCESS), pages 1–6, 2023.
  48. Fault diagnosis method for planetary gearbox based on intrinsic feature extraction and attention mechanism. Measurement Science and Technology, 35(3):035116, 2023.
  49. A two-stage multi-scale domain adversarial transfer learning method and its application in fault diagnosis. Measurement Science and Technology, 34(12):125041, 2023.
  50. Multi-scale convolutional neural network fault diagnosis based on attention mechanism. In 2023 42nd Chinese Control Conference (CCC), pages 1–6, 2023.
  51. Bearing fault diagnosis method based on data augmentation and mcnn-lstm. In 2023 IEEE 6th Information Technology,Networking,Electronic and Automation Control Conference (ITNEC), volume 6, pages 663–671, 2023.
  52. Multi-scale residual neural network with enhanced gated recurrent unit for fault diagnosis of rolling bearing. Measurement Science and Technology, 2024.
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets