Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
184 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

FedLED: Label-Free Equipment Fault Diagnosis with Vertical Federated Transfer Learning (2312.17451v1)

Published 29 Dec 2023 in cs.LG and cs.AI

Abstract: Intelligent equipment fault diagnosis based on Federated Transfer Learning (FTL) attracts considerable attention from both academia and industry. It allows real-world industrial agents with limited samples to construct a fault diagnosis model without jeopardizing their raw data privacy. Existing approaches, however, can neither address the intense sample heterogeneity caused by different working conditions of practical agents, nor the extreme fault label scarcity, even zero, of newly deployed equipment. To address these issues, we present FedLED, the first unsupervised vertical FTL equipment fault diagnosis method, where knowledge of the unlabeled target domain is further exploited for effective unsupervised model transfer. Results of extensive experiments using data of real equipment monitoring demonstrate that FedLED obviously outperforms SOTA approaches in terms of both diagnosis accuracy (up to 4.13 times) and generality. We expect our work to inspire further study on label-free equipment fault diagnosis systematically enhanced by target domain knowledge.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. J. Sun, C. Yan, and J. Wen, “Intelligent bearing fault diagnosis method combining compressed data acquisition and deep learning,” IEEE Trans. Instrum. Meas., vol. 67, no. 1, pp. 185–195, 2017.
  2. M. M. Islam and J.-M. Kim, “Reliable multiple combined fault diagnosis of bearings using heterogeneous feature models and multiclass support vector machines,” Rel. Eng. Syst. Saf., vol. 184, pp. 55–66, 2019.
  3. B. Zhao, Z. Niu, Q. Liang, Y. Xin, T. Qian, W. Tang, and Q. Wu, “Signal-to-signal translation for fault diagnosis of bearings and gears with few fault samples,” IEEE Trans. Instrum. Meas., vol. 70, pp. 1–10, 2021.
  4. Y. Lou, A. Kumar, and J. Xiang, “Machinery fault diagnosis based on domain adaptation to bridge the gap between simulation and measured signals,” IEEE Trans. Instrum. Meas., vol. 71, pp. 1–9, 2022.
  5. Z. Zhao, Q. Zhang, X. Yu, C. Sun, S. Wang, R. Yan, and X. Chen, “Applications of unsupervised deep transfer learning to intelligent fault diagnosis: A survey and comparative study,” IEEE Trans. Instrum. Meas., 2021.
  6. Y. Lei, N. Li, L. Guo, N. Li, T. Yan, and J. Lin, “Machinery health prognostics: A systematic review from data acquisition to rul prediction,” Mech. Syst. Signal Process., vol. 104, pp. 799–834, 2018.
  7. Y. Xia, C. Shen, D. Wang, Y. Shen, W. Huang, and Z. Zhu, “Moment matching-based intraclass multisource domain adaptation network for bearing fault diagnosis,” Mech. Syst. Signal Process., vol. 168, p. 108697, 2022.
  8. Q. Qian, Y. Qin, J. Luo, Y. Wang, and F. Wu, “Deep discriminative transfer learning network for cross-machine fault diagnosis,” Mech. Syst. Signal Process., vol. 186, p. 109884, 2023.
  9. P. Liang, C. Deng, J. Wu, G. Li, Z. Yang, and Y. Wang, “Intelligent fault diagnosis via semisupervised generative adversarial nets and wavelet transform,” IEEE Trans. Instrum. Meas., vol. 69, no. 7, pp. 4659–4671, 2019.
  10. X. Chen, R. Yang, Y. Xue, M. Huang, R. Ferrero, and Z. Wang, “Deep transfer learning for bearing fault diagnosis: A systematic review since 2016,” IEEE Trans. Instrum. Meas., 2023.
  11. X. Ma, C. Wen, and T. Wen, “An asynchronous and real-time update paradigm of federated learning for fault diagnosis,” IEEE Trans. Ind. Informat., vol. 17, no. 12, pp. 8531–8540, 2021.
  12. P. Regulation, “General data protection regulation,” Intouch, vol. 25, 2018.
  13. J. Chen, J. Li, R. Huang, K. Yue, Z. Chen, and W. Li, “Federated transfer learning for bearing fault diagnosis with discrepancy-based weighted federated averaging,” IEEE Trans. Instrum. Meas., vol. 71, pp. 1–11, 2022.
  14. W. Yang, J. Chen, Z. Chen, Y. Liao, and W. Li, “Federated transfer learning for bearing fault diagnosis based on averaging shared layers,” in 2021 Glob. Reliab. Progn. Health Manag. (PHM-Nanjing).   IEEE, 2021, pp. 1–7.
  15. W. Zhang and X. Li, “Data privacy preserving federated transfer learning in machinery fault diagnostics using prior distributions,” Struct. Health Monit., vol. 21, no. 4, pp. 1329–1344, 2022.
  16. S. Yang, L. Zhang, C. Xu, H. Yu, J. Fan, and Z. Xu, “Massive data clustering by multi-scale psychological observations,” Natl. Sci. Rev., vol. 9, no. 2, p. nwab183, 2022.
  17. Y. Liu, Y. Kang, C. Xing, T. Chen, and Q. Yang, “A secure federated transfer learning framework,” IEEE Intell. Syst., vol. 35, no. 4, pp. 70–82, 2020.
  18. B. Yang, S. Xu, Y. Lei, C.-G. Lee, E. Stewart, and C. Roberts, “Multi-source transfer learning network to complement knowledge for intelligent diagnosis of machines with unseen faults,” Mech. Syst. Signal Process., vol. 162, p. 108095, 2022.
  19. Z. Chai, C. Zhao, and B. Huang, “Multisource-refined transfer network for industrial fault diagnosis under domain and category inconsistencies,” IEEE Trans. Cybern., 2021.
  20. E. Tzinis, J. Casebeer, Z. Wang, and P. Smaragdis, “Separate but together: Unsupervised federated learning for speech enhancement from non-iid data,” in 2021 IEEE Workshop Appl. Signal Process. Audio and Acoust. (WASPAA).   IEEE, 2021, pp. 46–50.
  21. X. Li, X. Jia, Y. Wang, S. Yang, H. Zhao, and J. Lee, “Industrial remaining useful life prediction by partial observation using deep learning with supervised attention,” IEEE/ASME Trans. Mechatron., vol. 25, no. 5, pp. 2241–2251, 2020.
  22. T. Han, C. Liu, W. Yang, and D. Jiang, “A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults,” Knowledge-Based Syst., vol. 165, pp. 474–487, 2019.
  23. C. Lu, Z.-Y. Wang, W.-L. Qin, and J. Ma, “Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification,” Signal Process., vol. 130, pp. 377–388, 2017.
  24. T. W. Rauber, F. de Assis Boldt, and F. M. Varejão, “Heterogeneous feature models and feature selection applied to bearing fault diagnosis,” IEEE Trans. Ind. Electron., vol. 62, no. 1, pp. 637–646, 2014.
  25. R. van de Sand, S. Corasaniti, and J. Reiff-Stephan, “Data-driven fault diagnosis for heterogeneous chillers using domain adaptation techniques,” Control Eng. Pract., vol. 112, p. 104815, 2021.
  26. B. Sun and K. Saenko, “Deep coral: Correlation alignment for deep domain adaptation,” in Proc. ECCV.   Springer, 2016, pp. 443–450.
  27. D. Sejdinovic, B. Sriperumbudur, A. Gretton, and K. Fukumizu, “Equivalence of distance-based and rkhs-based statistics in hypothesis testing,” Ann. Stat., pp. 2263–2291, 2013.
  28. M. Long, J. Wang, G. Ding, J. Sun, and P. S. Yu, “Transfer feature learning with joint distribution adaptation,” in Proc. IEEE Int. Conf. Comput. Vision, 2013, pp. 2200–2207.
  29. Y. Ganin, E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, and V. Lempitsky, “Domain-adversarial training of neural networks,” J. Mach. Learn. Res., vol. 17, no. 1, pp. 2096–2030, 2016.
  30. M. Long, Z. Cao, J. Wang, and M. I. Jordan, “Conditional adversarial domain adaptation,” Adv. Neural Inf. Process. Syst., vol. 31, 2018.
  31. Q. Yang, Y. Liu, T. Chen, and Y. Tong, “Federated machine learning: Concept and applications,” ACM Trans. Intell. Syst. Technol. (TIST), vol. 10, no. 2, pp. 1–19, 2019.
  32. X. Peng, Z. Huang, Y. Zhu, and K. Saenko, “Federated adversarial domain adaptation,” arXiv preprint arXiv:1911.02054, 2019.
  33. Y. Chen, X. Qin, J. Wang, C. Yu, and W. Gao, “Fedhealth: A federated transfer learning framework for wearable healthcare,” IEEE Intell. Syst., vol. 35, no. 4, pp. 83–93, 2020.
  34. S. Arora, R. Ge, Y. Liang, T. Ma, and Y. Zhang, “Generalization and equilibrium in generative adversarial nets (gans),” in Int. Conf. Mach. Learn.   PMLR, 2017, pp. 224–232.
  35. M. Long, H. Zhu, J. Wang, and M. I. Jordan, “Deep transfer learning with joint adaptation networks,” in Int. Conf. Mach. learn.   PMLR, 2017, pp. 2208–2217.
  36. D. Hendrycks, K. Lee, and M. Mazeika, “Using pre-training can improve model robustness and uncertainty,” in Int. Conf. Mach. Learn.   PMLR, 2019, pp. 2712–2721.
  37. X. Li, W. Zhang, Q. Ding, and X. Li, “Diagnosing rotating machines with weakly supervised data using deep transfer learning,” IEEE Trans. Ind. Informat., vol. 16, no. 3, pp. 1688–1697, 2019.
  38. “Case western reserve university bearing data center,” accessed 3 August 2022. http: csegroups.case.edu/bearingdatacenter/home.
  39. S. Shao, S. McAleer, R. Yan, and P. Baldi, “Highly accurate machine fault diagnosis using deep transfer learning,” IEEE Trans. Ind. Informat., vol. 15, no. 4, pp. 2446–2455, 2018.
  40. R. J. Dugand, J. L. Tomkins, and W. J. Kennington, “Molecular evidence supports a genic capture resolution of the lek paradox,” Nat. Commun., vol. 10, no. 1, p. 1359, 2019.
  41. M. Long, Y. Cao, Z. Cao, J. Wang, and M. I. Jordan, “Transferable representation learning with deep adaptation networks,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 41, no. 12, pp. 3071–3085, 2018.
Citations (5)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now