Enhancing Power Quality Event Classification with AI Transformer Models (2402.14949v1)
Abstract: Recently, there has been a growing interest in utilizing machine learning for accurate classification of power quality events (PQEs). However, most of these studies are performed assuming an ideal situation, while in reality, we can have measurement noise, DC offset, and variations in the voltage signal's amplitude and frequency. Building on the prior PQE classification works using deep learning, this paper proposes a deep-learning framework that leverages attention-enabled Transformers as a tool to accurately classify PQEs under the aforementioned considerations. The proposed framework can operate directly on the voltage signals with no need for a separate feature extraction or calculation phase. Our results show that the proposed framework outperforms recently proposed learning-based techniques. It can accurately classify PQEs under the aforementioned conditions with an accuracy varying between 99.81%$-$91.43% depending on the signal-to-noise ratio, DC offsets, and variations in the signal amplitude and frequency.
- J. Li, H. Liu, D. Wang, and T. Bi, “Classification of power quality disturbance based on s-transform and convolution neural network,” Frontiers in Energy Research, vol. 9, p. 708131, 2021.
- M. A. Rodriguez, J. F. Sotomonte, J. Cifuentes, and M. Bueno-López, “Power quality disturbance classification via deep convolutional auto-encoders and stacked lstm recurrent neural networks,” in 2020 International Conference on Smart Energy Systems and Technologies (SEST). IEEE, 2020, pp. 1–6.
- N. Mohan, K. Soman, and R. Vinayakumar, “Deep power: Deep learning architectures for power quality disturbances classification,” in 2017 international conference on technological advancements in power and energy (TAP Energy). IEEE, 2017, pp. 1–6.
- W. Qiu, Q. Tang, J. Liu, and W. Yao, “An automatic identification framework for complex power quality disturbances based on multifusion convolutional neural network,” IEEE Trans. Industr. Inform., vol. 16, no. 5, pp. 3233–3241, 2019.
- C. Iturrino-García, G. Patrizi, A. Bartolini, L. Ciani, L. Paolucci, A. Luchetta, and F. Grasso, “An innovative single shot power quality disturbance detector algorithm,” IEEE Trans. Instrum. Meas., vol. 71, pp. 1–10, 2022.
- L. Fu, K. Yan, and T. Zhu, “Powercog: A practical method for recognizing power quality disturbances accurately in a noisy environment,” IEEE Trans. Industr. Inform., vol. 18, no. 5, pp. 3105–3113, 2021.
- J. Tian, B. Wang, J. Li, and Z. Wang, “Adversarial attacks and defense for cnn based power quality recognition in smart grid,” IEEE Trans. Netw. Sci. Eng., vol. 9, no. 2, pp. 807–819, 2021.
- M. Mishra, “Power quality disturbance detection and classification using signal processing and soft computing techniques: A comprehensive review,” International Trans. electrical energy systems, vol. 29, no. 8, p. e12008, 2019.
- C. Ge, R. A. de Oliveira, I. Y.-H. Gu, and M. H. Bollen, “Deep feature clustering for seeking patterns in daily harmonic variations,” IEEE Trans. Instrum. Meas., vol. 70, pp. 1–10, 2020.
- M. Sahani and P. K. Dash, “Fpga-based semisupervised multifusion rdcnn of process robust vmd data with online kernel rvfln for power quality events recognition,” IEEE Trans. Neural Netw. Learn. Syst., vol. 33, no. 2, pp. 515–527, 2020.
- D. Gu, Y. Gao, Y. Li, Y. Zhu, and C. Wu, “A novel label-guided attention method for multilabel classification of multiple power quality disturbances,” IEEE Trans. Industr. Inform., vol. 18, no. 7, pp. 4698–4706, 2021.
- D. H. Chiam and K. H. Lim, “Power quality disturbance classification using transformer network,” in International Conference on Cyber Warfare, Security and Space Research. Springer, 2021, pp. 272–282.
- D. H. Chiam, K. H. Lim, and K. H. Law, “Detection of power quality disturbances using wavelet-based convolutional transformer network,” in 2022 International Conference on Green Energy, Computing and Sustainable Technology (GECOST), 2022, pp. 150–154.
- R. Machlev, M. Perl, J. Belikov, K. Y. Levy, and Y. Levron, “Measuring explainability and trustworthiness of power quality disturbances classifiers using xai—explainable artificial intelligence,” IEEE Trans. Industr. Inform., vol. 18, no. 8, pp. 5127–5137, 2021.
- A. M. Saber, A. Selim, V. Kadkikar, H. Zeineldin, and E. El-Saadany, “Fast deep-learning-based recognition of multiple power quality events under noise and dc offset,” in 2023 IEEE Conference on Power Electronics and Renewable Energy (CPERE). IEEE, 2023, pp. 1–6.
- A. M. Saber, A. Youssef, D. Svetinovic, H. Zeineldin, and E. El-Saadany, “Learning-based detection of malicious volt-var control parameters in smart inverters,” in IECON 2023- 49th Annual Conference of the IEEE Industrial Electronics Society, 2023, pp. 1–6.
- J. Vig, “A multiscale visualization of attention in the transformer model,” arXiv preprint arXiv:1906.05714, 2019.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- T. Ntakouris, “Timeseries classification with a transformer model,” keras.io/examples/timeseries/timeseries_classification_transformer/, 2021.
- A. M. Saber, A. Youssef, D. Svetinovic, H. H. Zeineldin, and E. F. El-Saadany, “Anomaly-based detection of cyberattacks on line current differential relays,” IEEE Trans. Smart Grid, vol. 13, no. 6, pp. 4787–4800, 2022.
- N. S. Keskar and R. Socher, “Improving generalization performance by switching from adam to sgd,” arXiv preprint arXiv:1712.07628, 2017.
- A. M. Saber, A. Youssef, D. Svetinovic, H. Zeineldin, and E. F. El-Saadany, “Cyber-immune line current differential relays,” IEEE Trans. Industr. Inform., 2023, doi: 10.1109/TII.2023.3310769.