A Novel DDPM-based Ensemble Approach for Energy Theft Detection in Smart Grids (2307.16149v3)
Abstract: Energy theft, characterized by manipulating energy consumption readings to reduce payments, poses a dual threat-causing financial losses for grid operators and undermining the performance of smart grids. Effective Energy Theft Detection (ETD) methods become crucial in mitigating these risks by identifying such fraudulent activities in their early stages. However, the majority of current ETD methods rely on supervised learning, which is hindered by the difficulty of labelling data and the risk of overfitting known attacks. To address these challenges, several unsupervised ETD methods have been proposed, focusing on learning the normal patterns from honest users, specifically the reconstruction of input. However, our investigation reveals a limitation in current unsupervised ETD methods, as they can only detect anomalous behaviours in users exhibiting regular patterns. Users with high-variance behaviours pose a challenge to these methods. In response, this paper introduces a Denoising Diffusion Probabilistic Model (DDPM)-based ETD approach. This innovative approach demonstrates impressive ETD performance on high-variance smart grid data by incorporating additional attributes correlated with energy consumption. The proposed methods improve the average ETD performance on high-variance smart grid data from below 0.5 to over 0.9 w.r.t. AUC. On the other hand, our experimental findings indicate that while the state-of-the-art ETD methods based on reconstruction error can identify ETD attacks for the majority of users, they prove ineffective in detecting attacks for certain users. To address this, we propose a novel ensemble approach that considers both reconstruction error and forecasting error, enhancing the robustness of the ETD methodology. The proposed ensemble method improves the average ETD performance on the stealthiest attacks from nearly 0 to 0.5 w.r.t. 5%-TPR.
- P. Glauner, J. A. Meira, P. Valtchev, R. State, and F. Bettinger, “The challenge of non-technical loss detection using artificial intelligence: A survey,” IJCIS, vol. 10, no. 1, p. 760, 2017.
- Eaton. Blackout tracker - united states annual report 2017. [Online]. Available: https://www.eaton.com/explore/c/us-blackout-tracker--2?x=NzOhds
- P. Samadi, H. Mohsenian-Rad, R. Schober, and V. W. Wong, “Advanced demand side management for the future smart grid using mechanism design,” IEEE Transactions on Smart Grid, vol. 3, no. 3, pp. 1170–1180, 2012.
- C. Bharathi, D. Rekha, and V. Vijayakumar, “Genetic algorithm based demand side management for smart grid,” Wireless personal communications, vol. 93, pp. 481–502, 2017.
- A. Takiddin, M. Ismail, U. Zafar, and E. Serpedin, “Robust electricity theft detection against data poisoning attacks in smart grids,” IEEE Transactions on Smart Grid, vol. 12, no. 3, pp. 2675–2684, 2020.
- S. Kumar, L. Hussain, S. Banarjee, and M. Reza, “Energy load forecasting using deep learning approach-lstm and gru in spark cluster,” in 2018 fifth international conference on emerging applications of information technology (EAIT). IEEE, 2018, pp. 1–4.
- N. Wei, C. Li, X. Peng, F. Zeng, and X. Lu, “Conventional models and artificial intelligence-based models for energy consumption forecasting: A review,” Journal of Petroleum Science and Engineering, vol. 181, p. 106187, 2019.
- M. Nabil, M. Ismail, M. Mahmoud, M. Shahin, K. Qaraqe, and E. Serpedin, “Deep learning-based detection of electricity theft cyber-attacks in smart grid ami networks,” in Deep Learning Applications for Cyber Security, 2019, p. 73–102.
- A. Ullah, N. Javaid, O. Samuel, M. Imran, and M. Shoaib, “Cnn and gru based deep neural network for electricity theft detection to secure smart grid,” in IWCMC, 2020, p. 1598–1602.
- H. Gao, S. Kuenzel, and X. Zhang, “A hybrid convlstm-based anomaly detection approach for combating energy theft,” IEEE TIM, vol. 71, no. 3, pp. 1–10, 2022.
- A. Alromih, J. A. Clark, and P. Gope, “Privacy-aware split learning based energy theft detection for smart grids,” in ICICS, 2022, pp. 281–300.
- A. Takiddin, M. Ismail, U. Zafar, and E. Serpedin, “Deep autoencoder-based anomaly detection of electricity theft cyberattacks in smart grids,” ISJ, vol. 16, no. 3, pp. 4106–4117, 2022.
- M. N. Hasan, R. N. Toma, A.-A. Nahid, and M. M. M. Islam, “Electricity theft detection in smart grid systems: A cnn-lstm based approach,” Energies, vol. 12, no. 17, 2019.
- M. Nabil, M. Mahmoud, M. Ismail, and E. Serpedin, “Deep recurrent electricity theft detection in ami networks with evolutionary hyper-parameter tuning,” in 2019 International Conference on Internet of Things, 2019, p. 1002–1008.
- R. Yang, C. Zhang, R. Gao, and L. Zhang, “A novel feature extraction method with feature selection to identify golgi-resident protein types from imbalanced data,” IJMS, vol. 17, no. 2, 2016.
- H. Han, W. Wang, and B. Mao, “Borderline-smote: a new over-sampling method in imbalanced data sets learning,” in ICIC, 2005, p. 878–887.
- H. He, Y. Bai, E. Garcia, and S. Li, “Adasyn: Adaptive synthetic sampling approach for imbalanced learning,” in IEEE International Joint Conference on Computational Intelligence, 2008, p. 1322–1328.
- C. Doersch, “Tutorial on variational autoencoders,” arXiv preprint arXiv:1606.05908, 2016.
- P. Malhotra, A. Ramakrishnan, G. Anand, L. Vig, P. Agarwal, and G. Shroff, “Lstm-based encoder-decoder for multi-sensor anomaly detection,” arXiv preprint arXiv:1607.00148, 2016.
- D. L. Marino, K. Amarasinghe, and M. Manic, “Building energy load forecasting using deep neural networks,” in IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society, 2016, pp. 7046–7051.
- J. Wolleb, F. Bieder, R. Sandkühler, and P. C. Cattin, “Diffusion models for medical anomaly detection,” in MICCAI, 2022.
- J. Wyatt, A. Leach, S. M. Schmon, and C. G. Willcocks, “Anoddpm: Anomaly detection with denoising diffusion probabilistic models using simplex noise,” in CVPR, 2022, pp. 650–656.
- L. Falorsi, P. de Haan, T. R. Davidson, and P. Forré, “Reparameterizing distributions on lie groups,” in The 22nd International Conference on Artificial Intelligence and Statistics. PMLR, 2019, pp. 3244–3253.
- J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” in NIPS, 2020, pp. 6840–6851.
- K. Rasul, C. S. adn I. Schuster, and R. Vollgraf, “Autoregressive denoising diffusion models for multivariate probabilistic time series forecasting,” in ICML, 2021, pp. 8857–8868.
- R. Dey and F. M. Salem, “Gate-variants of gated recurrent unit (gru) neural networks,” in 2017 IEEE 60th international midwest symposium on circuits and systems (MWSCAS). IEEE, 2017, pp. 1597–1600.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-resolution image synthesis with latent diffusion models,” in CVPR, 2022, pp. 10 684–10 695.
- I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to sequence learning with neural networks,” in NIPS, 2014.
- Z. Kong, W. Ping, J. Huang, K. Zhao, and B. Catanzaro, “Diffwave: A versatile diffusion model for audio synthesis,” in ICLR, 2021.
- D. P. Kingma and J. Ba., “Adam: A method for stochastic optimization,” in ICLR, 2015.
- A. Alromih, J. A. Clark, and P. Gope, “Electricity theft detection in the presence of prosumers using a cluster-based multi-feature detection model,” in IEEE SmartGridComm, 2021, pp. 339–345.
- U. D. of Energy. Gridlab-d: The next-generation simulation software. [Online]. Available: https://www.gridlabd.org/
- D. Ulyanov, A. Vedaldi, and V. Lempitsky, “Instance normalization: The missing ingredient for fast stylization,” arXiv preprint arXiv:1607.08022, 2016.