AE SemRL: Learning Semantic Association Rules with Autoencoders (2403.18133v1)
Abstract: Association Rule Mining (ARM) is the task of learning associations among data features in the form of logical rules. Mining association rules from high-dimensional numerical data, for example, time series data from a large number of sensors in a smart environment, is a computationally intensive task. In this study, we propose an Autoencoder-based approach to learn and extract association rules from time series data (AE SemRL). Moreover, we argue that in the presence of semantic information related to time series data sources, semantics can facilitate learning generalizable and explainable association rules. Despite enriching time series data with additional semantic features, AE SemRL makes learning association rules from high-dimensional data feasible. Our experiments show that semantic association rules can be extracted from a latent representation created by an Autoencoder and this method has in the order of hundreds of times faster execution time than state-of-the-art ARM approaches in many scenarios. We believe that this study advances a new way of extracting associations from representations and has the potential to inspire more research in this field.
- Machine learning for anomaly detection: A systematic review. Ieee Access, 9:78658–78700, 2021.
- A systematic review: machine learning based recommendation systems for e-learning. Education and Information Technologies, 25:2635–2664, 2020.
- A multi-objective pso approach of mining association rules for affective design based on online customer reviews. Journal of Engineering Design, 29(7):381–403, 2018.
- Fast algorithms for mining association rules. In Proc. 20th int. conf. very large data bases, VLDB, volume 1215, pages 487–499. Santiago, Chile, 1994.
- Mining frequent patterns without candidate generation. ACM sigmod record, 29(2):1–12, 2000.
- Numerical association rule mining: A systematic literature review. arXiv preprint arXiv:2307.00662, 2023.
- A survey of evolutionary computation for association rule mining. Information Sciences, 524:318–352, 2020.
- Iqbal H Sarker. Machine learning: Algorithms, real-world applications and research directions. SN computer science, 2(3):160, 2021.
- Rnnlogic: Learning logic rules for reasoning on knowledge graphs. arXiv preprint arXiv:2010.04029, 2020.
- Knowledge Graphs. Number 22 in Synthesis Lectures on Data, Semantics, and Knowledge. Springer, 2021. ISBN 9783031007903. doi:10.2200/S01125ED1V01Y202109DSK022. URL https://kgbook.org/.
- Ontologies in digital twins: A systematic literature review. Future Generation Computer Systems, 2023a.
- On the use of semantic technologies for video analytics. Journal of Ambient Intelligence and Humanized Computing, 12:567–587, 2021.
- Association rules mining with auto-encoders. arXiv preprint arXiv:2304.13717, 2023.
- Applications of association rule mining algorithms in deep learning. In Computer Networks and Inventive Communication Technologies: Proceedings of Third ICCNCT 2020, pages 351–362. Springer, 2021.
- Mining semantic association rules from rdf data. Knowledge-Based Systems, 133:183–196, 2017.
- Claudia d’Amato. Machine learning for the semantic web: Lessons learnt and next research directions. Semantic Web, 11(1):195–203, 2020.
- Semantic association rule learning from time series data and knowledge graphs. In Proceedings of the 2nd International Workshop on Semantic Industrial Information Modelling (SemIIM 2023) co-located with 22nd International Semantic Web Conference (ISWC 2023), pages 1–7, 2023b.
- A deep learning-based cep rule extraction framework for iot data. The Journal of Supercomputing, 77:8563–8592, 2021.
- Rule extraction from neural network trained using deep belief network and back propagation. Knowledge and Information Systems, 62:3753–3781, 2020.
- Harvendra Kumar Patel et al. An innovative approach for association rule mining in grocery dataset based on non-negative matrix factorization and autoencoder. Journal of Algebraic Statistics, 13(3):2898–2905, 2022.
- Auto-encoders in deep learning—a review with new perspectives. Mathematics, 11(8):1777, 2023.
- Defining a knowledge graph development process through a systematic review. ACM Transactions on Software Engineering and Methodology, 32(1):1–40, 2023.
- Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th international conference on Machine learning, pages 1096–1103, 2008.
- Ralph Foorthuis. The impact of discretization method on the detection of six types of anomalies in datasets. arXiv preprint arXiv:2008.12330, 2020.
- Leakdb: a benchmark dataset for leakage diagnosis in water distribution networks:(146). In WDSA/CCWI Joint Conference Proceedings, volume 1, 2018.
- Dataset of battledim: Battle of the leakage detection and isolation methods. In Proc., 2nd Int CCWI/WDSA Joint Conf. Kingston, ON, Canada: Queen’s Univ, 2020.
- Lbnl fault detection and diagnostics datasets, 08 2022. URL https://data.openei.org/submissions/5763.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
- Confidence metrics for association rule mining. Applied Artificial Intelligence, 23(8):713–737, 2009.
- Sebastian Raschka. Mlxtend: Providing machine learning and data science utilities and extensions to python’s scientific computing stack. The Journal of Open Source Software, 3(24), April 2018. doi:10.21105/joss.00638. URL https://joss.theoj.org/papers/10.21105/joss.00638.
- Harris hawks optimization: Algorithm and applications. Future generation computer systems, 97:849–872, 2019.
- Niapy: Python microframework for building nature-inspired algorithms. Journal of Open Source Software, 3(23):613, 2018.
- Niaarm: a minimalistic framework for numerical association rule mining. Journal of Open Source Software, 7(77):4448, 2022.
- Research and improvement on association rule algorithm based on fp-growth. In Web Information Systems and Mining: International Conference, WISM 2012, Chengdu, China, October 26-28, 2012. Proceedings, pages 306–313. Springer, 2012.