2000 character limit reached
BanglaAutoKG: Automatic Bangla Knowledge Graph Construction with Semantic Neural Graph Filtering (2404.03528v3)
Published 4 Apr 2024 in cs.CL, cs.IR, cs.LG, cs.NE, and cs.SI
Abstract: Knowledge Graphs (KGs) have proven essential in information processing and reasoning applications because they link related entities and give context-rich information, supporting efficient information retrieval and knowledge discovery; presenting information flow in a very effective manner. Despite being widely used globally, Bangla is relatively underrepresented in KGs due to a lack of comprehensive datasets, encoders, NER (named entity recognition) models, POS (part-of-speech) taggers, and lemmatizers, hindering efficient information processing and reasoning applications in the language. Addressing the KG scarcity in Bengali, we propose BanglaAutoKG, a pioneering framework that is able to automatically construct Bengali KGs from any Bangla text. We utilize multilingual LLMs to understand various languages and correlate entities and relations universally. By employing a translation dictionary to identify English equivalents and extracting word features from pre-trained BERT models, we construct the foundational KG. To reduce noise and align word embeddings with our goal, we employ graph-based polynomial filters. Lastly, we implement a GNN-based semantic filter, which elevates contextual understanding and trims unnecessary edges, culminating in the formation of the definitive KG. Empirical findings and case studies demonstrate the universal effectiveness of our model, capable of autonomously constructing semantically enriched KGs from any text.
- Constraint-based question answering with knowledge graph. In Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pages 2503–2514.
- Banglabert: Language model pretraining and benchmarks for low-resource language understanding evaluation in bangla. In Findings of the Association for Computational Linguistics: NAACL 2022, pages 1318–1327.
- Banglanlg and banglat5: Benchmarks and resources for evaluating low-resource natural language generation in bangla. In Findings of the Association for Computational Linguistics: EACL 2023, pages 714–723.
- Dipesh Chakrabarty. 1991. Europe reconsidered: Perceptions of the west in nineteenth century bengal. by tapan raychaudhuri. delhi: Oxford university press, 1988. xviii, 369 pp. rs. 170.00. The Journal of Asian Studies, 50(3):723–724.
- The Bengali Literary Collection of Rabindranath Tagore: Search and Study of Lexical Richness, page 302–314. IGI Global.
- Convolutional neural networks on graphs with fast localized spectral filtering. In Advances in Neural Information Processing Systems.
- BERT: pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers), pages 4171–4186. Association for Computational Linguistics.
- Thibaut d’Hubert. 2018. Literary history of bengal, 8th-19th century ad. Oxford Research Encyclopedia of Asian History.
- Banglarqa: A benchmark dataset for under-resourced bangla language reading comprehension-based question answering with diverse question-answer types. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 2518–2532.
- Octavian-Eugen Ganea and Thomas Hofmann. 2017. Deep joint entity disambiguation with local neural attention. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2619–2629.
- Semantically smooth knowledge graph embedding. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 84–94.
- Sentnob: A dataset for analysing sentiment on noisy bangla texts. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 3265–3271.
- Exploring in-context learning capabilities of foundation models for generating knowledge graphs from text. In TEXT2KG/BiKE@ESWC.
- Dongkwan Kim and Alice Oh. 2021. How to find your friendly neighborhood: Graph attention design with self-supervision. In International Conference on Learning Representations.
- Phong Le and Ivan Titov. 2018. Improving entity linking by modeling latent relations between mentions. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1595–1604.
- Auto-encoding knowledge graph for unsupervised medical report generation. Advances in Neural Information Processing Systems, 34:16266–16279.
- Weisfeiler and leman go neural: Higher-order graph neural networks. In Proceedings of the AAAI conference on artificial intelligence, volume 33, pages 4602–4609.
- Reinforcement learning over sentiment-augmented knowledge graphs towards accurate and explainable recommendation. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, pages 784–793.
- Improving knowledge base construction from robust infobox extraction. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Industry Papers), pages 138–148.
- Label noise reduction in entity typing by heterogeneous partial-label embedding. In Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pages 1825–1834.
- Tree-kgqa: an unsupervised approach for question answering over knowledge graphs. IEEE Access, 10:50467–50478.
- Salim Sazzed. 2022. An annotated dataset and automatic approaches for discourse mode identification in low-resource bengali language. In Proceedings of the Workshop on Multilingual Information Access (MIA), pages 9–15.
- Nettaxo: Automated topic taxonomy construction from text-rich network. In Proceedings of the Web Conference 2020, pages 1908–1919.
- A comparison of semantic similarity methods for maximum human interpretability. In 2019 Artificial Intelligence for Transforming Business and Society (AITB), volume 1, pages 1–4.
- Unsupervised embedding enhancements of knowledge graphs using textual associations. In IJCAI, pages 5218–5225.
- Graph attention networks. In International Conference on Learning Representations.
- Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In Proceedings of the 27th ACM international conference on information and knowledge management, pages 417–426.
- Explicit semantic ranking for academic search via knowledge graph embedding. In Proceedings of the 26th international conference on world wide web, pages 1271–1279.
- Peng Xu and Denilson Barbosa. 2018. Neural fine-grained entity type classification with hierarchy-aware loss. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 16–25.
- Distant supervision for relation extraction via piecewise convolutional neural networks. In Proceedings of the 2015 conference on empirical methods in natural language processing, pages 1753–1762.
- Towards explainable automatic knowledge graph construction with human-in-the-loop. Frontiers in artificial intelligence and applications.
- Correlation coefficients and semantic textual similarity. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 951–962.
- Attention-based bidirectional long short-term memory networks for relation classification. In Proceedings of the 54th annual meeting of the association for computational linguistics (volume 2: Short papers), pages 207–212.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
