Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

The Integration of Semantic and Structural Knowledge in Knowledge Graph Entity Typing (2404.08313v1)

Published 12 Apr 2024 in cs.CL and cs.AI

Abstract: The Knowledge Graph Entity Typing (KGET) task aims to predict missing type annotations for entities in knowledge graphs. Recent works only utilize the \textit{\textbf{structural knowledge}} in the local neighborhood of entities, disregarding \textit{\textbf{semantic knowledge}} in the textual representations of entities, relations, and types that are also crucial for type inference. Additionally, we observe that the interaction between semantic and structural knowledge can be utilized to address the false-negative problem. In this paper, we propose a novel \textbf{\underline{S}}emantic and \textbf{\underline{S}}tructure-aware KG \textbf{\underline{E}}ntity \textbf{\underline{T}}yping~{(SSET)} framework, which is composed of three modules. First, the \textit{Semantic Knowledge Encoding} module encodes factual knowledge in the KG with a Masked Entity Typing task. Then, the \textit{Structural Knowledge Aggregation} module aggregates knowledge from the multi-hop neighborhood of entities to infer missing types. Finally, the \textit{Unsupervised Type Re-ranking} module utilizes the inference results from the two models above to generate type predictions that are robust to false-negative samples. Extensive experiments show that SSET significantly outperforms existing state-of-the-art methods.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. Entity type prediction leveraging graph walks and entity descriptions. In The Semantic Web – ISWC 2022, pages 392–410, Cham. Springer International Publishing.
  2. Cat2type: Wikipedia category embeddings for entity typing in knowledge graphs. In Proceedings of the 11th Knowledge Capture Conference, K-CAP ’21, page 81–88, New York, NY, USA. Association for Computing Machinery.
  3. Freebase: A collaboratively created graph database for structuring human knowledge. In Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, SIGMOD ’08, page 1247–1250, New York, NY, USA. Association for Computing Machinery.
  4. Translating embeddings for modeling multi-relational data. In Advances in Neural Information Processing Systems 26, volume 26. Curran Associates, Inc.
  5. Improving entity linking by modeling latent entity type information. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05):7529–7537.
  6. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota. Association for Computational Linguistics.
  7. Compounding geometric operations for knowledge graph completion. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 6947–6965, Toronto, Canada. Association for Computational Linguistics.
  8. Lora: Low-rank adaptation of large language models.
  9. Transformer-based entity typing in knowledge graphs. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 5988–6001, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
  10. Type-aware embeddings for multi-hop reasoning over knowledge graphs. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, pages 3078–3084. International Joint Conferences on Artificial Intelligence Organization. Main Track.
  11. Empowering language models with knowledge graph reasoning for open-domain question answering. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 9562–9581, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
  12. Fine-grained entity typing via hierarchical multi graph convolutional networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 4969–4978, Hong Kong, China. Association for Computational Linguistics.
  13. A good neighbor, a found treasure: Mining treasured neighbors for knowledge graph entity typing. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 480–490, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
  14. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings.
  15. Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings.
  16. FastBERT: a self-distilling BERT with adaptive inference time. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6035–6044, Online. Association for Computational Linguistics.
  17. Robust knowledge graph completion with stacked convolutions and a student re-ranking network. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 1016–1029, Online. Association for Computational Linguistics.
  18. Learning contextual embeddings for knowledge graph completion. Pacific Asia Conference on Information Systems.
  19. Learning entity type embeddings for knowledge graph completion. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, CIKM ’17, page 2215–2218, New York, NY, USA. Association for Computing Machinery.
  20. Context-aware entity typing in knowledge graphs. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 2240–2250, Punta Cana, Dominican Republic. Association for Computational Linguistics.
  21. Modeling Relational Data with Graph Convolutional Networks, pages 593–607.
  22. Semi-supervised multi-label learning for graph-structured data. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management, CIKM ’21, page 1723–1733, New York, NY, USA. Association for Computing Machinery.
  23. Towards an optimal asymmetric graph structure for robust semi-supervised node classification. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD ’22, page 1656–1665, New York, NY, USA. Association for Computing Machinery.
  24. RoBERTa-based traditional Chinese medicine named entity recognition model. In Proceedings of the 34th Conference on Computational Linguistics and Speech Processing (ROCLING 2022), pages 61–66, Taipei, Taiwan. The Association for Computational Linguistics and Chinese Language Processing (ACLCLP).
  25. Yago: A core of semantic knowledge. In Proceedings of the 16th International Conference on World Wide Web, WWW ’07, page 697–706, New York, NY, USA. Association for Computing Machinery.
  26. Rotate: Knowledge graph embedding by relational rotation in complex space. In International Conference on Learning Representations.
  27. Complex embeddings for simple link prediction. In Proceedings of the 33rd International Conference on International Conference on Machine Learning - Volume 48, ICML’16, page 2071–2080.
  28. Denny Vrandečić and Markus Krötzsch. 2014. Wikidata: A free collaborative knowledgebase. Commun. ACM, 57(10):78–85.
  29. SimKGC: Simple contrastive knowledge graph completion with pre-trained language models. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4281–4294, Dublin, Ireland. Association for Computational Linguistics.
  30. A relation extraction method based on entity type embedding and recurrent piecewise residual networks. In Big Data – BigData 2019, pages 33–48, Cham. Springer International Publishing.
  31. Representation learning of knowledge graphs with entity descriptions. Proceedings of the AAAI Conference on Artificial Intelligence, 30(1).
  32. Representation learning of knowledge graphs with hierarchical types. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI’16, page 2965–2971. AAAI Press.
  33. Knowledge graph entity typing via learning connecting embeddings. Knowledge-Based Systems, 196:105808.
  34. Connecting embeddings based on multiplex relational graph attention networks for knowledge graph entity typing. IEEE Transactions on Knowledge and Data Engineering.
  35. K. Zhu and J. Wu. 2021. Residual attention: A simple but effective method for multi-label recognition. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pages 184–193, Los Alamitos, CA, USA. IEEE Computer Society.
  36. A neighborhood-attention fine-grained entity typing for knowledge graph completion. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, WSDM ’22, page 1525–1533, New York, NY, USA. Association for Computing Machinery.
  37. Knowledge graph entity type prediction with relational aggregation graph attention network. In The Semantic Web, pages 39–55, Cham. Springer International Publishing.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now