Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
41 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Completeness, Recall, and Negation in Open-World Knowledge Bases: A Survey (2305.05403v2)

Published 9 May 2023 in cs.AI, cs.CL, cs.DB, and cs.DL

Abstract: General-purpose knowledge bases (KBs) are a cornerstone of knowledge-centric AI. Many of them are constructed pragmatically from Web sources, and are thus far from complete. This poses challenges for the consumption as well as the curation of their content. While several surveys target the problem of completing incomplete KBs, the first problem is arguably to know whether and where the KB is incomplete in the first place, and to which degree. In this survey we discuss how knowledge about completeness, recall, and negation in KBs can be expressed, extracted, and inferred. We cover (i) the logical foundations of knowledge representation and querying under partial closed-world semantics; (ii) the estimation of this information via statistical patterns; (iii) the extraction of information about recall from KBs and text; (iv) the identification of interesting negative statements; and (v) relaxed notions of relative recall. This survey is targeted at two types of audiences: (1) practitioners who are interested in tracking KB quality, focusing extraction efforts, and building quality-aware downstream applications; and (2) data management, knowledge base and semantic web researchers who wish to understand the state of the art of knowledge bases beyond the open-world assumption. Consequently, our survey presents both fundamental methodologies and their working, and gives practice-oriented recommendations on how to choose between different approaches for a problem at hand.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize File Document Download Save Streamline Icon: https://streamlinehq.com PDF File Document Download Save Streamline Icon: https://streamlinehq.com Markdown Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (130)
  1. Enhancing answer completeness of SPARQL queries via crowdsourcing. Journal of Web Semantics 45 (2017), 41–62.
  2. Assessing the completeness of entities in knowledge bases. In The Semantic Web: ESWC 2017 Satellite Events (ESWC 2017). Springer, 7–11.
  3. Prompting as Probing: Using Language Models for Knowledge Base Construction. In Semantic Web Challenge on Knowledge Base Construction from Pre-Trained Language Models (LM-KBC).
  4. Axel Almquist and Adam Jatowt. 2019. Towards content expiry date determination: predicting validity periods of sentences. In Advances in Information Retrieval: 41st European Conference on IR Research (ECIR 2019). Springer International Publishing, 86–101. https://doi.org/10.1007/978-3-030-15712-8_6
  5. Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction. In Annual Meeting of the Association for Computational Linguistics (ACL). 1388–1398.
  6. Hiba Arnaout. 2023. Enriching Open-world Knowledge Graphs with Expressive Negative Statements. Ph. D. Dissertation. (to appear).
  7. Hiba Arnaout and Simon Razniewski. 2023. Can large language models generate salient negative statements?. In Knowledge Base Construction from Pre-trained Language Models Workshop at ISWC 2023 (KBC-LM).
  8. Enriching knowledge bases with interesting negative statements. In Automated Knowledge Base Construction (AKBC ’20).
  9. Negative Knowledge for Open-world Wikidata. In Companion Proceedings of the Web Conference 2021 (WWW ’21). Association for Computing Machinery, 544–551. https://doi.org/10.1145/3442442.3452339
  10. Negative statements considered useful. Web Semant. 71, C (2021). https://doi.org/10.1016/j.websem.2021.100661
  11. Wikinegata: a knowledge base with interesting negative statements. Proc. VLDB Endow. 14, 12 (2021), 2807–2810. https://doi.org/10.14778/3476311.3476350
  12. UnCommonSense: Informative Negative Knowledge about Everyday Concepts. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (CIKM ’22). Association for Computing Machinery, 37–46. https://doi.org/10.1145/3511808.3557484
  13. DBpedia: A Nucleus for a Web of Open Data. In The Semantic Web (ISWC). Springer Berlin Heidelberg, 722–735.
  14. The description logic handbook: Theory, implementation and applications. Cambridge university press.
  15. Recoin: relative completeness in Wikidata. In Companion Proceedings of the The Web Conference 2018 (WWW ’18). International World Wide Web Conferences Steering Committee, 1787–1792. https://doi.org/10.1145/3184558.3191641
  16. Relevance Scores for Triples from Type-Like Relations. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’15). Association for Computing Machinery, 243–252. https://doi.org/10.1145/2766462.2767734
  17. RDF dataset profiling–a survey of features, methods, vocabularies and applications. Semantic Web 9, 5 (2018), 677–705.
  18. Frank Benford. 1938. The law of anomalous numbers. Proceedings of the American philosophical society (1938).
  19. Michael K Bergman. 2001. White paper: the deep web: surfacing hidden value. Journal of electronic publishing (2001).
  20. Freebase: A shared database of structured general human knowledge. In Proceedings of the 22nd National Conference on Artificial Intelligence - Volume 2 (AAAI’07). https://dl.acm.org/doi/abs/10.5555/1619797.1619981
  21. Toward an architecture for never-ending language learning. In Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI ’10). AAAI Press, 1306–1313.
  22. Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledge. In ACL.
  23. Conversational Question Answering on Heterogeneous Sources. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’22). Association for Computing Machinery, 144–154. https://doi.org/10.1145/3477495.3531815
  24. Knowfi: Knowledge extraction from long fictional texts. In Automated Knowledge Base Construction (AKBC). 1–19.
  25. Luciano Del Corro and Rainer Gemulla. 2013. ClausIE: clause-based open information extraction. In Proceedings of the 22nd International Conference on World Wide Web (WWW ’13). Association for Computing Machinery, 355–366. https://doi.org/10.1145/2488388.2488420
  26. Completeness statements about RDF data sources and their use for query answering. In The Semantic Web–ISWC 2013: 12th International Semantic Web Conference (ISWC 2013). Springer, 66–83. https://doi.org/10.1007/978-3-642-41335-3_5
  27. Completeness management for RDF data sources. ACM Trans. Web 12, 3 (2018). https://doi.org/10.1145/3196248
  28. Towards a logical reconstruction of a theory for locally closed databases. ACM Trans. Database Syst. 35, 3 (2008). https://doi.org/10.1145/1806907.1806914
  29. The Centre for Speech, Language and the Brain (CSLB) concept property norms. Behavior Research Methods 46 (2014), 1119–1127. https://doi.org/10.3758/s13428-013-0420-4
  30. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics. 4171–4186. https://doi.org/10.18653/v1/n19-1423
  31. Epitaph or Breaking News? Analyzing and Predicting the Stability of Knowledge Base Properties. In Companion Proceedings of The 2019 World Wide Web Conference (WWW ’19). Association for Computing Machinery, 1155–1158. https://doi.org/10.1145/3308560.3314998
  32. Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD ’14). Association for Computing Machinery, 601–610. https://doi.org/10.1145/2623330.2623623
  33. From Data Fusion to Knowledge Fusion. Proc. VLDB Endow. 7, 10 (2014). https://doi.org/10.14778/2732951.2732962
  34. Knowlife: a versatile approach for constructing a large knowledge graph for biomedical sciences. BMC bioinformatics 16 (2015), 1–13.
  35. Linked data quality of dbpedia, freebase, opencyc, wikidata, and yago. Semant. Web 9, 1 (2018), 77–129. https://doi.org/10.3233/SW-170275
  36. Predicting completeness in knowledge bases. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining (WSDM ’17). Association for Computing Machinery, 375–383. https://doi.org/10.1145/3018661.3018739
  37. Fast Rule Mining in Ontological Knowledge Bases with AMIE+. The VLDB Journal 24, 6 (2015), 707–730. https://doi.org/10.1007/s00778-015-0394-1
  38. AMIE: association rule mining under incomplete evidence in ontological knowledge bases. In Proceedings of the 22nd International Conference on World Wide Web (WWW ’13). Association for Computing Machinery, 413–422. https://doi.org/10.1145/2488388.2488425
  39. On aligning OpenIE extractions with knowledge bases: A case study. In Proceedings of the First Workshop on Evaluation and Comparison of NLP Systems. Association for Computational Linguistics, 143–154. https://doi.org/10.18653/v1/2020.eval4nlp-1.14
  40. OPIEC: An Open Information Extraction Corpus. In Automated Knowledge Base Construction (AKBC).
  41. CounQER: A System for Discovering and Linking Count Information in Knowledge Bases. In The Semantic Web: ESWC 2020 Satellite Events: ESWC 2020 Satellite Events (ESWC 2020). Springer-Verlag, 84–90. https://doi.org/10.1007/978-3-030-62327-2_15
  42. Uncovering hidden semantics of set information in knowledge bases. Journal of Web Semantics 64 (2020). https://doi.org/10.1016/j.websem.2020.100588
  43. Mining significant maximum cardinalities in knowledge bases. In The Semantic Web – ISWC 2019: 18th International Semantic Web Conference. Springer-Verlag, 182–199. https://doi.org/10.1007/978-3-030-30793-6_11
  44. SchemaTree: Maximum-Likelihood Property Recommendation for Wikidata. In European Semantic Web Conference (ESWC 2020). Springer, 179–195.
  45. Herbert P Grice. 1975. Logic and conversation. In Speech acts. Brill.
  46. Reasoning with transformer-based models: Deep learning, but shallow reasoning. In International Conference on Automated Knowledge Base Construction (AKBC).
  47. Sven Hertling and Heiko Paulheim. 2017. WebIsALOD: Providing Hypernymy Relations Extracted from the Web as Linked Open Data. In The Semantic Web – ISWC 2017: 16th International Semantic Web Conference (ISWC). Springer-Verlag, 111–119. https://doi.org/10.1007/978-3-319-68204-4_11
  48. Wassily Hoeffding. 1994. Probability inequalities for sums of bounded random variables. In The Collected Works of Wassily Hoeffding. Springer, 409–426. https://doi.org/10.1007/978-1-4612-0865-5_26
  49. STICS: Searching with Strings, Things, and Cats. In Conference on Research and Development in Information Retrieval.
  50. Knowledge graphs. ACM Comput. Surv. 54, 4 (2021). https://doi.org/10.1145/3447772
  51. Bernhard Hollunder and Franz Baader. 1991. Qualifying Number Restrictions in Concept Languages. In Proceedings of the Second International Conference on Principles of Knowledge Representation and Reasoning (KR’91). Morgan Kaufmann Publishers Inc., 335–346.
  52. Demand-Weighted Completeness Prediction for a Knowledge Base. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers) (NAACL ’18). Association for Computational Linguistics, 200–207. https://doi.org/10.18653/v1/N18-3025
  53. Knowledge graph completeness: A systematic literature review. IEEE Access 9 (2021), 31322–31339. https://doi.org/10.1109/ACCESS.2021.3056622
  54. Assessing the completeness evolution of dbpedia: A case study. In Advances in Conceptual Modeling: ER 2017 Workshops AHA, MoBiD, MREBA, OntoCom, and QMMQ. Springer, 238–247.
  55. A survey on knowledge graphs: Representation, acquisition, and applications. Transactions on Neural Networks and Learning Systems 33, 2 (2022), 494–514. https://doi.org/10.1109/TNNLS.2021.3070843
  56. How can we know when language models know? on the calibration of language models for question answering. Transactions of the Association for Computational Linguistics 9 (2021), 962–977. https://doi.org/10.1162/tacl_a_00407
  57. GenIE: Generative Information Extraction. In North American Chapter of the Association for Computational Linguistics (NAACL). 4626–4643.
  58. Mining an “anti-knowledge base” from Wikipedia updates with applications to fact checking and beyond. Proc. VLDB Endow. 13, 4 (2019), 561–573. https://doi.org/10.14778/3372716.3372727
  59. Identifying Surprising Facts in Wikidata. Wikidata Workshop (2022).
  60. Resource description framework (RDF): Concepts and abstract syntax. W3C Recommendation.
  61. Jonathan Lajus and Fabian M Suchanek. 2018. Are all people married? Determining obligatory attributes in knowledge bases. In Proceedings of the 2018 World Wide Web Conference (WWW ’18). International World Wide Web Conferences Steering Committee, 1115–1124. https://doi.org/10.1145/3178876.3186010
  62. Partial Results in Database Systems (SIGMOD ’14). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/2588555.2612176
  63. Assigning global relevance scores to DBpedia facts. In 2014 IEEE 30th International Conference on Data Engineering Workshops. IEEE, 248–253.
  64. Alon Y Levy. 1996. Obtaining complete answers from incomplete databases. In Proceedings of the 22th International Conference on Very Large Data Bases (VLDB ’96). 402–412.
  65. Birds Have Four Legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 6862–6868. https://doi.org/10.18653/v1/2020.emnlp-main.557
  66. Wiki2Prop: A Multimodal Approach for Predicting Wikidata Properties from Wikipedia. In Proceedings of the Web Conference 2021 (WWW ’21). Association for Computing Machinery, 2357–2366. https://doi.org/10.1145/3442381.3450082
  67. Non-parametric Class Completeness Estimators for Collaborative Knowledge Graphs - The Case of Wikidata. In The Semantic Web–ISWC 2019: 18th International Semantic Web Conference. Springer, 453–469.
  68. When not to trust language models: Investigating effectiveness of parametric and non-parametric memories. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (ACL). Association for Computational Linguistics, 9802–9822. https://doi.org/10.18653/v1/2023.acl-long.546
  69. Open Language Learning for Information Extraction. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL ’12). Association for Computational Linguistics, 523–534.
  70. MediaWiki. 2022. ORES. Retrieved 1-July-2022 from https://www.mediawiki.org/w/index.php?title=ORES
  71. Enriching knowledge bases with counting quantifiers. In International Semantic Web Conference (ISWC). Springer, 179–197.
  72. Expanding Wikidata’s Parenthood Information by 178%, or How To Mine Relation Cardinality Information. In The Semanic Web: ISWC 2016 Posters & Demonstrations Trac. CEUR-WS.org.
  73. Domain-Targeted, High Precision Knowledge Extraction. Transactions of the Association for Computational Linguistics 5 (2017), 233–246. https://doi.org/10.1162/tacl_a_00058
  74. Amihai Motro. 1989. Integrity= validity+completeness. ACM Trans. Database Syst. 14, 4 (1989), 480–502. https://doi.org/10.1145/76902.76904
  75. Embedding cardinality constraints in neural link predictors. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing (SAC ’19). Association for Computing Machinery, 2243–2250. https://doi.org/10.1145/3297280.3297502
  76. PATTY: A taxonomy of relational patterns with semantic types. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL ’12). Association for Computational Linguistics, 1135–1145.
  77. Tuan-Phong Nguyen and Simon Razniewski. 2022. Materialized Knowledge Bases from Commonsense Transformers. (2022), 36–42. https://doi.org/10.18653/v1/2022.csrr-1.5
  78. Refined Commonsense Knowledge from Large-Scale Web Contents. IEEE Transactions on Knowledge and Data Engineering 35, 8 (2023), 8431–8447. https://doi.org/10.1109/TKDE.2022.3206505
  79. Advanced Semantics for Commonsense Knowledge Extraction. In Proceedings of the Web Conference 2021 (WWW ’21). Association for Computing Machinery, 2636–2647. https://doi.org/10.1145/3442381.3449827
  80. Industry-scale Knowledge Graphs: Lessons and Challenges: Five diverse technology companies show how it’s done. Queue 17, 2 (2019), 48–75. https://doi.org/10.1145/3329781.3332266
  81. Unik-QA: Unified representations of structured and unstructured knowledge for open-domain question answering. (2022), 1535–1546. https://doi.org/10.18653/v1/2022.findings-naacl.115
  82. OpenAI. 2022. Introducing ChatGPT. https://openai.com/blog/chatgpt.
  83. Large Language Models and Knowledge Graphs: Opportunities and Challenges. arXiv:2308.06374
  84. The Vagueness of Vagueness in Noun Phrases. In International Conference on Automated Knowledge Base Construction (AKBC 2021). https://imt.hal.science/hal-03344675
  85. Heiko Paulheim. 2017. Knowledge graph refinement: A survey of approaches and evaluation methods. Semant. Web 8, 3 (2017), 489–508. https://doi.org/10.3233/SW-160218
  86. Completeness-aware rule learning from knowledge graphs. In The Semantic Web – ISWC 2017.
  87. Language Models as Knowledge Bases? Association for Computational Linguistics, Hong Kong, China, 2463–2473. https://doi.org/10.18653/v1/D19-1250
  88. A two-stage framework for computing entity relatedness in wikipedia. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (CIKM ’17). Association for Computing Machinery, 1867–1876. https://doi.org/10.1145/3132847.3132890
  89. UNIQORN: unified question answering over RDF knowledge graphs and natural language text. arXiv:2108.08614
  90. Managing and Consuming Completeness Information for Wikidata Using COOL-WD. CEUR Workshop Proceedings on 7th International Workshop on Consuming Linked Data 1666 (2016).
  91. Péter Rácz. 2013. Salience in sociolinguistics: A quantitative approach. Vol. 84. Walter de Gruyter.
  92. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
  93. Know What You Don’t Know: Unanswerable Questions for SQuAD. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics, 784–789. https://doi.org/10.18653/v1/P18-2124
  94. Simon Razniewski. 2016. Optimizing update frequencies for decaying information. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management (CIKM ’16). Association for Computing Machinery, 1191–1200. https://doi.org/10.1145/2983323.2983719
  95. Doctoral advisor or medical condition: Towards entity-specific rankings of knowledge base properties. In Advanced Data Mining and Applications: 13th International Conference (ADMA 2017). Springer, 526–540.
  96. Simon Razniewski and Priyanka Das. 2020. Structured Knowledge: Have we made progress? An extrinsic study of KB coverage over 19 years. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management (CIKM ’20). Association for Computing Machinery, 3317–3320. https://doi.org/10.1145/3340531.3417447
  97. Coverage of information extraction from sentences and paragraphs. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 5771–5776. https://doi.org/10.18653/v1/D19-1583
  98. Identifying the extent of completeness of query answers over partially complete databases. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD ’15). Association for Computing Machinery, 561–576. https://doi.org/10.1145/2723372.2750544
  99. Simon Razniewski and Werner Nutt. 2011. Completeness of queries over incomplete databases. Proc. VLDB Endow. 4, 11 (2011), 749–760. https://doi.org/10.14778/3402707.3402715
  100. But What Do We Actually Know?. In Proceedings of the 5th Workshop on Automated Knowledge Base Construction (AKBC). 40–44.
  101. Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Association for Computational Linguistics, Hong Kong, China, 3982–3992. https://doi.org/10.18653/v1/D19-1410
  102. Raymond Reiter. 1981. On closed world data bases. In Readings in artificial intelligence. Elsevier, 119–140.
  103. Daniel Ringler and Heiko Paulheim. 2017. One knowledge graph to rule them all? Analyzing the differences between DBpedia, YAGO, Wikidata & co.. In Advances in Artificial Intelligence: 40th Annual German Conference on AI, Proceedings 40 (KI 2017). Springer, 366–372.
  104. D. S. Robson and H. A. Regier. 1964. Sample size in Petersen mark–recapture experiments. Transactions of the American Fisheries Society 3 (1964), 215–226.
  105. Commonsense Properties from Query Logs and Question Answering Forums. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM ’19). Association for Computing Machinery, 1411–1420. https://doi.org/10.1145/3357384.3357955
  106. Reasoning about Quantities in Natural Language. Transactions of the Association for Computational Linguistics 3 (2015), 1–13. https://doi.org/10.1162/tacl_a_00118
  107. Tara Safavi and Danai Koutra. 2020. Generating Negative Commonsense Knowledge. 4th Knowledge Representation and Reasoning Meets Machine Learning Workshop at NeurIPS (2020).
  108. NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Bases. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 5633–5646. https://doi.org/10.18653/v1/2021.emnlp-main.456
  109. Complete approximations of incomplete queries. Proc. VLDB Endow. 6, 12 (2013), 1378–1381. https://doi.org/10.14778/2536274.2536320
  110. Amit Singhal. 2012. Introducing the Knowledge Graph: things, not strings. Retrieved 14-Aug-2023 from https://blog.google/products/search/introducing-knowledge-graph-things-not/
  111. Knowledge Base Construction from Pre-trained Language Models. In Challenge at ISWC 2023.
  112. LM-KBC: Knowledge Base Construction from Pre-trained Language Models. In Challenge at ISWC 2022. https://ceur-ws.org/Vol-3274/paper1.pdf
  113. Extracting Multi-valued Relations from Language Models. In Workshop on Representation Learning for NLP (RepL4NLP 2023).
  114. Representativeness of knowledge bases with the generalized Benford’s law. In The Semantic Web–ISWC 2018: 17th International Semantic Web Conference. Springer, 374–390.
  115. ConceptNet 5.5: An Open Multilingual Graph of General Knowledge. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI ’17). AAAI Press, 4444–4451.
  116. Jannik Strötgen and Michael Gertz. 2010. Heideltime: High quality rule-based extraction and normalization of temporal expressions. In Proceedings of the 5th International Workshop on Semantic Evaluation (SemEval ’10). Association for Computational Linguistics, 321–324.
  117. Yago: a core of semantic knowledge. In Proceedings of the 16th International Conference on World Wide Web (WWW ’07). Association for Computing Machinery, 697–706. https://doi.org/10.1145/1242572.1242667
  118. Knowledge Representation and Rule Mining in Entity-Centric Knowledge Bases. Reasoning Web. Explainable Artificial Intelligence: 15th International Summer School 2019, Tutorial Lectures, 110–152.
  119. Fabian M. Suchanek and Anh Tuan Luu. 2023. Knowledge Bases and Language Models: Complementing Forces. In RuleML+RR invited paper.
  120. Shelley E Taylor and Susan T Fiske. 1978. Salience, attention, and attribution: Top of the head phenomena. In Advances in experimental social psychology. Vol. 11.
  121. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023).
  122. Crowdsourced enumeration queries. In 2013 IEEE 29th International Conference on Data Engineering (ICDE). IEEE, 673–684.
  123. Evaluating Language Models for Knowledge Base Completion. In European Semantic Web Conference (ESWC). Springer, 227–243.
  124. Denny Vrandečić and Markus Krötzsch. 2014. Wikidata: A Free Collaborative Knowledge base. Commun. ACM 57, 10 (2014), 78–85. https://doi.org/10.1145/2629489
  125. K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters. In Findings of the Association for Computational Linguistics (ACL-IJCNLP 2021). 1405–1418.
  126. Machine Knowledge: Creation and Curation of Comprehensive Knowledge Bases. Foundations and Trends® in Databases 10, 2-4, 108–490.
  127. Ian H Witten and David N Milne. 2008. An effective, low-cost measure of semantic relatedness obtained from Wikipedia links. In Proceeding of AAAI Workshop on Wikipedia and Artificial Intelligence: an Evolving Synergy, 2008. AAAI Press, 25–30.
  128. Wikipedia2Vec: An Efficient Toolkit for Learning and Visualizing the Embeddings of Words and Entities from Wikipedia. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP). Association for Computational Linguistics, 23–30. https://doi.org/10.18653/v1/2020.emnlp-demos.4
  129. Quality assessment for linked data: A survey. Semantic Web 7, 1 (2016), 63–93.
  130. Explainability for Large Language Models: A Survey. arXiv preprint arXiv:2309.01029 (2023).
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Simon Razniewski (49 papers)
  2. Hiba Arnaout (6 papers)
  3. Shrestha Ghosh (9 papers)
  4. Fabian Suchanek (13 papers)
Citations (6)
View on Semantic Scholar