Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash 91 tok/s
Gemini 2.5 Pro 47 tok/s Pro
GPT-5 Medium 30 tok/s
GPT-5 High 33 tok/s Pro
GPT-4o 98 tok/s
GPT OSS 120B 483 tok/s Pro
Kimi K2 242 tok/s Pro
2000 character limit reached

Iterative Zero-Shot LLM Prompting for Knowledge Graph Construction (2307.01128v1)

Published 3 Jul 2023 in cs.CL and cs.AI

Abstract: In the current digitalization era, capturing and effectively representing knowledge is crucial in most real-world scenarios. In this context, knowledge graphs represent a potent tool for retrieving and organizing a vast amount of information in a properly interconnected and interpretable structure. However, their generation is still challenging and often requires considerable human effort and domain expertise, hampering the scalability and flexibility across different application fields. This paper proposes an innovative knowledge graph generation approach that leverages the potential of the latest generative LLMs, such as GPT-3.5, that can address all the main critical issues in knowledge graph building. The approach is conveyed in a pipeline that comprises novel iterative zero-shot and external knowledge-agnostic strategies in the main stages of the generation process. Our unique manifold approach may encompass significant benefits to the scientific community. In particular, the main contribution can be summarized by: (i) an innovative strategy for iteratively prompting LLMs to extract relevant components of the final graph; (ii) a zero-shot strategy for each prompt, meaning that there is no need for providing examples for "guiding" the prompt result; (iii) a scalable solution, as the adoption of LLMs avoids the need for any external resources or human expertise. To assess the effectiveness of our proposed model, we performed experiments on a dataset that covered a specific domain. We claim that our proposal is a suitable solution for scalable and versatile knowledge graph construction and may be applied to different and novel contexts.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (29)
  1. Healthcare knowledge graph construction: A systematic review of the state-of-the-art, open issues, and opportunities. Journal of Big Data, 10(1), 2023. doi: 10.1186/s40537-023-00774-9. Cited by: 0; All Open Access, Gold Open Access.
  2. Large language models are few-shot clinical information extractors. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 1998–2022, 2022.
  3. D. Ashok and Z. C. Lipton. Promptner: Prompting for named entity recognition. arXiv preprint arXiv:2305.15444, 2023.
  4. Codekgc: Code language model for generative knowledge graph construction. arXiv preprint arXiv:2304.09048, 2023.
  5. Inpars: Data augmentation for information retrieval using large language models, 2022.
  6. Universal sentence encoder. In In submission to: EMNLP demonstration, Brussels, Belgium, 2018. URL https://arxiv.org/abs/1803.11175. In submission.
  7. J. P. Chiu and E. Nichols. Named Entity Recognition with Bidirectional LSTM-CNNs. Transactions of the Association for Computational Linguistics, 4:357–370, 07 2016. ISSN 2307-387X. doi: 10.1162/tacl_a_00104. URL https://doi.org/10.1162/tacl_a_00104.
  8. An efficient joint framework for interacting knowledge graph and item recommendation. Knowledge and Information Systems, 65(4):1685 – 1712, 2023. doi: 10.1007/s10115-022-01808-z. Cited by: 0.
  9. Deeper - deep entity resolution. ArXiv, abs/1710.00597, 2017.
  10. A high precision pipeline for financial knowledge graph construction. In Proceedings of the 28th international conference on computational linguistics, pages 967–977, 2020.
  11. Bertnet: Harvesting knowledge graphs from pretrained language models. arXiv preprint arXiv:2206.14268, 2022.
  12. X. Hou. Design and application of intelligent financial accounting model based on knowledge graph. Mobile Information Systems, 2022, 2022. doi: 10.1155/2022/8353937. Cited by: 1; All Open Access, Gold Open Access, Green Open Access.
  13. B. Ji. Vicunaner: Zero/few-shot named entity recognition using vicuna. arXiv preprint arXiv:2305.03253, 2023.
  14. V. Levenshtein. Binary Codes Capable of Correcting Deletions, Insertions and Reversals. Soviet Physics Doklady, 10:707, 1966.
  15. Evaluating chatgpt’s information extraction capabilities: An assessment of performance, explainability, calibration, and faithfulness. ArXiv, abs/2304.11633, 2023.
  16. Multi-task identification of entities, relations, and coreference for scientific knowledge graph construction. arXiv preprint arXiv:1808.09602, 2018.
  17. Scalable knowledge graph construction over text using deep learning based predicate mapping. In Companion Proceedings of The 2019 World Wide Web Conference, pages 705–713, 2019.
  18. T. H. Nguyen and R. Grishman. Relation extraction: Perspective from convolutional neural networks. In VS@HLT-NAACL, 2015.
  19. A survey on open information extraction. In International Conference on Computational Linguistics, 2018.
  20. N. Peng. Controllable text generation for open-domain creativity and fairness, 2022.
  21. I. H. Sarker. Machine learning: Algorithms, real-world applications and research directions. SN Comput. Sci., 2(3), mar 2021. doi: 10.1007/s42979-021-00592-x. URL https://doi.org/10.1007/s42979-021-00592-x.
  22. Enhancing knowledge graph construction using large language models. arXiv preprint arXiv:2305.04676, 2023.
  23. Gpt-re: In-context learning for relation extraction using large language models. ArXiv, abs/2305.02105, 2023.
  24. Language models are open knowledge graphs. arXiv preprint arXiv:2010.11967, 2020.
  25. Zero-shot information extraction via chatting with chatgpt. ArXiv, abs/2302.10205, 2023.
  26. Machine knowledge: Creation and curation of comprehensive knowledge bases. Found. Trends Databases, 10(2–4):108–490, jul 2021. ISSN 1931-7883. doi: 10.1561/1900000064. URL https://doi.org/10.1561/1900000064.
  27. Semantic service search in it crowdsourcing platform: A knowledge graph-based approach. International Journal of Software Engineering and Knowledge Engineering, 30(6):765 – 783, 2020. doi: 10.1142/S0218194020400069. Cited by: 6.
  28. Tree of thoughts: Deliberate problem solving with large language models, 2023.
  29. Benchmarking large language models for news summarization, 2023.
Citations (21)
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

Summary

We haven't generated a summary for this paper yet.

Dice Question Streamline Icon: https://streamlinehq.com

Follow-up Questions

We haven't generated follow-up questions for this paper yet.

Don't miss out on important new AI/ML research

See which papers are being discussed right now on X, Reddit, and more:

“Emergent Mind helps me see which AI papers have caught fire online.”

Philip

Philip

Creator, AI Explained on YouTube