2000 character limit reached
Prompt-Time Ontology-Driven Symbolic Knowledge Capture with Large Language Models (2405.14012v1)
Published 22 May 2024 in cs.AI and cs.CL
Abstract: In applications such as personal assistants, LLMs must consider the user's personal information and preferences. However, LLMs lack the inherent ability to learn from user interactions. This paper explores capturing personal information from user prompts using ontology and knowledge-graph approaches. We use a subset of the KNOW ontology, which models personal information, to train the LLM on these concepts. We then evaluate the success of knowledge capture using a specially constructed dataset. Our code and datasets are publicly available at https://github.com/HaltiaAI/paper-PTODSKC
- Neurosymbolic AI – Why, What, and How, May 2023. arXiv:2305.00813 [cs].
- Neurosymbolic AI for Reasoning over Knowledge Graphs: A Survey, May 2024. arXiv:2302.07200 [cs, stat].
- Describing and Organizing Semantic Web and Machine Learning Systems in the SWeMLS-KG, March 2023. arXiv:2303.15113 [cs].
- LLM-assisted Knowledge Graph Engineering: Experiments with ChatGPT, July 2023. arXiv:2307.06917 [cs].
- CycleGT: Unsupervised Graph-to-Text and Text-to-Graph Generation via Cycle Training, December 2020. arXiv:2006.04702 [cs].
- Entity-Relation Extraction as Multi-Turn Question Answering, September 2019. arXiv:1905.05529 [cs].
- INFINITY: A Simple Yet Effective Unsupervised Framework for Graph-Text Mutual Conversion, September 2022. arXiv:2209.10754 [cs].
- Ontology Guided Information Extraction from Unstructured Text. International journal of Web & Semantic Technology, 4(1):19–36, January 2013. arXiv:1302.1335 [cs].
- Prompt-Time Symbolic Knowledge Capture with Large Language Models, February 2024. arXiv:2402.00414 [cs].
- LLMs4OL: Large Language Models for Ontology Learning, August 2023. arXiv:2307.16648 [cs, math].
- Ontology engineering with Large Language Models, July 2023. arXiv:2307.16699 [cs].
- PIVOINE: Instruction Tuning for Open-world Information Extraction, May 2023. arXiv:2305.14898 [cs].
- Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Text, August 2023. arXiv:2308.02357 [cs].
- Towards Ontology Construction with Language Models, September 2023. arXiv:2309.09898 [cs].
- MLX: Efficient and flexible machine learning on Apple silicon. https://github.com/ml-explore, 2023.
- QLoRA: Efficient Finetuning of Quantized LLMs, May 2023. arXiv:2305.14314 [cs].
- Open LLM Leaderboard. https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard, 2023.
- Mistral 7B, October 2023. arXiv:2310.06825 [cs].
- Llama 2: Open foundation and fine-tuned chat models, 2023.
Collections
Sign up for free to add this paper to one or more collections.