Enhancing Multi-Hop Knowledge Graph Reasoning through Reward Shaping Techniques (2403.05801v1)
Abstract: In the realm of computational knowledge representation, Knowledge Graph Reasoning (KG-R) stands at the forefront of facilitating sophisticated inferential capabilities across multifarious domains. The quintessence of this research elucidates the employment of reinforcement learning (RL) strategies, notably the REINFORCE algorithm, to navigate the intricacies inherent in multi-hop KG-R. This investigation critically addresses the prevalent challenges introduced by the inherent incompleteness of Knowledge Graphs (KGs), which frequently results in erroneous inferential outcomes, manifesting as both false negatives and misleading positives. By partitioning the Unified Medical Language System (UMLS) benchmark dataset into rich and sparse subsets, we investigate the efficacy of pre-trained BERT embeddings and Prompt Learning methodologies to refine the reward shaping process. This approach not only enhances the precision of multi-hop KG-R but also sets a new precedent for future research in the field, aiming to improve the robustness and accuracy of knowledge inference within complex KG frameworks. Our work contributes a novel perspective to the discourse on KG reasoning, offering a methodological advancement that aligns with the academic rigor and scholarly aspirations of the Natural journal, promising to invigorate further advancements in the realm of computational knowledge representation.
- Z. Zhibin, S. Liping, and C. Xuan, “Labeled box-particle cphd filter for multiple extended targets tracking,” Journal of Systems Engineering and Electronics, vol. 30, no. 1, pp. 57–67, 2019.
- A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko, “Translating embeddings for modeling multi-relational data,” Advances in neural information processing systems, vol. 26, 2013.
- R. Das, S. Dhuliawala, M. Zaheer, L. Vilnis, I. Durugkar, A. Krishnamurthy, A. Smola, and A. McCallum, “Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning,” arXiv preprint arXiv:1711.05851, 2017.
- C. Wang, “Intelligent agricultural greenhouse control system based on internet of things and machine learning,” arXiv preprint arXiv:2402.09488, 2024.
- Z.-b. Zou, L.-p. Song, and Z.-l. Song, “Labeled box-particle phd filter for multi-target tracking,” in 2017 3rd IEEE International Conference on Computer and Communications (ICCC), pp. 1725–1730, IEEE, 2017.
- Z. Zou, M. Careem, A. Dutta, and N. Thawdar, “Unified characterization and precoding for non-stationary channels,” in ICC 2022-IEEE International Conference on Communications, pp. 5140–5146, IEEE, 2022.
- J. D. M.-W. C. Kenton and L. K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” in Proceedings of naacL-HLT, vol. 1, p. 2, 2019.
- Y. Zhang, X. Wang, L. Gao, and Z. Liu, “Manipulator control system based on machine vision,” in International Conference on Applications and Techniques in Cyber Intelligence ATCI 2019: Applications and Techniques in Cyber Intelligence 7, pp. 906–916, Springer, 2020.
- Z. Mo, Y. Fu, D. Xu, and X. Di, “Trafficflowgan: Physics-informed flow based generative adversarial network for uncertainty quantification,” in Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 323–339, Springer, 2022.
- L. Yu, B. Liu, Q. Lin, X. Zhao, and C. Che, “Semantic similarity matching for patent documents using ensemble bert-related model and novel text processing method,” arXiv preprint arXiv:2401.06782, 2024.
- Z. Zou, M. Careem, A. Dutta, and N. Thawdar, “Joint spatio-temporal precoding for practical non-stationary wireless channels,” IEEE Transactions on Communications, vol. 71, no. 4, pp. 2396–2409, 2023.
- W. Wang, B. Joshi, N. Burgdorfer, K. Batsosc, A. Q. Lid, P. Mordohaia, and I. Rekleitisb, “Real-time dense 3d mapping of underwater environments,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), pp. 5184–5191, 2023.
- C. Che, Q. Lin, X. Zhao, J. Huang, and L. Yu, “Enhancing multimodal understanding with clip-based image-to-text transformation,” in Proceedings of the 2023 6th International Conference on Big Data Technologies, pp. 414–418, 2023.
- L. Gao, G. Cordova, C. Danielson, and R. Fierro, “Autonomous multi-robot servicing for spacecraft operation extension,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 10729–10735, IEEE, 2023.
- S. Ott, C. Meilicke, and M. Samwald, “Safran: An interpretable, rule-based link prediction method outperforming embedding models,” arXiv preprint arXiv:2109.08002, 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.