Exploring the ChatGPT Approach for Bidirectional Traceability Problem between Design Models and Code (2309.14992v2)
Abstract: This study explores the capabilities of LLMs, particularly OpenAI's ChatGPT, in addressing the challenges associated with software modeling, explicitly focusing on the bidirectional traceability problem between design models and code. The objective of this study is to demonstrate the proficiency of ChatGPT in understanding and integrating specific requirements into design models and code. We also explore its potential to offer solutions to the bidirectional traceability problem through a case study. The findings indicate that ChatGPT is capable of generating design models and code from natural language requirements, thereby bridging the gap between these requirements and software modeling. Despite its limitations in suggesting a specific method to resolve the problem using ChatGPT itself, it exhibited the capacity to provide corrections to be consistent between design models and code. As a result, the study concludes that achieving bidirectional traceability between design models and code is feasible using ChatGPT.
- OpenAI, “ChatGPT,” [Online]. Available: https://openai.com/chatgpt.
- X. Hou, Y. Zhao, Y. Liu, Z. Yang, K. Wang, L. Li, X. Luo, D. Lo, J. Grundy, and H. Wang, “Large Language Models for Software Engineering: A Systematic Literature Review,” arXiv preprint arXiv:2308.10620, 2023.
- S. Barke, M. B. James, and N. Polikarpova, “Grounded Copilot: How Programmers Interact with Code-Generating Models,” Proc. ACM Programming Languages, vol. 7, no. OOPSLA1, pp. 85–111, 2023.
- Z. Zheng, K. Ning, J. Chen, Y. Wang, W. Chen, L. Guo, and W. Wang, “Towards an Understanding of Large Language Models in Software Engineering Tasks,” arXiv preprint arXiv:2308.11396, 2023.
- J. Cámara, J. Troya, L. Burgueño, and A. Vallecillo, “On the assessment of generative AI in modeling tasks: an experience report with ChatGPT and UML,” Software and Systems Modeling, pp. 1–13, 2023.
- OpenAI, “GPT-4 Technical Report,” arXiv:2303.08774 [cs.CL], 2023.
- F. Tian, T. Wang, P. Liang, C. Wang, A. A. Khan, and M. A. Babar, “The impact of traceability on software maintenance and evolution: A mapping study,” Journal of Software: Evolution and Process, vol. 33, no. 10, pp. e2374, 2021.
- R. Eramo, A. Pierantonio, and M. Tucci, “Improved traceability for bidirectional model transformations,” Proc. MODELS 2018 Workshops co-located with ACM/IEEE 21st International Conference on Model Driven Engineering Languages and Systems (MODELS 2018), vol. 2245, pp. 306-315.
- N. Ubayashi and Y. Kamei, “Library problem 2.0: A common problem example in software engineering research,” Proc. SIG Software Engineering (SIGSE) Winter Workshop 2012 in Biwako, Information Processing Society of Japan, pp. 129-130, 2012. (in Japanese)
- “PlantUML,” [Online]. Available: https://plantuml.com.
- Prompting Guide, “Few-shot Prompting Techniques,” [Online]. Available: https://www.promptingguide.ai/techniques/fewshot.
- Z. Ji, N. Lee, R. Frieske, T. Yu, D. Su, Y. Xu, E. Ishii, Y. J. Bang, A. Madotto, and P. Fung, “Survey of Hallucination in Natural Language Generation,” ACM Computing Surveys, vol. 55, no. 12, pp. 248-285, Mar. 2023.
- H. Kanuka, G. Koreki, R. Soga, and K. Nishikawa, “An experiment for applying ChatGPT to bidirectional traceability problem between design models and code,” Proc. SIG Software Engineering (SIGSE) Software Engineering Symposium 2023, Information Processing Society of Japan, pp. 238-239, Aug. 2023. (in Japanese)
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.