Process Modeling With Large Language Models (2403.07541v2)
Abstract: In the realm of Business Process Management (BPM), process modeling plays a crucial role in translating complex process dynamics into comprehensible visual representations, facilitating the understanding, analysis, improvement, and automation of organizational processes. Traditional process modeling methods often require extensive expertise and can be time-consuming. This paper explores the integration of LLMs into process modeling to enhance the accessibility of process modeling, offering a more intuitive entry point for non-experts while augmenting the efficiency of experts. We propose a framework that leverages LLMs for the automated generation and iterative refinement of process models starting from textual descriptions. Our framework involves innovative prompting strategies for effective LLM utilization, along with a secure model generation protocol and an error-handling mechanism. Moreover, we instantiate a concrete system extending our framework. This system provides robust quality guarantees on the models generated and supports exporting them in standard modeling notations, such as the Business Process Modeling Notation (BPMN) and Petri nets. Preliminary results demonstrate the framework's ability to streamline process modeling tasks, underscoring the transformative potential of generative AI in the BPM field.
- A qualitative analysis of the state of the art in process extraction from text. In Giuseppe Vizzari, Matteo Palmonari, and Andrea Orlandini, editors, Proceedings of the AIxIA 2020 Discussion Papers Workshop co-located with the the 19th International Conference of the Italian Association for Artificial Intelligence (AIxIA2020), Anywhere, November 27th, 2020, volume 2776 of CEUR Workshop Proceedings, pages 19–30. CEUR-WS.org, 2020.
- PET: an annotated dataset for process extraction from natural language text tasks. In Cristina Cabanillas, Niels Frederik Garmann-Johnsen, and Agnes Koschmider, editors, Business Process Management Workshops - BPM 2022 International Workshops, Münster, Germany, September 11-16, 2022, Revised Selected Papers, volume 460 of Lecture Notes in Business Information Processing, pages 315–321. Springer, 2022.
- Abstractions, scenarios, and prompt definitions for process mining with LLMs: A case study. In Jochen De Weerdt and Luise Pufahl, editors, Business Process Management Workshops - BPM 2023 International Workshops, Utrecht, The Netherlands, September 11-15, 2023, Revised Selected Papers, volume 492 of Lecture Notes in Business Information Processing, pages 427–439. Springer, 2023.
- Just tell me: Prompt engineering in business process management. In Han van der Aa, Dominik Bork, Henderik A. Proper, and Rainer Schmidt, editors, Enterprise, Business-Process and Information Systems Modeling - 24th International Conference, BPMDS 2023, and 28th International Conference, EMMSAD 2023, Zaragoza, Spain, June 12-13, 2023, Proceedings, volume 479 of Lecture Notes in Business Information Processing, pages 3–11. Springer, 2023.
- Bert-log: Anomaly detection for system logs based on pre-trained language model. Appl. Artif. Intell., 36(1), 2022.
- Let me tell you a story - on how to build process models. J. Univers. Comput. Sci., 17(2):276–295, 2011.
- BERT: pre-training of deep bidirectional transformers for language understanding. In Jill Burstein, Christy Doran, and Thamar Solorio, editors, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers), pages 4171–4186. Association for Computational Linguistics, 2019.
- Rohan Anil et al. Gemini: A family of highly capable multimodal models. CoRR, abs/2312.11805, 2023.
- Tom B. Brown et al. Language models are few-shot learners. In Hugo Larochelle, Marc’Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.
- Conceptual modeling and large language models: Impressions from first experiments with ChatGPT. Enterp. Model. Inf. Syst. Archit. Int. J. Concept. Model., 18:3, 2023.
- Process model generation from natural language text. In Haralambos Mouratidis and Colette Rolland, editors, Advanced Information Systems Engineering - 23rd International Conference, CAiSE 2011, London, UK, June 20-24, 2011. Proceedings, volume 6741 of Lecture Notes in Computer Science, pages 482–496. Springer, 2011.
- Large language models can accomplish business process management tasks. In Jochen De Weerdt and Luise Pufahl, editors, Business Process Management Workshops - BPM 2023 International Workshops, Utrecht, The Netherlands, September 11-15, 2023, Revised Selected Papers, volume 492 of Lecture Notes in Business Information Processing, pages 453–465. Springer, 2023.
- From text to visual BPMN process models: design and evaluation. In Eugene Syriani, Houari A. Sahraoui, Juan de Lara, and Silvia Abrahão, editors, MoDELS ’20: ACM/IEEE 23rd International Conference on Model Driven Engineering Languages and Systems, Virtual Event, Canada, 18-23 October, 2020, pages 229–239. ACM, 2020.
- Conversational process modelling: State of the art, applications, and implications in practice. In Chiara Di Francescomarino, Andrea Burattin, Christian Janiesch, and Shazia W. Sadiq, editors, Business Process Management Forum - BPM 2023 Forum, Utrecht, The Netherlands, September 11-15, 2023, Proceedings, volume 490 of Lecture Notes in Business Information Processing, pages 319–336. Springer, 2023.
- Scalable discovery of partially ordered workflow models with formal guarantees. In 5th International Conference on Process Mining, ICPM 2023, Rome, Italy, October 23-27, 2023, pages 89–96. IEEE, 2023.
- Humam Kourani and Sebastiaan J. van Zelst. POWL: partially ordered workflow language. In Chiara Di Francescomarino, Andrea Burattin, Christian Janiesch, and Shazia Sadiq, editors, Business Process Management - 21st International Conference, BPM 2023, Utrecht, The Netherlands, September 11-15, 2023, Proceedings, volume 14159 of Lecture Notes in Computer Science, pages 92–108. Springer, 2023.
- Sander J. J. Leemans. Robust Process Mining with Guarantees - Process Discovery, Conformance Checking and Enhancement, volume 440 of Lecture Notes in Business Information Processing. Springer, 2022.
- Pretrained language model for text generation: A survey. In Zhi-Hua Zhou, editor, Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21, pages 4492–4499. International Joint Conferences on Artificial Intelligence Organization, 8 2021. Survey Track.
- Knowledge injection to counter large language model (LLM) hallucination. In Catia Pesquita, Hala Skaf-Molli, Vasilis Efthymiou, Sabrina Kirrane, Axel Ngonga, Diego Collarana, Renato Cerqueira, Mehwish Alam, Cássia Trojahn, and Sven Hertling, editors, The Semantic Web: ESWC 2023 Satellite Events - Hersonissos, Crete, Greece, May 28 - June 1, 2023, Proceedings, volume 13998 of Lecture Notes in Computer Science, pages 182–185. Springer, 2023.
- Negative-prompt inversion: Fast image inversion for editing with text-guided diffusion models. CoRR, abs/2305.16807, 2023.
- Limitations of chatgpt in conceptual modeling: Insights from experiments in metamodeling, 2024.
- OpenAI. GPT-4 technical report. CoRR, abs/2303.08774, 2023.
- Generating BPMN diagram from textual requirements. J. King Saud Univ. Comput. Inf. Sci., 34(10 Part B):10079–10093, 2022.
- Wil M. P. van der Aalst. Process Mining - Discovery, Conformance and Enhancement of Business Processes. Springer, 2011.
- Business process modeling using Petri nets. Trans. Petri Nets Other Model. Concurr., 7:116–161, 2013.
- A composable just-in-time programming framework with LLMs and FBP. In IEEE High Performance Extreme Computing Conference, HPEC 2023, Boston, MA, USA, September 25-29, 2023, pages 1–8. IEEE, 2023.
- Large language models for business process management: Opportunities and challenges. In Chiara Di Francescomarino, Andrea Burattin, Christian Janiesch, and Shazia W. Sadiq, editors, Business Process Management Forum - BPM 2023 Forum, Utrecht, The Netherlands, September 11-15, 2023, Proceedings, volume 490 of Lecture Notes in Business Information Processing, pages 107–123. Springer, 2023.
- Business process model and notation - BPMN. In Mark von Rosing, Henrik von Scheel, and August-Wilhelm Scheer, editors, The Complete Business Process Handbook: Body of Knowledge from Process Modeling to BPM, Volume I, pages 429–453. Morgan Kaufmann/Elsevier, 2015.
- Expertprompting: Instructing large language models to be distinguished experts. CoRR, abs/2305.14688, 2023.
- Large language models are human-level prompt engineers. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023.
- Humam Kourani (9 papers)
- Alessandro Berti (35 papers)
- Daniel Schuster (18 papers)
- Wil M. P. van der Aalst (116 papers)