Conversational Process Modeling: Can Generative AI Empower Domain Experts in Creating and Redesigning Process Models?
Abstract: AI-driven chatbots such as ChatGPT have caused a tremendous hype lately. For BPM applications, several applications for AI-driven chatbots have been identified to be promising to generate business value, including explanation of process mining outcomes and preparation of input data. However, a systematic analysis of chatbots for their support of conversational process modeling as a process-oriented capability is missing. This work aims at closing this gap by providing a systematic analysis of existing chatbots. Application scenarios are identified along the process life cycle. Then a systematic literature review on conversational process modeling is performed, resulting in a taxonomy of application scenarios for conversational process modeling, including paraphrasing and improvement of process descriptions. In addition, this work suggests and applies an evaluation method for the output of AI-driven chatbots with respect to completeness and correctness of the process models. This method consists of a set of KPIs on a test set, a set of prompts for task and control flow extraction, as well as a survey with users. Based on the literature and the evaluation, recommendations for the usage (practical implications) and further development (research directions) of conversational process modeling are derived.
- Alotaibi Y (2016) Business process modelling challenges and solutions: a literature review. Journal of Intelligent Manufacturing 27(4):701–723, 10.1007/s10845-014-0917-4
- Campbell I (2007) Chi-squared and Fisher–Irwin tests of two-by-two tables with small sample recommendations. Statistics in Medicine 26(19):3661–3675, https://doi.org/10.1002/sim.2832
- Chowdhary K (2020) Fundamentals of Artificial Intelligence. Springer India, https://books.google.at/books?id=8SfbDwAAQBAJ
- Ciravegna F (2001) Adaptive information extraction from text by rule induction and generalisation. In: Nebel B (ed) Joint conference on artificial intelligence, pp 1251–1256
- Farkas V (2023) Towards a machine learning-based approach for recommending next elements in bpmn models. In: Business process management workshops, https://sites.google.com/view/nlp4bpm2023
- Friedrich F (2010) Automated generation of business process models from natural language input. Master’s thesis, School OF Business and Economics of the Humbold-University zu Berlin
- Jiang J (2012) Information extraction from text. Mining text data pp 11–41
- Kahloun F, Ghannouchi SA (2018) Improvement of quality for business process modeling driven by guidelines. Procedia Computer Science 126:39–48
- Kitchenham B (2004) Procedures for Performing Systematic Reviews. Keele University Technical Report TR/SE-0401, Keele University
- M Riefer TT S Ternis (2016) Mining process models from natural language text: A state-of-the-art analysis. In: Wirtschaftsinformatik, pp 9––11
- Mangler J, Klievtsova N (2023) Dataset: Textual Process Descriptions and Corresponding BPMN Models. 10.5281/zenodo.7783492
- Meurers D (2012) Natural language processing and language learning. Encyclopedia of applied linguistics pp 4193–4205
- Mooney RJ, Bunescu R (2005) Mining knowledge from text using information extraction. ACM SIGKDD explorations newsletter 7(1):3–10
- OpenAI (2023) Openai documentation: Models overview. https://platform.openai.com/docs/models/, accessed: 2023-10-25
- Polyvyanyy A (ed) (2022) Process Querying Methods. Springer, 10.1007/978-3-030-92875-9
- Ryniak C, Burgert O (2020) Automatic generation of checklists from business process model and notation (bpmn) models for surgical assist systems. Current Directions in Biomedical Eng 6(1):20200,005
- Santing LB (2021) Easy data augmentation techniques for traditional machine learning models on text classification tasks. B.S. thesis, Utrecht University
- Silver B (2011) BPMN Method and Style: With BPMN Implementer’s Guide. Cody-Cassidy Press, https://books.google.at/books?id=mLDYygAACAAJ
- Soderland S (1999) Learning information extraction rules for semi-structured and free text. Machine learning 34:233–272
- Thompson B, Post M (2020) Automatic machine translation evaluation in many languages via zero-shot paraphrasing. arXiv preprint arXiv:200414564
- Wei J, Zou K (2019) Eda: Easy data augmentation techniques for boosting performance on text classification tasks. arXiv preprint arXiv:190111196
- Witteveen S, Andrews M (2019) Paraphrasing with large language models. arXiv preprint arXiv:191109661
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
