Generating Business Process Models with Open Source Large Language Models using Instruction Tuning
This program is tentative and subject to change.
Domain models play a central role in software development. They support communication, foster collaboration, and serve as references throughout the process. They also allow for automated analysis and can be used for code generation in model-driven development. Despite these benefits, software practitioners often neglect building domain models because they demand significant time, deep subject-matter expertise, and advanced modeling skills. To address these challenges and automatically generate domain models from text, we leverage generative large language models and apply instruction tuning to further enhance their performance. We demonstrate the applicability of our approach by tuning an open-source large language model to generate dynamic domain models as business process models and comparing its performance with off-the-shelf models. The results show that the instruction-tuned model outperforms off-the-shelf models not only in key text similarity metrics such as BLEU, ROUGE, and METEOR, but also in Graph Edit Distance, which captures structural correctness. Our qualitative assessment confirms that industry experts find the outputs accurate and useful, and they demonstrate a willingness to integrate the system into their workflow. Our study demonstrates the first application of instruction tuning to business process model generation and highlights the potential for domain-specific adaptation of large language models.
This program is tentative and subject to change.
Tue 2 DecDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:30 - 13:00 | Artificial Intelligence and Analytics in Software EngineeringIndustry Papers / Research Papers / Short Papers and Posters at Room 1 | ||
11:30 15mTalk | Generating Business Process Models with Open Source Large Language Models using Instruction Tuning Research Papers Gökberk Çelikmasat Boğaziçi University, Atay Özgövde Boğaziçi University, Fatma Başak Aydemir Utrecht University | ||
11:45 15mTalk | Application of Large Language Models in Product Management: A Systematic Literature Review Research Papers Vitor Mori FGV-EAESP, Jan Bosch Chalmers University of Technology, Helena Holmström Olsson Malmö University | ||
12:00 15mTalk | Towards Understanding Team Congestion in Large-Scale Software Development Research Papers Javier Gonzalez-Huerta Blekinge Institute of Technology, Ehsan Zabardast Nordea / Blekinge Institute of Technology | ||
12:15 10mTalk | A Small Dataset May Go a Long Way: Process Duration Prediction in Clinical Settings Industry Papers | ||
12:25 7mTalk | Prompts as Software Engineering Artifacts: A Research Agenda and Preliminary Findings Short Papers and Posters Hugo Villamizar fortiss GmbH, Jannik Fischbach Netlight Consulting GmbH and fortiss GmbH, Alexander Korn University of Duisburg-Essen, Andreas Vogelsang paluno – The Ruhr Institute for Software Technology, University of Duisburg-Essen, Daniel Mendez Blekinge Institute of Technology and fortiss | ||
12:32 7mTalk | MAPS-AI – A Tool for AI-Assisted Model-Driven Generation of IT Project Plan and Scope Short Papers and Posters Oksana Nikiforova Riga Technical University, Rihards Bobkovs Riga Technical University, Megija Krista Miļūne Riga Technical University, Kristaps Babris Riga Technical University, Oscar Pastor Universitat Politecnica de Valencia, Jānis Grabis Riga Technical University | ||
12:39 7mTalk | Cost of Artificial Intelligence in Finnish Software Companies: A Survey Short Papers and Posters Antti Klemetti University of Helsinki, Anssi Sorvisto University of Jyväskylä, Mikko Raatikainen University of Helsinki, Jukka K. Nurminen University of Helsinki | ||
12:46 7mTalk | Exploring the Performance of ML Model Size for Classification in Relation to Energy Consumption Short Papers and Posters Andreas Bexell Ericsson, Lo Heander Lund University, Emma Söderberg Lund University, Sigrid Eldh Ericsson AB, Mälardalen University, Carleton University, Per Runeson Lund University | ||
12:53 7mTalk | On the Use of Agentic Coding Manifests: An Empirical Study of Claude Code Short Papers and Posters Worawalan Chatlatanagulchai Kasetsart University, Kundjanasith Thonglek Kasetsart University, Brittany Reid Nara Institute of Science and Technology, Yutaro Kashiwa Nara Institute of Science and Technology, Pattara Leelaprute Kasetsart University, Arnon Rungsawang Kasetsart University, Bundit Manaskasemsak Kasetsart University, Hajimu Iida Nara Institute of Science and Technology | ||