Mutation-Guided Metamorphic Testing of Optimality in AI Planning
In this journal article, which was published in open access in the John Wiley’s Journal of Software Testing, Verification and Reliability (STVR) on the 3rd October 2024, we address the critical challenge of ensuring the optimality of plans generated by AI planners in autonomous systems, especially those employed in safety-critical and resource-constrained applications such as space exploration, elderly assistance, and industrial control. While previous research has delved into verifying the soundness and completeness of AI planners, the verification of optimality remains a largely unexplored area due to the inherent complexity and scalability issues associated with determining optimal solutions. Our contribution is a novel framework called MorphinPlan that employs mutation-guided metamorphic testing to detect non-optimal plans. Metamorphic Testing (MT) is a technique that uses metamorphic relations (MRs) to generate follow-up test cases from initial test cases, thus alleviating the need for a test oracle. We extend this approach by integrating mutation testing to guide the selection of follow-up test cases, focusing on states within the state space that are most likely to reveal non-optimal plans.
Wed 2 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 15:30 | Test OracleJournal-First Papers / Research Papers / Industry at Aula Magna (AM) Chair(s): Mike Papadakis University of Luxembourg | ||
14:00 15mTalk | Differential Testing of Concurrent Classes Research Papers Valerio Terragni University of Auckland, Shing-Chi Cheung Hong Kong University of Science and Technology | ||
14:15 15mTalk | Hybrid Equivalence/Non-Equivalence Testing Research Papers Laboni Sarker University of California at Santa Barbara, Tevfik Bultan University of California at Santa Barbara | ||
14:30 15mTalk | Metamorphic Testing for Pose Estimation Systems Research Papers Matias Duran Trinity College Dublin, Ireland, Thomas Laurent Lero@Trinity College Dublin, Ellen Rushe School of Computing Dublin City University, Anthony Ventresque Trinity College Dublin & Lero, Ireland | ||
14:45 15mTalk | Mutation-Guided Metamorphic Testing of Optimality in AI Planning Journal-First Papers Quentin Mazouni Simula Research Laboratory, Arnaud Gotlieb Simula Research Laboratory, Helge Spieker Simula Research Laboratory, Mathieu Acher University of Rennes - Inria - CNRS - IRISA, Benoit Combemale University of Rennes, Inria, CNRS, IRISA Link to publication DOI | ||
15:00 15mTalk | LLMs in the Heart of Differential Testing: A Case Study on a Medical Rule Engine Industry Erblin Isaku Simula Research Laboratory, and University of Oslo (UiO), Christoph Laaber Simula Research Laboratory, Hassan Sartaj Simula Research Laboratory, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Thomas Schwitalla Cancer Registry of Norway, Jan F. Nygård Cancer Registry of Norway |