Behavioral models are important assets that must be thoroughly verified early in the design process. This can be achieved with manually-written test cases that embed carefully hand-picked domain-specific input data. However, such test cases may not always reach the desired level of quality, such as high coverage or being able to localize faults efficiently. Test amplification is an interesting emergent approach to improve a test suite by automatically generating new test cases out of existing manually-written ones. Yet, while ad-hoc test amplification solutions have been proposed for a few programming languages, no solution currently exists for amplifying the test cases of behavioral models. In this paper, we fill this gap with an automated and generic approach. Given an executable DSL, a conforming behavioral model, and an existing test suite, the proposed approach generates new regression test cases in three steps: (i) generating new test inputs by applying a set of generic modifiers on the existing test inputs; (ii) running the model under test with new inputs and generating assertions from the execution traces; and (iii) selecting the new test cases that increase the mutation score. We provide tool support for the approach atop the Eclipse GEMOC Studio and show its applicability in an empirical study. In the experiment, we applied the approach to 71 test suites written for models conforming to two different DSLs, and for 67 of the 71 cases, it successfully improved the mutation score between 3.17% and 54.11% depending on the initial setup.
Wed 26 OctDisplayed time zone: Eastern Time (US & Canada) change
13:30 - 15:00 | Validation & Verification ITechnical Track at A-3502.1 Chair(s): Marsha Chechik University of Toronto | ||
13:30 22mTalk | Practical Multiverse Debugging through User-defined Reductions: Application to UML ModelsFT Technical Track Matthias Pasquier Ertosgener, Ciprian Teodorov ENSTA Bretagne, Frédéric Jouault ERIS Team, ESEO , France, Matthias Brun TRAME Team, ESEO, Luka Le Roux Lab-STICC CNRS UMR 6285, ENSTA Bretagne, Loïc Lagadec Lab-STICC CNRS UMR 6285, ENSTA Bretagne | ||
13:52 22mTalk | Modelling Program Verification Tools for Software EngineersP&I Technical Track File Attached | ||
14:15 22mTalk | Automatic Test Amplification for Executable ModelsFT Technical Track Faezeh Khorram IMT Atlantique, Nantes, France, Erwan Bousse Nantes Université, Jean-Marie Mottu Université de Nantes, LS2N, IMT Atlantique, Gerson Sunyé Université de Nantes, LS2N, Pablo Gómez-Abajo Universidad Autónoma de Madrid, Pablo C Canizares Autonomous University of Madrid, Spain, Esther Guerra Universidad Aut�noma de Madrid, Juan de Lara Autonomous University of Madrid Pre-print | ||
14:37 22mTalk | Feedback on the Formal Verification of UML Models in an Industrial Context: The Case of a Smart Device Life Cycle Management SystemP&I Technical Track Maxime Méré STMicroelectronics, Frédéric Jouault ERIS Team, ESEO , France, Loïc Pallardy STMicroelectronics, Richard Perdriau ESEO |