Towards Automated Metamorphic Test identification for Ocean System Models
Metamorphic testing seeks to validate software in the absence of test oracles. Our application domain is ocean system modeling, where test oracles rarely exist, but where symmetries of the simulated physical systems are known. The input data set is big owing to the requirements of the application domain. This short paper presents work in progress for the automated generation of metamorphic test scenarios using machine learning. We extended our previously proposed method ~cite{Hiremath2020} to identify better Metamorphic relations with reduced computational complexity. We represent metamorphic testing and assume identity map to be the first metamorphic relation. We construct a cost function that minimizes for identifying a metamorphic relation that is orthogonal to previously found metamorphic relations and penalize for the identity map. We use machine leaning algorithm to identify all possible metamorphic relations minimizing the defined cost function. We propose applying dimensionality reduction techniques to identify attributes in the input which have high variance among the identified metamorphic relations. We apply mutation on these selected attributes to identify distinct metamorphic relations with reduced computational complexity. For experimental evaluation, we subject the two implementations of an ocean-modeling application to the proposed method to present the use of metamorphic relations to test the implementations of the applications.
Wed 2 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
18:00 - 19:20 | Session 4: Safety and Security and Simulation and Metamorphic RelationsMET 2021 at MET Room Chair(s): Sergio Segura Universidad de Sevilla | ||
18:00 30mLong-paper | Applying Metamorphic Testing to Homomorphic Cryptography MET 2021 Media Attached | ||
18:30 20mShort-paper | Towards Automated Metamorphic Test identification for Ocean System Models MET 2021 Dilip Jagadeeshwarswamy Hiremath GEOMAR, Helmholtz Centre for Ocean Research and Kiel University, Martin Claus GEOMAR, Helmholtz Centre for Ocean Research and Kiel University, Wilhelm Hasselbring Kiel University, Willi Rath GEOMAR, Helmholtz Centre for Ocean Research Media Attached | ||
18:50 30mLong-paper | Dreaming up Metamorphic Relations: Experiences from Three Fuzzer Tools MET 2021 Andrei Lascu Imperial College London, Matt Windsor Imperial College London, Alastair F. Donaldson Imperial College London, Tobias Grosser University of Edinburgh, John Wickerson Imperial College London Media Attached |
Go directly to this room on Clowdr