On the Validation of Distributed Systems Simulation using Metamorphic Testing
Simulation is widely adopted by the research community to analyze and study complex systems. It is based on the idea of creating a model representing the target system under study, so that the experiments can be executed over the model instead of the target system. However, since the model is a simplification of a real-world system, the obtained results entail an accuracy loss, which makes determining the reliability of the experiments a complex task. Testing can be applied to check the correctness of systems. Thus, an oracle is used to determine if a test is correct or not. In the field of simulation, an oracle can be applied to determine the reliability of the results, but in most cases, the oracle is not available or is computationally too expensive to be applied. In this work, we propose to use metamorphic testing to detect faults in simulated distributed systems. In essence, we use metamorphic relations – representing the relevant properties of the system under study – as an oracle. Thus, the results provided are contrasted against these relations to determine their reliability. In order to show the applicability of this approach, we have modelled different distributed systems architectures using the SIMCAN simulator and a high performance application that is executed over the models.
Mon 9 MayDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:30 | Metamorphic Testing for SimulationMET at MET room Chair(s): Upulee Kanewala University of North Florida | ||
11:00 30mTalk | Testing Ocean Software with Metamorphic Testing MET Quang-Hung Luu Swinburne University of Technology, Huai Liu Swinburne University of Technology, Tsong Yueh Chen Swinburne University of Technology, Hai L. Vu Monash University | ||
11:30 30mTalk | Metamorphic Testing in Bioinformatics Software: A Case Study on Metagenomic Assembly MET Brook Stacy Fraunhofer, USA CMA, Jason Hauzel Fraunhofer, USA CMA, Mikael Lindvall Fraunhofer USA CESE, Adam Porter University of Maryland, Mihai Pop University of Maryland, College Park | ||
12:00 30mTalk | On the Validation of Distributed Systems Simulation using Metamorphic Testing MET Alberto Núňez University Complutense of Madrid, Spain., Pablo C Canizares Autonomous University of Madrid, Spain, Pablo Gómez-Abajo Universidad Autónoma de Madrid, Esther Guerra Universidad Autonoma de Madrid, Juan de Lara Autonomous University of Madrid |