The test oracle problem is one of the most challenging problems in software engineering. A growing body of research has examined the concept of Metamorphic Testing (MT), and has proven that MT can effectively alleviate the oracle problem and detect real bugs. Compared with most other testing methods, where the correctness of each individual test output is checked, MT has a different perspective on testing: it focuses on the relationships among the inputs and outputs of multiple executions of the software under test. MET: The International Workshop on Metamorphic Testing will bring together researchers and practitioners in academia and industry to discuss research results, experiences, and insights into MT. The ultimate goal of MET is to provide a platform for the discussion of novel ideas, new perspectives, new applications, and the state of research, related to or inspired by MT.
More information about MET can be found on: http://metwiki.net/MET21/
Wed 2 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:00 - 10:20
Pak-Lok Poon School of Engineering & Technology, Central Queensland University, AustraliaMedia Attached
10:20 - 11:00
|BMT: Behavior Driven Development-based MetamorphicTesting for Autonomous Driving Models
Yao Deng Macquarie University, Guannan Lou Macquarie University, Xi Zheng Macquarie University, Tianyi Zhang Harvard University, USA, Miryung Kim University of California at Los Angeles, USA, Huai Liu Swinburne University of Technology, Chen Wang CSIRO DATA61, Tsong Yueh Chen Swinburne University of TechnologyMedia Attached
|Enhancing Euro NCAP Standards with Metamorphic Testing for Verification of Advanced Driver-Assistance Systems
Muhammad Iqbal University of Wollongong, Jia Cheng Han University of Wollongong, Zhi Quan (George) Zhou University of Wollongong, Australia, Dave Towey University of Nottingham Ningbo ChinaMedia Attached
12:00 - 13:20
|Robustness Evaluation of Stacked Generative Adversarial Networks using Metamorphic Testing
Hyejin Park School of Information Technology, Monash University Malaysia, Taaha Waseem School of Information Technology, Monash University Malaysia, Wen Qi Teo School of Information Technology, Monash University Malaysia, Ying Hwei Low School of Information Technology, Monash University Malaysia, Mei Kuan Lim School of Information Technology, Monash University Malaysia, Chun Yong Chong Monash UniversityMedia Attached
|MT4NS: Metamorphic Testing for Network Scanning
Zhirui Zhang University of Nottingham Ningbo China, Dave Towey University of Nottingham Ningbo China, Zhihao Ying University of Nottingham Ningbo China, Yifan Zhang University of Nottingham Ningbo China, Zhi Quan (George) Zhou University of Wollongong, AustraliaMedia Attached
|Follow-up Test Cases are Better Than Source Test Cases in Metamorphic Testing: A Preliminary Study
Zenghui Zhou Beihang University, Zheng Zheng Beihang University, Tsong Yueh Chen Swinburne University of Technology, Jinyi Zhou Beihang University, Kun Qiu Beihang UniversityMedia Attached
15:00 - 16:00
|How do we go — to MET 2.0?
Adam Porter University of MarylandMedia Attached
16:10 - 17:30
|Metamorphic Detection of Repackaged Malware
MET 2021Media Attached
|Metamorphic Testing on the Continuum of Verification and Validation of Simulation Models
MET 2021Media Attached
|Metamorphic Testing for Image-based Calcium Imaging Analysis Pipelines
Madeline Diep Fraunhofer USA CESE, Rohan Reddy Mekala Fraunhofer USA CESE, Ujjwal Ayyangar Fraunhofer USA CESE, Gudjon Magnusson Fraunhofer USA CESE, Adam Porter Fraunhofer USA CESE, Wolfgang Losert University of Maryland, Mikael Lindvall Fraunhofer USA CESEMedia Attached
18:00 - 19:20
|Applying Metamorphic Testing to Homomorphic Cryptography
MET 2021Media Attached
|Towards Automated Metamorphic Test identification for Ocean System Models
Dilip Jagadeeshwarswamy Hiremath GEOMAR, Helmholtz Centre for Ocean Research and Kiel University, Martin Claus GEOMAR, Helmholtz Centre for Ocean Research and Kiel University, Wilhelm Hasselbring Kiel University, Willi Rath GEOMAR, Helmholtz Centre for Ocean ResearchMedia Attached
|Dreaming up Metamorphic Relations: Experiences from Three Fuzzer Tools
Andrei Lascu Imperial College London, Matt Windsor Imperial College London, Alastair F. Donaldson Imperial College London, Tobias Grosser University of Edinburgh, John Wickerson Imperial College LondonMedia Attached
Call for Papers
Metamorphic testing (MT) is a testing technique that exploits the relationships among the inputs and outputs of multiple executions of the program under test, so-called Metamorphic Relations (MRs). MT has been proven highly effective in testing programs that face the oracle problem, for which the correctness of individual output is difficult to determine. Since the introduction of MT two decades ago, the interest in this testing methodology has grown immensely with numerous applications in various domains such as machine learning, bioinformatics, computer graphics, simulation, search engines, decision support, cloud computing, databases, and compilers. The 6th International Workshop on Metamorphic Testing (MET) will bring together researchers and practitioners in academia and industry to discuss research results and experiences in MT. The ultimate goal of MET is to provide a platform for the discussion of novel ideas, new perspectives, new applications, and state of research, related to or inspired by MT.
We invite original submissions on, but not limited to, the following topics on MT:
- Emerging and innovative applications of MT (e.g., artificial intelligence).
- Guidelines and techniques for the construction of MRs or MT test cases.
- Prioritization and minimization of MRs or MT test cases.
- Quality assessment mechanisms for MRs or MT test cases (e.g., metrics).
- Automated generation of potential MRs.
- Combination of MRs.
- Formal methods involving MRs.
- Case studies from practice.
- Empirical studies.
- Integration/comparison with other techniques.
- Novel applications, perspectives, or theories inspired by MT.