The test oracle problem is one of the most challenging problems in software engineering. A growing body of research has examined the concept of Metamorphic Testing (MT), and has proven that MT can effectively alleviate the oracle problem and detect real bugs. Compared with most other testing methods, where the correctness of each individual test output is checked, MT has a different perspective on testing: it focuses on the relationships among the inputs and outputs of multiple executions of the software under test. MET: The International Workshop on Metamorphic Testing will bring together researchers and practitioners in academia and industry to discuss research results, experiences, and insights into MT. The ultimate goal of MET is to provide a platform for the discussion of novel ideas, new perspectives, new applications, and the state of research, related to or inspired by MT.
More information about MET can be found on: http://metwiki.net/MET21/
Conference DayWed 2 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:00 - 10:20
Pak-Lok PoonSchool of Engineering & Technology, Central Queensland University, Australia
10:20 - 11:00
|BMT: Behavior Driven Development-based MetamorphicTesting for Autonomous Driving Models|
Yao DengMacquarie University, Guannan LouMacquarie University, Xi ZhengMacquarie University, Tianyi ZhangHarvard University, USA, Miryung KimUniversity of California at Los Angeles, USA, Huai LiuSwinburne University of Technology, Chen WangCSIRO DATA61, Tsong Yueh ChenSwinburne University of Technology
|Enhancing Euro NCAP Standards with Metamorphic Testing for Verification of Advanced Driver-Assistance Systems|
12:00 - 13:20
|Robustness Evaluation of Stacked Generative Adversarial Networks using Metamorphic Testing|
Hyejin ParkSchool of Information Technology, Monash University Malaysia, Taaha WaseemSchool of Information Technology, Monash University Malaysia, Wen Qi TeoSchool of Information Technology, Monash University Malaysia, Ying Hwei LowSchool of Information Technology, Monash University Malaysia, Mei Kuan LimSchool of Information Technology, Monash University Malaysia, Chun Yong ChongMonash University
|MT4NS: Metamorphic Testing for Network Scanning|
|Follow-up Test Cases are Better Than Source Test Cases in Metamorphic Testing: A Preliminary Study|
15:00 - 16:00
|How do we go — to MET 2.0?|
Adam PorterUniversity of Maryland
16:10 - 17:30
|Metamorphic Detection of Repackaged Malware|
|Metamorphic Testing on the Continuum of Verification and Validation of Simulation Models|
|Metamorphic Testing for Image-based Calcium Imaging Analysis Pipelines|
18:00 - 19:20
|Applying Metamorphic Testing to Homomorphic Cryptography|
|Towards Automated Metamorphic Test identification for Ocean System Models|
|Dreaming up Metamorphic Relations: Experiences from Three Fuzzer Tools|
Call for Papers
Metamorphic testing (MT) is a testing technique that exploits the relationships among the inputs and outputs of multiple executions of the program under test, so-called Metamorphic Relations (MRs). MT has been proven highly effective in testing programs that face the oracle problem, for which the correctness of individual output is difficult to determine. Since the introduction of MT two decades ago, the interest in this testing methodology has grown immensely with numerous applications in various domains such as machine learning, bioinformatics, computer graphics, simulation, search engines, decision support, cloud computing, databases, and compilers. The 6th International Workshop on Metamorphic Testing (MET) will bring together researchers and practitioners in academia and industry to discuss research results and experiences in MT. The ultimate goal of MET is to provide a platform for the discussion of novel ideas, new perspectives, new applications, and state of research, related to or inspired by MT.
We invite original submissions on, but not limited to, the following topics on MT:
- Emerging and innovative applications of MT (e.g., artificial intelligence).
- Guidelines and techniques for the construction of MRs or MT test cases.
- Prioritization and minimization of MRs or MT test cases.
- Quality assessment mechanisms for MRs or MT test cases (e.g., metrics).
- Automated generation of potential MRs.
- Combination of MRs.
- Formal methods involving MRs.
- Case studies from practice.
- Empirical studies.
- Integration/comparison with other techniques.
- Novel applications, perspectives, or theories inspired by MT.