MET 2021

The test oracle problem is one of the most challenging problems in software engineering. A growing body of research has examined the concept of Metamorphic Testing (MT), and has proven that MT can effectively alleviate the oracle problem and detect real bugs. Compared with most other testing methods, where the correctness of each individual test output is checked, MT has a different perspective on testing: it focuses on the relationships among the inputs and outputs of multiple executions of the software under test. MET: The International Workshop on Metamorphic Testing will bring together researchers and practitioners in academia and industry to discuss research results, experiences, and insights into MT. The ultimate goal of MET is to provide a platform for the discussion of novel ideas, new perspectives, new applications, and the state of research, related to or inspired by MT.

More information about MET can be found on: http://metwiki.net/MET21/

Accepted Papers

	Title
	Applying Metamorphic Testing to Homomorphic Cryptography MET 2021 Melvin Wolf, Jürgen Schönwälder Media Attached
	BMT: Behavior Driven Development-based MetamorphicTesting for Autonomous Driving Models MET 2021 Yao Deng, Guannan Lou, Xi Zheng, Tianyi Zhang, Miryung Kim, Huai Liu, Chen Wang, Tsong Yueh Chen Media Attached
	Closing Remarks MET 2021 Sergio Segura Media Attached
	Dreaming up Metamorphic Relations: Experiences from Three Fuzzer Tools MET 2021 Andrei Lascu, Matt Windsor, Alastair F. Donaldson, Tobias Grosser, John Wickerson Media Attached
	Enhancing Euro NCAP Standards with Metamorphic Testing for Verification of Advanced Driver-Assistance Systems MET 2021 Muhammad Iqbal, Jia Cheng Han, Zhi Quan (George) Zhou, Dave Towey Media Attached
	Follow-up Test Cases are Better Than Source Test Cases in Metamorphic Testing: A Preliminary Study MET 2021 Zenghui Zhou, Zheng Zheng, Tsong Yueh Chen, Jinyi Zhou, Kun Qiu Media Attached
	Metamorphic Detection of Repackaged Malware MET 2021 Shirish Singh, Gail Kaiser Media Attached
	Metamorphic Testing for Image-based Calcium Imaging Analysis Pipelines MET 2021 Madeline Diep, Rohan Reddy Mekala, Ujjwal Ayyangar, Gudjon Magnusson, Adam Porter, Wolfgang Losert, Mikael Lindvall Media Attached
	Metamorphic Testing on the Continuum of Verification and Validation of Simulation Models MET 2021 M S Raunak, Megan Olsen Media Attached
	MT4NS: Metamorphic Testing for Network Scanning MET 2021 Zhirui Zhang, Dave Towey, Zhihao Ying, Yifan Zhang, Zhi Quan (George) Zhou Media Attached
	Opening Remarks MET 2021 Pak-Lok Poon Media Attached
	Robustness Evaluation of Stacked Generative Adversarial Networks using Metamorphic Testing MET 2021 Hyejin Park, Taaha Waseem, Wen Qi Teo, Ying Hwei Low, Mei Kuan Lim, Chun Yong Chong Media Attached
	Towards Automated Metamorphic Test identification for Ocean System Models MET 2021 Dilip Jagadeeshwarswamy Hiremath, Martin Claus, Wilhelm Hasselbring, Willi Rath Media Attached

Call for Papers

Metamorphic testing (MT) is a testing technique that exploits the relationships among the inputs and outputs of multiple executions of the program under test, so-called Metamorphic Relations (MRs). MT has been proven highly effective in testing programs that face the oracle problem, for which the correctness of individual output is difficult to determine. Since the introduction of MT two decades ago, the interest in this testing methodology has grown immensely with numerous applications in various domains such as machine learning, bioinformatics, computer graphics, simulation, search engines, decision support, cloud computing, databases, and compilers. The 6th International Workshop on Metamorphic Testing (MET) will bring together researchers and practitioners in academia and industry to discuss research results and experiences in MT. The ultimate goal of MET is to provide a platform for the discussion of novel ideas, new perspectives, new applications, and state of research, related to or inspired by MT.

TOPICS OF INTEREST

We invite original submissions on, but not limited to, the following topics on MT:

• Emerging and innovative applications of MT (e.g., artificial intelligence).
• Guidelines and techniques for the construction of MRs or MT test cases.
• Prioritization and minimization of MRs or MT test cases.
• Quality assessment mechanisms for MRs or MT test cases (e.g., metrics).
• Automated generation of potential MRs.
• Combination of MRs.
• Formal methods involving MRs.
• Case studies from practice.
• Tools.
• Surveys.
• Empirical studies.
• Integration/comparison with other techniques.
• Novel applications, perspectives, or theories inspired by MT.