MET 2024

The test oracle problem is one of the most fundamental and challenging problems in software testing and more broadly, software engineering. A growing body of research has examined the concept and approach of Metamorphic Testing (MT) and has justified that MT can effectively alleviate the oracle problem and detect real-life bugs in various application domains. Compared with most other testing methods where the correctness of each individual test output is checked, MT has a different perspective on testing: it focuses on the relationships among the inputs and outputs of multiple executions of the software under test. MET: The International Workshop on Metamorphic Testing will bring together researchers and practitioners in academia and industry to discuss research results, experiences, and insights into MT. The ultimate goal of MET is to provide a platform for the discussion of novel ideas, new perspectives, new applications, and the state of research, related to or inspired by MT.

Call for Papers

Metamorphic testing (MT) is a testing technique that exploits the relationships among the inputs and outputs of multiple executions of the program under test, so-called Metamorphic Relations (MRs). MT has been proven highly effective in testing programs that face the oracle problem, for which the correctness of individual output is difficult to determine. Since the introduction of MT in the late 1990’s, the interest in this testing methodology has grown immensely with numerous applications in various domains such as machine learning, bioinformatics, computer graphics, simulation, search engines, decision support, cloud computing, databases, and compilers. The 9th International Workshop on Metamorphic Testing (MET) will bring together researchers and practitioners in academia and industry to discuss research results and experiences in MT. The ultimate goal of MET is to provide a platform for the discussion of novel ideas, new perspectives, new applications, and state of research, related to or inspired by MT.

We invite original submissions on, but not limited to, the following topics on MT:

• Emerging and innovative applications of MT (e.g., AI, autonomous systems).
• Guidelines and techniques for the construction of MRs or MT test cases.
• Prioritization and minimization of MRs or MT test cases.
• Theoretical analysis and empirical evaluation of MRs or MT test cases (e.g., metrics).
• Application of MT and MRs beyond testing.
• Automation of MT.
• Formal methods involving MRs.
• Case studies from practice.
• Tools.
• Surveys.
• Empirical studies.
• Integration/comparison with other techniques.
• Novel applications, perspectives, or theories inspired by MT.

Submissions:

Prospective participants are invited to contribute to MET’24 with three types of submissions:

• Full papers (maximum of 8 pages). Original research in MT aligned with the topics of workshop.
• Short papers (maximum of 6 pages). Work in progress and emerging results to get quick feedback from the community.
• New ideas papers (2-3 pages). Discussion of innovation ideas, identification of research opportunities and challenges, and plans for future work.

All the submissions must follow the ACM formatting instructions. It is not possible to pay for extra pages. Full and short papers will be reviewed with respect to their quality and relevance. New ideas papers will be reviewed with respect to relevance and their ability to foster discussions.

More detailed submission guideline can be found at https://2024.issta.org/track/issta-2024-papers#Call-for-Papers.

Submission web page for MET 2024 is https://easychair.org/my/conference?conf=met20240.