ICSE 2021 (series) / MET 2021 (series) / MET 2021 /
Follow-up Test Cases are Better Than Source Test Cases in Metamorphic Testing: A Preliminary Study
Wed 2 Jun 2021 13:00 - 13:20 at MET Room - Session 2: Safety and Security and Metamorphic Relations Chair(s): Xiaoyuan Xie
Recently, metamorphic testing (MT) has been used to augment test datasets by inclusion of new (follow-up) test cases transformed from existing (source) test cases using metamorphic relations (MRs). It has been reported that the augmented test dataset usually has higher fault detection capabilities. Intuitively, a question arises: why the metamorphic relations can improve the fault detection effectiveness of the augmented test dataset? To investigate this issue, we conducted an empirical study on three DNN models by feeding 70000 handwritten digits images, in which six sets of MRs were designed. Furthermore, the impacts of follow-up test cases percentages and test suite sizes on the fault detection capabilities were investigated.
Wed 2 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
Wed 2 Jun
Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
12:00 - 13:20 | Session 2: Safety and Security and Metamorphic RelationsMET 2021 at MET Room Chair(s): Xiaoyuan Xie School of Computer Science, Wuhan University, China | ||
12:00 30mLong-paper | Robustness Evaluation of Stacked Generative Adversarial Networks using Metamorphic Testing MET 2021 Hyejin Park School of Information Technology, Monash University Malaysia, Taaha Waseem School of Information Technology, Monash University Malaysia, Wen Qi Teo School of Information Technology, Monash University Malaysia, Ying Hwei Low School of Information Technology, Monash University Malaysia, Mei Kuan Lim School of Information Technology, Monash University Malaysia, Chun Yong Chong Monash University Media Attached | ||
12:30 30mLong-paper | MT4NS: Metamorphic Testing for Network Scanning MET 2021 Zhirui Zhang University of Nottingham Ningbo China, Dave Towey University of Nottingham Ningbo China, Zhihao Ying University of Nottingham Ningbo China, Yifan Zhang University of Nottingham Ningbo China, Zhi Quan (George) Zhou University of Wollongong, Australia Media Attached | ||
13:00 20mShort-paper | Follow-up Test Cases are Better Than Source Test Cases in Metamorphic Testing: A Preliminary Study MET 2021 Zenghui Zhou Beihang University, Zheng Zheng Beihang University, Tsong Yueh Chen Swinburne University of Technology, Jinyi Zhou Beihang University, Kun Qiu Beihang University Media Attached |
Information for Participants
Wed 2 Jun 2021 12:00 - 13:20 at MET Room - Session 2: Safety and Security and Metamorphic Relations Chair(s): Xiaoyuan Xie
Info for room MET Room:
Go directly to this room on Clowdr