Write a Blog >>
ICSE 2023
Sun 14 - Sat 20 May 2023 Melbourne, Australia
Wed 17 May 2023 15:45 - 15:52 at Meeting Room 102 - Test generation Chair(s): Chunyang Chen

Exploratory testing is an effective testing approach for the system-level testing from the end user’s perspective, which is widely practiced and appreciated in the software industry. Although many concrete principles and guidelines for performing exploratory testing have been proposed, there are no effective tools for automatic generation of exploratory test scenarios (a.k.a soap opera tests). In this paper, we propose a tool named SoapOperaTG for automatic soap opera test generation by leveraging the scenario and oracle knowledge in bug reports. We first construct a system knowledge graph (KG) of user tasks and failures from the preconditions, steps to reproduce (S2Rs), expected behavior (EB) and observed behavior (OB) in bug reports. Then, we create soap opera tests by combining the scenarios of relevant bugs based on the system knowledge graph. SoapOperaTG is implemented as a web tool to present the generated test scenarios. In our user study, 5 users find 18 bugs in Mozilla Firefox (a mature, well-maintained software system) in 2 hours using SoapOperaTG, while the control group finds only 5 bugs based on the recommended similar bugs. SoapOperaTG can be found at https://github.com/SuYanqi/SYS-KG. Demo video can be found at https://youtu.be/xcXmY8qGDSc.

Wed 17 May

Displayed time zone: Hobart change

15:45 - 17:15
15:45
7m
Talk
SoapOperaTG: A Tool for System Knowledge Graph Based Soap Opera Test Generation
DEMO - Demonstrations
Yanqi Su Australian National University, Zheming Han , Zhenchang Xing CSIRO’s Data61; Australian National University, Xiwei (Sherry) Xu CSIRO’s Data61, Liming Zhu CSIRO’s Data61, Qinghua Lu CSIRO’s Data61
15:52
7m
Talk
GUI Testing to the Power of Parallel Q-Learning
DEMO - Demonstrations
Marco Mobilio University of Milano Bicocca, Diego Clerissi University of Milano-Bicocca, Giovanni Denaro University of Milano-Bicocca, Italy, Leonardo Mariani University of Milano-Bicocca
16:00
15m
Talk
BADGE: Prioritizing UI Events with Hierarchical Multi-Armed Bandits for Automated UI Testing
Technical Track
Dezhi Ran Peking University, Hao Wang Peking University, China, Wenyu Wang University of Illinois Urbana-Champaign, Tao Xie Peking University
16:15
15m
Talk
Efficiency Matters: Speeding Up Automated Testing with GUI Rendering InferenceDistinguished Paper Award
Technical Track
Sidong Feng Monash University, Mulong Xie Australian National University, Chunyang Chen Monash University
Pre-print
16:30
15m
Talk
CodaMOSA: Escaping Coverage Plateaus in Test Generation with Pre-trained Large Language Models
Technical Track
Caroline Lemieux University of British Columbia, Jeevana Priya Inala Microsoft Research, Shuvendu K. Lahiri Microsoft Research, Siddhartha Sen Microsoft Research
16:45
15m
Talk
Simulation-Driven Automated End-to-End Test and Oracle Inference
SEIP - Software Engineering in Practice
Shreshth Tuli Meta Platforms Inc. and Imperial College, Kinga Bojarczuk Facebook, Natalija Gucevska Facebook, Mark Harman University College London, Xiaoyu Wang Meta Platforms Inc., Graham Wright Meta Platforms Inc.
17:00
7m
Talk
Reasoning-Based Software Testing
NIER - New Ideas and Emerging Results
Luca Giamattei Università di Napoli Federico II, Roberto Pietrantuono Università di Napoli Federico II, Stefano Russo Università di Napoli Federico II
Pre-print
17:07
7m
Talk
Automated Generation and Evaluation of JMH Microbenchmark Suites From Unit Tests
Journal-First Papers
Mostafa Jangali Concordia University, Yiming Tang Concordia University, Niclas Alexandersson Chalmers University of Technology, Philipp Leitner Chalmers University of Technology, Sweden / University of Gothenburg, Sweden, Jinqiu Yang Concordia University, Weiyi Shang University of Waterloo