Generating Failing Test Suites for Quantum Programs with Search
Testing quantum programs requires systematic, automated, and intelligent methods due to their inherent complexity, such as their superposition and entanglement. To this end, we present a search-based approach, called Quantum Search-Based Testing (QuSBT), for automatically generating test suites of a given size depending on available testing budget, with the aim of maximizing the number of failing test cases in the test suite. QuSBT consists of definitions of the problem encoding, failure types, test assessment with statistical tests, fitness function, and test case generation with a Genetic Algorithm (GA). To empirically evaluate QuSBT, we compared it with Random Search (RS) by testing six quantum programs. We assessed the effectiveness of QuSBT and RS with 30 carefully designed faulty versions of the six quantum programs. Results show that QuSBT provides a viable solution for testing quantum programs, and achieved a significant improvement over RS in 87% of the faulty programs, and no significant difference in the rest of 13% of the faulty programs.
Mon 11 OctDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
12:10 - 13:30 | SSBSE Session 1Research Papers / Challenge at SSBSE ROOM Chair(s): Erik Hemberg Massachusetts Institute of Technology | ||
12:10 30mTalk | Generating Failing Test Suites for Quantum Programs with Search Research Papers Xinyi Wang Nanjing University of Aeronautics and Astronautics, Paolo Arcaini National Institute of Informatics
, Tao Yue Nanjing University of Aeronautics and Astronautics, Shaukat Ali Simula Research Laboratory, Norway Link to publication DOI | ||
12:40 20mTalk | Searching for Multi-Fault Programs in Defects4J Challenge Link to publication Pre-print Media Attached | ||
13:00 30mTalk | Search-based Selection and Prioritization of Test Scenarios for Autonomous Driving Systems Research Papers Chengjie Lu Nanjing University of Aeronautics and Astronautics, Huihui Zhang Weifang University, Tao Yue Nanjing University of Aeronautics and Astronautics, Shaukat Ali Simula Research Laboratory, Norway |