ASE 2024
Sun 27 October - Fri 1 November 2024 Sacramento, California, United States
Thu 31 Oct 2024 13:55 - 14:08 at Camellia - Testing 3 Chair(s): Yi Song

The most promising applications of quantum computing are centered around solving search and optimization tasks, particularly in fields such as physics simulations, quantum chemistry, and finance. However, the current quantum software testing methods face practical limitations when applied in industrial contexts: (i) they do not apply to quantum programs most relevant to the industry, (ii) they require a full program specification, which is usually not available for these programs, and (iii) they are incompatible with error mitigation methods currently adopted by main industry actors like IBM. To address these challenges, we present QOPS, a novel quantum software testing approach. QOPS introduces a new definition of test cases based on Pauli strings to improve compatibility with different quantum programs. QOPS also introduces a new test oracle that can be directly integrated with industrial APIs such as IBM’s Estimator API and can utilize error mitigation methods for testing on real noisy quantum computers. We also leverage the commuting property of Pauli strings to relax the requirement of having complete program specifications, making QOPS practical for testing complex quantum programs in industrial settings. We empirically evaluate QOPS on 194,982 real quantum programs, demonstrating effective performance in test assessment compared to the state-of-the-art with a perfect F1-score, precision, and recall. Furthermore, we validate the industrial applicability of QOPS by assessing its performance on IBM’s three real quantum computers, incorporating both industrial and open-source error mitigation methods.

Thu 31 Oct

Displayed time zone: Pacific Time (US & Canada) change

13:30 - 15:00
Testing 3Tool Demonstrations / Journal-first Papers / Research Papers / Industry Showcase / NIER Track at Camellia
Chair(s): Yi Song School of Computer Science, Wuhan University
13:30
12m
Talk
General and Practical Property-based Testing for Android AppsACM SigSoft Distinguished Paper Award
Research Papers
Yiheng Xiong East China Normal University, Ting Su East China Normal University, Jue Wang Nanjing University, Jingling Sun University of Electronic Science and Technology of China, Geguang Pu East China Normal University, China, Zhendong Su ETH Zurich
Pre-print
13:42
12m
Talk
ACCESS: Assurance Case Centric Engineering of Safety-critical Systems
Journal-first Papers
Ran Wei Lancaster University, Simon Foster University of York, Haitao Mei University of York, Fang Yan University of York, Ruizhe Yang Dalian University of Technology, Ibrahim Habli University of York, Colin O'Halloran D-RisQ Software Systems, Nick Tudor D-RisQ Software Systems, Tim Kelly University of York, Yakoub Nemouchi University of York
13:55
12m
Talk
Quantum Program Testing Through Commuting Pauli Strings on IBM's Quantum Computers
Industry Showcase
Asmar Muqeet Simula Research Laboratory and University of Oslo, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Paolo Arcaini National Institute of Informatics
Link to publication Pre-print
14:08
12m
Talk
Toward Individual Fairness Testing with Data Validity
NIER Track
Takashi Kitamura , Sousuke Amasaki Okayama Prefectural University, Jun Inoue National Institute of Advanced Industrial Science and Technology, Japan, Yoshinao Isobe AIST, Takahisa Toda The University of Electro-Communications
14:21
12m
Talk
DroneWiS: Automated Simulation Testing of small Unmanned Aerial System in Realistic Windy Conditions
Tool Demonstrations
Bohan Zhang Saint Louis University, Missouri, Ankit Agrawal Saint Louis University, Missouri
14:34
12m
Talk
ARUS: A Tool for Automatically Removing Unnecessary Stubbings from Test Suites
Tool Demonstrations
Mengzhen Li University of Minnesota, Mattia Fazzini University of Minnesota
14:47
12m
Talk
Learning Failure-Inducing Models for Testing Software-Defined Networks
Journal-first Papers
Raphaël Ollando University of Luxembourg, Seung Yeob Shin University of Luxembourg, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland