Quantum Circuit Mutants: Empirical Analysis and Recommendations
This program is tentative and subject to change.
Quantum software testing is an emerging research area that currently lacks systematic benchmarks to assess the effectiveness of testing techniques. Recently, some open-source benchmarks for quantum circuits and quantum software bugs have been introduced, along with some mutation analysis tools. Despite these advances, there is still little understanding of how factors such as quantum circuit characteristics (e.g., number of qubits, circuit depth), algorithms (e.g., Quantum Phase Estimation), and mutation characteristics (e.g., mutation operators) influence mutant detection in quantum circuits. Gaining a better understanding of these relations would enable the design of faulty benchmarks with diverse attributes, such as different levels of fault detection difficulty, which would help evaluate the cost-effectiveness of quantum software testing techniques more effectively. In this study, we conduct the largest empirical study to date on quantum circuit mutants, analyzing over 700,000 faulty benchmarks produced by mutating 382 real-world quantum circuits. To evaluate how easy it is to detect a mutant with certain characteristics, we defined the survival rate, a new metric that quantifies the proportion of undetected mutants in the set of mutants with those same characteristics. This empirical study provides essential insights into mutants of quantum circuits, aiming to enhance the knowledge of developers and researchers in the field. We also present a tool that recommends mutants to users based on selected characteristics, such as a specific type of quantum algorithm and the desired survival rates, along with faulty benchmarks to evaluate the cost-effectiveness of testing techniques for quantum software.
This program is tentative and subject to change.
Tue 18 NovDisplayed time zone: Seoul change
14:00 - 15:30 | |||
14:00 10mTalk | Quantum Circuit Mutants: Empirical Analysis and Recommendations Journal-First Track Eñaut Mendiluze Usandizaga Simula Research Laboratory, Norway, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Tao Yue Beihang University, Paolo Arcaini National Institute of Informatics
| ||
14:10 10mTalk | MET-MAPF: A Metamorphic Testing Approach for Multi-Agent Path Finding Algorithms Journal-First Track Xiao-Yi Zhang University of Science and Technology Beijing, Yang Liu Nanyang Technological University, Paolo Arcaini National Institute of Informatics
, Mingyue Jiang Zhejiang Sci-Tech University, Zheng Zheng Beihang University | ||
14:20 10mTalk | State Field Coverage: A Metric for Oracle Quality Research Papers Facundo Molina IMDEA Software Institute, Nazareno Aguirre University of Rio Cuarto and CONICET, Alessandra Gorla IMDEA Software Institute | ||
14:30 10mTalk | Do LLMs Generate Useful Test Oracles? An Empirical Study with an Unbiased Dataset Research Papers Davide Molinelli USI Lugano; Schaffhausen Institute of Technology, Luca Di Grazia University of St. Gallen, Alberto Martin-Lopez Software Institute - USI, Lugano, Michael D. Ernst University of Washington, Mauro Pezze Università della Svizzera italiana (USI) and Università degli Studi di Milano Bicocca | ||
14:40 10mTalk | Finding Safety Violations of AI-Enabled Control Systems through the Lens of Synthesized Proxy Programs Journal-First Track Jieke Shi Singapore Management University, Zhou Yang University of Alberta, Alberta Machine Intelligence Institute , Junda He Singapore Management University, Bowen Xu North Carolina State University, Dongsun Kim Korea University, DongGyun Han Royal Holloway, University of London, David Lo Singapore Management University Link to publication DOI Pre-print | ||
14:50 10mTalk | ZendDiff: Differential Testing of PHP Interpreter Research Papers Yuancheng Jiang National University of Singapore, Jianing Wang National University of Singapore, Qiange Liu Beihang University, Yeqi Fu National University of Singapore, Jian Mao Beihang University, Roland H. C. Yap National University of Singapore, Zhenkai Liang National University of Singapore | ||
15:00 10mTalk | SATORI: Static Test Oracle Generation for REST APIs Research Papers Juan C. Alonso Universidad de Sevilla, Alberto Martin-Lopez Software Institute - USI, Lugano, Sergio Segura SCORE Lab, I3US Institute, Universidad de Sevilla, Seville, Spain, Gabriele Bavota Software Institute @ Università della Svizzera Italiana, Antonio Ruiz-Cortés University of Seville | ||
15:10 10mTalk | Exact Inference for Quantum Circuits: A Testing Oracle for Quantum Software Stacks Research Papers | ||
15:20 10mTalk | Identifying inconsistent software defect predictions with symmetry metamorphic relation pattern Journal-First Track Chan Pak Yuen Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong, China, Jacky Keung City University of Hong Kong, Zhen Yang Shandong University | ||