Bugs4Q: A Benchmark of Real Bugs for Quantum Programs
Realistic benchmarks of reproducible bugs and fixes are vital to good experimental evaluation of debugging and testing approaches. However, there is no suitable benchmark suite that can systematically evaluate the debugging and testing methods of quantum programs until now. This paper proposes Bugs4Q, a benchmark of thirty-six real, manually validated Qiskit bugs from four popular Qiskit elements (Terra, Aer, Ignis, and Aqua), supplemented with the test cases for reproducing buggy behaviors. Bugs4Q also provides interfaces for accessing the buggy and fixed versions of the Qiskit programs and executing the corresponding test cases, facilitating the reproducible empirical studies and comparisons of Qiskit program debugging and testing tools. (Bugs4Q is available at https://github.com/Z-928/Bugs4Q)
Thu 18 NovDisplayed time zone: Hobart change
19:00 - 20:00 | Bugs IIResearch Papers / NIER track / Tool Demonstrations at Koala Chair(s): Annibale Panichella Delft University of Technology | ||
19:00 20mTalk | Detecting Memory-Related Bugs by Tracking Heap Memory Management of C++ Smart Pointers Research Papers Xutong Ma State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China, Jiwei Yan Institute of Software at Chinese Academy of Sciences, China, Wei Wang State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China, Jun Yan Institute of Software at Chinese Academy of Sciences, China, Jian Zhang Institute of Software at Chinese Academy of Sciences, China, Zongyan Qiu Peking University | ||
19:20 20mTalk | Understanding and Detecting Performance Bugs in Markdown Compilers Research Papers Penghui Li The Chinese University of Hong Kong, Yinxi Liu The Chinese University of Hong Kong, Wei Meng Chinese University of Hong Kong Pre-print | ||
19:40 10mTalk | Bugs4Q: A Benchmark of Real Bugs for Quantum Programs NIER track Pengzhan Zhao Kyushu University, Jianjun Zhao Kyushu University, Zhongtao Miao Kyushu University, Shuhan Lan Kyushu University | ||
19:50 5mTalk | Muskit: A Mutation Analysis Tool for Quantum Software Testing Tool Demonstrations Eñaut Mendiluze Usandizaga Simula Research Laboratory, Norway, Shaukat Ali Simula Research Laboratory, Norway, Paolo Arcaini National Institute of Informatics
, Tao Yue Nanjing University of Aeronautics and Astronautics | ||
19:55 5mTalk | JTDog: a Gradle Plugin for Dynamic Test Smell Detection Tool Demonstrations Masayuki Taniguchi Osaka University, Shinsuke Matsumoto Osaka University, Shinji Kusumoto Osaka University |