MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform
Fri 19 May 2023 16:45 - 17:00 at Meeting Room 102 - Metamorphic testing Chair(s): Shiva Nejati
As quantum computing is becoming increasingly popular, the underlying quantum computing platforms are growing both in ability and complexity. Unfortunately, testing these platforms is challenging due to the relatively small number of existing quantum programs and because of the oracle problem, i.e., a lack of specifications of the expected behavior of programs. This paper presents MorphQ, the first metamorphic testing approach for quantum computing platforms. Our two key contributions are (i) a program generator that creates a large and diverse set of valid (i.e., non-crashing) quantum programs, and (ii) a set of program transformations that exploit quantum-specific metamorphic relationships to alleviate the oracle problem. Evaluating the approach by testing the popular Qiskit platform shows that the approach creates over 8k program pairs within two days, many of which expose crashes. Inspecting the crashes, we find 13 bugs, nine of which have already been confirmed. MorphQ widens the slim portfolio of testing techniques of quantum computing platforms, helping to create a reliable software stack for this increasingly important field.
Wed 17 MayDisplayed time zone: Hobart change
Fri 19 MayDisplayed time zone: Hobart change
15:45 - 17:15 | Metamorphic testingSEIP - Software Engineering in Practice / Technical Track / Journal-First Papers / SEIS - Software Engineering in Society at Meeting Room 102 Chair(s): Shiva Nejati University of Ottawa | ||
15:45 15mTalk | MTTM: Metamorphic Testing for Textual Content Moderation Software Technical Track Wenxuan Wang The Chinese University of Hong Kong, Jen-tse Huang The Chinese University of Hong Kong, Weibin Wu Sun Yat-sen University, Jianping Zhang The Chinese University of Hong Kong, Yizhan Huang The Chinese University of Hong Kong, Shuqing Li The Chinese University of Hong Kong, Pinjia He Chinese University of Hong Kong at Shenzhen, Michael Lyu The Chinese University of Hong Kong | ||
16:00 15mTalk | Metamorphic Shader Fusion for Testing Graphics Shader Compilers Technical Track Dongwei Xiao The Hong Kong University of Science and Technology, Zhibo Liu Hong Kong University of Science and Technology, Shuai Wang Hong Kong University of Science and Technology | ||
16:15 15mPaper | Metamorphic Testing and Debugging of Tax Preparation Software SEIS - Software Engineering in Society Saeid Tizpaz-Niari University of Texas at El Paso, Verya Monjezi University of Texas at El Paso, Morgan Wagner University of Texas at El Paso, Shiva Darian University of Colorado Boulder, Krystia Reed University of Texas at El Paso, Ashutosh Trivedi University of Colorado Boulder Pre-print | ||
16:30 7mTalk | Biasfinder: Metamorphic test generation to uncover bias for sentiment analysis systems Journal-First Papers Muhammad Hilmi Asyrofi School of Computing and Information Systems, Singapore Management University, Zhou Yang Singapore Management University, Imam Nur Bani Yusuf Singapore Management University, Singapore, Hong Jin Kang UCLA, Ferdian Thung Singapore Management University, David Lo Singapore Management University | ||
16:37 7mTalk | Automated Metamorphic Testing using Transitive Relations for Specializing Stance Detection Models SEIP - Software Engineering in Practice Alisa Arno IBM Research - Tokyo, Futoshi Iwama IBM Research - Tokyo, Mikio Takeuchi IBM Research - Tokyo | ||
16:45 15mTalk | MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform Technical Track Pre-print | ||