Quantum Program Testing Through Commuting Pauli Strings on IBM's Quantum Computers
The most promising applications of quantum computing are centered around solving search and optimization tasks, particularly in fields such as physics simulations, quantum chemistry, and finance. However, the current quantum software testing methods face practical limitations when applied in industrial contexts: (i) they do not apply to quantum programs most relevant to the industry, (ii) they require a full program specification, which is usually not available for these programs, and (iii) they are incompatible with error mitigation methods currently adopted by main industry actors like IBM. To address these challenges, we present QOPS, a novel quantum software testing approach. QOPS introduces a new definition of test cases based on Pauli strings to improve compatibility with different quantum programs. QOPS also introduces a new test oracle that can be directly integrated with industrial APIs such as IBM’s Estimator API and can utilize error mitigation methods for testing on real noisy quantum computers. We also leverage the commuting property of Pauli strings to relax the requirement of having complete program specifications, making QOPS practical for testing complex quantum programs in industrial settings. We empirically evaluate QOPS on 194,982 real quantum programs, demonstrating effective performance in test assessment compared to the state-of-the-art with a perfect F1-score, precision, and recall. Furthermore, we validate the industrial applicability of QOPS by assessing its performance on IBM’s three real quantum computers, incorporating both industrial and open-source error mitigation methods.
Thu 31 OctDisplayed time zone: Pacific Time (US & Canada) change
13:30 - 15:00 | Testing 3Tool Demonstrations / Journal-first Papers / Research Papers / Industry Showcase / NIER Track at Camellia Chair(s): Yi Song School of Computer Science, Wuhan University | ||
13:30 12mTalk | General and Practical Property-based Testing for Android Apps Research Papers Yiheng Xiong East China Normal University, Ting Su East China Normal University, Jue Wang Nanjing University, Jingling Sun University of Electronic Science and Technology of China, Geguang Pu East China Normal University, China, Zhendong Su ETH Zurich Pre-print | ||
13:42 12mTalk | ACCESS: Assurance Case Centric Engineering of Safety-critical Systems Journal-first Papers Ran Wei Lancaster University, Simon Foster University of York, Haitao Mei University of York, Fang Yan University of York, Ruizhe Yang Dalian University of Technology, Ibrahim Habli University of York, Colin O'Halloran D-RisQ Software Systems, Nick Tudor D-RisQ Software Systems, Tim Kelly University of York, Yakoub Nemouchi University of York | ||
13:55 12mTalk | Quantum Program Testing Through Commuting Pauli Strings on IBM's Quantum Computers Industry Showcase Asmar Muqeet Simula Research Laboratory and University of Oslo, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Paolo Arcaini National Institute of Informatics
Link to publication Pre-print | ||
14:08 12mTalk | Toward Individual Fairness Testing with Data Validity NIER Track Takashi Kitamura , Sousuke Amasaki Okayama Prefectural University, Jun Inoue National Institute of Advanced Industrial Science and Technology, Japan, Yoshinao Isobe AIST, Takahisa Toda The University of Electro-Communications | ||
14:21 12mTalk | DroneWiS: Automated Simulation Testing of small Unmanned Aerial System in Realistic Windy Conditions Tool Demonstrations | ||
14:34 12mTalk | ARUS: A Tool for Automatically Removing Unnecessary Stubbings from Test Suites Tool Demonstrations | ||
14:47 12mTalk | Learning Failure-Inducing Models for Testing Software-Defined Networks Journal-first Papers Raphaël Ollando University of Luxembourg, Seung Yeob Shin University of Luxembourg, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland |