Ensuring Critical Properties of Test Oracles for Effective Bug Detection
With software becoming essential in all aspects of our lives, especially in critical areas like medical and avionic systems, the need for robust and reliable software is more critical than ever. Even seemingly insignificant software bugs can compromise system stability and security, as evidenced by a simple copy-paste error in Apple devices accepting invalid SSL certificates and a date formatting issue causing a widespread Twitter outage. These realities underscore the need for effective testing and bug detection mechanisms to ensure software reliability. At the heart of this challenge are test oracles, a fundamental component of testing, which play a crucial role in detecting software bugs.
Recognizing the pivotal role of test oracles, my research conducts large-scale studies to understand their impact on bug detection effectiveness, identify limitations in existing test adequacy metrics and automated oracle generation methods. Based on the findings, my research identifies three key properties of test oracles essential for effective bug detection, referred to as CCS (check, correct, strong). These properties ensure that test oracles thoroughly check codes, are correct based on the specification and strong for bug detection. To enforce the CCS properties, my research introduces a set of methods, leading to the development of OracleGuru framework that significantly enhances the quality of test oracles.
Tue 16 AprDisplayed time zone: Lisbon change
14:00 - 15:30 | Focus Group: Software TestingDoctoral Symposium at Fernando Pessoa Chair(s): Andreas Zeller CISPA Helmholtz Center for Information Security | ||
14:00 90mPoster | Ensuring Critical Properties of Test Oracles for Effective Bug Detection Doctoral Symposium Soneya Binta Hossain University of Virginia Pre-print | ||
14:00 90mPoster | On Improving Management of Duplicate Video-Based Bug Reports Doctoral Symposium Yanfu Yan William & Mary | ||
14:00 90mPoster | Autonomic Testing: Testing with Scenarios from Production Doctoral Symposium Ketai Qiu USI Università della Svizzera Italiana DOI | ||
14:00 90mPoster | Selecting and Constraining Metamorphic Relations Doctoral Symposium Alejandra Duque-Torres University of Tartu |