Tue 27 Oct 2020 20:30 - 21:00 at Infante - RT10 - Misc 3 Chair(s): Luís Cruz
Runtime Verification (RV) can help find software bugs by monitoring formally specified properties during testing. A key problem when using RV during testing is how to reduce the manual inspection effort for checking whether property violations are true bugs. To date, there was no automated approach for determining the likelihood that property violations were true bugs to reduce tedious and time-consuming manual inspection.We present RVPRIO, the first automated approach for prioritizing RV violations in order of likelihood of being true bugs. RVPRIO uses machine learning classifiers to prioritize violations. For training, we used a labeled dataset of 1,170 violations from 110 projects. On that dataset, (1) RVPRIO reached 90% of the effectiveness of a theoretically optimal prioritizer that ranks all true bugs at the top of the ranked list, and (2) 88.1% of true bugs were in the top 25% of RVPRIO-ranked violations; 32.7% of true bugs were in the top 10%. RVPRIO was also effective when we applied it to new unlabeled violations, from which we found previously unknown bugs-29 bugs in 7 projects and two bugs in two properties. Our dataset is publicly available online.
Tue 27 OctDisplayed time zone: Lisbon change
09:00 - 10:00 | RT10 - Misc 3Research Papers at Infante +11h Chair(s): Thomas Durieux KTH Royal Institute of Technology, Sweden | ||
09:00 30mTalk | A Framework for In-Vivo Testing of Mobile Applications Research Papers Mariano Ceccato University of Verona, Davide Corradini Fondazione Bruno Kessler, Luca Gazzola Università degli Studi di Milano-Bicocca, Fitsum Kifetew Fondazione Bruno Kessler, Leonardo Mariani University of Milano Bicocca, Matteo Orru University of Milano Bicocca, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
09:30 30mTalk | Prioritizing Runtime Verification Violations Research Papers Breno Miranda Federal University of Pernambuco, Igor Lima Federal University of Pernambuco, Owolabi Legunsen Cornell University, Marcelo d'Amorim Federal University of Pernambuco Link to publication DOI | ||
20:00 - 21:00 | |||
20:00 30mTalk | A Framework for In-Vivo Testing of Mobile Applications Research Papers Mariano Ceccato University of Verona, Davide Corradini Fondazione Bruno Kessler, Luca Gazzola Università degli Studi di Milano-Bicocca, Fitsum Kifetew Fondazione Bruno Kessler, Leonardo Mariani University of Milano Bicocca, Matteo Orru University of Milano Bicocca, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
20:30 30mTalk | Prioritizing Runtime Verification Violations Research Papers Breno Miranda Federal University of Pernambuco, Igor Lima Federal University of Pernambuco, Owolabi Legunsen Cornell University, Marcelo d'Amorim Federal University of Pernambuco Link to publication DOI | ||