Write a Blog >>
ICSE 2023
Sun 14 - Sat 20 May 2023 Melbourne, Australia
Wed 17 May 2023 15:19 - 15:21 at Meeting Room 105 - Posters 1
Fri 19 May 2023 14:00 - 14:15 at Meeting Room 105 - Fault injection and mutation Chair(s): Lingxiao Jiang

We present Diver, a novel technique for effectively finding critical bugs in SMT solvers. Ensuring the correctness of SMT solvers is becoming increasingly important as many applications use solvers as a foundational basis. In response, several approaches for testing SMT solvers, which are classified into differential testing and oracle-guided approaches, have been proposed until recently. However, they are still unsatisfactory in that (1) differential testing approaches cannot validate unique yet important features of solvers, and (2) oracle-guided approaches cannot generate diverse tests due to their reliance on limited mutation rules. Diver aims to complement these shortcomings, particularly focusing on finding bugs that are missed by existing approaches. To this end, we present a new testing technique that supports unrestricted random mutations without differential testing. We have used Diver to validate the most recent versions of three popular SMT solvers: CVC5, Z3 and dReal. In total, Diver found 25 confirmed and unique bugs, of which 21 are critical and directly affect the reliability of the solvers. We also empirically prove Diver’s own strength by showing that existing tools are unlikely to find the bugs discovered by Diver.

Wed 17 May

Displayed time zone: Hobart change

15:15 - 15:45
15:15
2m
Poster
Distribution-aware Fairness Test Generation
Posters
Sai Sathiesh Rajan Singapore University of Technology and Design, Singapore, Ezekiel Soremekun Royal Holloway, University of London, Sudipta Chattopadhyay Singapore University of Technology and Design, Yves Le Traon University of Luxembourg, Luxembourg
15:17
2m
Talk
Improving API Knowledge Discovery with ML: A Case Study of Comparable API Methods
Technical Track
Daye Nam Carnegie Mellon University, Brad A. Myers Carnegie Mellon University, Bogdan Vasilescu Carnegie Mellon University, Vincent J. Hellendoorn Carnegie Mellon University
Pre-print
15:19
2m
Talk
Diver: Oracle-Guided SMT Solver Testing with Unrestricted Random Mutations
Technical Track
Jongwook Kim Korea University, Sunbeom So Korea University, Hakjoo Oh Korea University
15:21
2m
Talk
Demystifying Exploitable Bugs in Smart Contracts
Technical Track
Zhuo Zhang Purdue University, Brian Zhang Harrison High School (Tippecanoe), Wen Xu PNM Labs, Zhiqiang Lin The Ohio State University
Pre-print
15:23
2m
Talk
An Empirical Study of Deep Learning Models for Vulnerability Detection
Technical Track
Benjamin Steenhoek Iowa State University, Md Mahbubur Rahman Iowa State University, Richard Jiles Iowa State University, Wei Le Iowa State University
Pre-print
15:25
2m
Talk
MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform
Technical Track
Matteo Paltenghi University of Stuttgart, Germany, Michael Pradel University of Stuttgart
Pre-print
15:27
2m
Talk
Large Language Models are Few-shot Testers: Exploring LLM-based General Bug Reproduction
Technical Track
Sungmin Kang KAIST, Juyeon Yoon Korea Advanced Institute of Science and Technology, Shin Yoo KAIST
Pre-print
15:30
2m
Talk
Automating Code-Related Tasks Through Transformers: The Impact of Pre-training
Technical Track
Rosalia Tufano Università della Svizzera Italiana, Luca Pascarella ETH Zurich, Gabriele Bavota Software Institute, USI Università della Svizzera italiana
15:32
2m
Talk
Generic Partition Refinement and Weighted Tree Automata
Showcase
Hans-Peter Deifel Friedrich-Alexander University Erlangen-Nürnberg, Germany, Stefan Milius , Lutz Schröder University of Erlangen-Nuremberg, Thorsten Wißmann Friedrich-Alexander University Erlangen-Nürnberg
Link to publication DOI Pre-print
15:34
2m
Talk
Learning Seed-Adaptive Mutation Strategies for Greybox Fuzzing
Technical Track
Myungho Lee Korea University, Sooyoung Cha Sungkyunkwan University, Hakjoo Oh Korea University
15:36
2m
Talk
Bug localization in game software engineering: evolving simulations to locate bugs in software models of video games
Showcase
Rodrigo Casamayor SVIT Research Group. Universidad San Jorge, Lorena Arcega San Jorge University, Francisca Pérez SVIT Research Group, Universidad San Jorge, Carlos Cetina San Jorge University, Spain
DOI
15:38
2m
Poster
Don't Complete It! Preventing Unhelpful Code Completion for Productive and Sustainable Neural Code Completion Systems
Posters
Zhensu Sun The Hong Kong Polytechnic University, Xiaoning Du Monash University, Australia, Fu Song ShanghaiTech University, Shangwen Wang National University of Defense Technology, Li Li Beihang University
15:40
2m
Talk
A Qualitative Study on the Implementation Design Decisions of DevelopersDistinguished Paper Award
Technical Track
Jenny T. Liang Carnegie Mellon University, Maryam Arab George Mason University, Minhyuk Ko Virginia Tech, Amy Ko University of Washington, Thomas LaToza George Mason University
Pre-print
15:42
2m
Poster
Closing the Loop for Software Remodularisation - REARRANGE: An Effort Estimation Approach for Software Clustering-based Remodularisation
Posters
Alvin Jian Jin Tan , Chun Yong Chong Monash University Malaysia, Aldeida Aleti Monash University

Fri 19 May

Displayed time zone: Hobart change

13:45 - 15:15
13:45
15m
Talk
Coverage Guided Fault Injection for Cloud Systems
Technical Track
Yu Gao Institute of Software, Chinese Academy of Sciences, China, Wensheng Dou Institute of Software Chinese Academy of Sciences, Dong Wang Institute of software, Chinese academy of sciences, Wenhan Feng Institute of Software Chinese Academy of Sciences, Jun Wei Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; University of Chinese Academy of Sciences Chongqing School, Hua Zhong Institute of Software Chinese Academy of Sciences, Tao Huang Institute of Software Chinese Academy of Sciences
Pre-print
14:00
15m
Talk
Diver: Oracle-Guided SMT Solver Testing with Unrestricted Random Mutations
Technical Track
Jongwook Kim Korea University, Sunbeom So Korea University, Hakjoo Oh Korea University
14:15
15m
Talk
Identifying Defect Injection Risks from Analysis and Design Diagrams: An Industrial Case Study at Sony
SEIP - Software Engineering in Practice
Yoji Imanishi Sony Global Manufacturing&Operations, Kazuhiro Kumon Sony Global Manufacturing&Operations, Shuji Morisaki Nagoya University
14:30
7m
Talk
DaMAT: A Data-driven Mutation Analysis Tool
DEMO - Demonstrations
Enrico Viganò University of Luxembourg, Oscar Cornejo SnT Centre, University of Luxembourg, Fabrizio Pastore University of Luxembourg, Lionel Briand University of Luxembourg; University of Ottawa
Pre-print
14:37
7m
Talk
Mutation testing in the wild: findings from GitHub
Journal-First Papers
Ana B. Sánchez University of Seville, Pedro Delgado-Pérez Universidad de Cádiz, Inmaculada Medina-Bulo Universidad de Cádiz, Sergio Segura University of Seville
Link to publication DOI
14:45
7m
Talk
An Experimental Assessment of Using Theoretical Defect Predictors to Guide Search-Based Software Testing
Journal-First Papers
Anjana Perera Oracle Labs, Australia, Aldeida Aleti Monash University, Burak Turhan University of Oulu, Marcel Böhme MPI-SP, Germany and Monash University, Australia
Link to publication DOI
14:52
7m
Talk
Assurance Cases as Data: A Manifesto
NIER - New Ideas and Emerging Results
Claudio Menghi McMaster University, Canada, Torin Viger , Alessio Di Sandro University of Toronto, Chris Rees Critical Systems Labs, Jeffrey Joyce Critical System Labs Inc., Marsha Chechik University of Toronto
15:00
7m
Talk
Predictive Mutation Analysis via Natural Language Channel in Source Code
Journal-First Papers
Jinhan Kim KAIST, Juyoung Jeon Handong Global University, Shin Hong Handong Global University, Shin Yoo KAIST
Link to publication Pre-print