The Tools Track seeks to bridge the gap between research and practice, focusing on software testing, verification, and validation. Its main goal is to advance both the state of the art and the state of the practice.
Sun 25 OctDisplayed time zone: Lisbon change
09:00 - 09:15 | Intro & WelcomeResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room +11h Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC, Rui Abreu Faculty of Engineering, University of Porto, Portugal | ||
09:00 15mDay opening | Intro & Welcome Research Papers |
14:00 - 16:00 | RT5 - Testing for APIsTesting Tools Track / Research Papers at Farfetch (D. Maria) +11h Chair(s): José Miguel Rojas University of Leicester, UK | ||
15:30 15mTalk | CDST: A Toolkit for Testing Cockpit Display Systems Testing Tools Track Hassan Sartaj QUEST - UAV Dependability Lab, Muhammad Zohaib Iqbal National University of Computer and Emerging Sciences, Muhammad Uzair Khan National University of Computer and Emerging Sciences Link to publication DOI | ||
15:45 15mTalk | Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing Testing Tools Track Miroslav Bures Czech Technical University in Prague, Pavel Herout University of West Bohemia, Pilsen, CZ, Bestoun S. Ahmed Karlstad University Link to publication DOI |
16:15 - 17:15 | Keynote 1Research Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC | ||
16:15 60mKeynote | One-click formal methods Research Papers Liana Hadarean Amazon Link to publication |
20:00 - 20:15 | Intro & WelcomeResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC, Rui Abreu Faculty of Engineering, University of Porto, Portugal | ||
20:00 15mDay opening | Intro & Welcome Research Papers |
Mon 26 OctDisplayed time zone: Lisbon change
01:00 - 03:00 | RT5 - Testing for APIsResearch Papers / Testing Tools Track at Farfetch (D. Maria) Chair(s): Marcelo d'Amorim Federal University of Pernambuco | ||
02:30 15mTalk | CDST: A Toolkit for Testing Cockpit Display Systems Testing Tools Track Hassan Sartaj QUEST - UAV Dependability Lab, Muhammad Zohaib Iqbal National University of Computer and Emerging Sciences, Muhammad Uzair Khan National University of Computer and Emerging Sciences Link to publication DOI | ||
02:45 15mTalk | Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing Testing Tools Track Miroslav Bures Czech Technical University in Prague, Pavel Herout University of West Bohemia, Pilsen, CZ, Bestoun S. Ahmed Karlstad University Link to publication DOI |
09:00 - 09:30 | Most Influential Paper AwardsResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room +11h Chair(s): Luís Cruz Deflt University of Technology | ||
09:00 15mAwards | Using Mutation to Automatically Suggest Fixes for Faulty Programs Research Papers Media Attached | ||
09:15 15mAwards | Searching for a needle in a haystack predicting security vulnerabilities for Windows Vista Research Papers Thomas Zimmermann Microsoft Research, Nachiappan Nagappan Microsoft Research, USA, Laurie Williams North Carolina State University Media Attached |
20:00 - 20:30 | Most Influential Paper AwardsResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): Rui Abreu Faculty of Engineering, University of Porto, Portugal, João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC | ||
20:00 15mAwards | Using Mutation to Automatically Suggest Fixes for Faulty Programs Research Papers Media Attached | ||
20:15 15mAwards | Searching for a needle in a haystack predicting security vulnerabilities for Windows Vista Research Papers Thomas Zimmermann Microsoft Research, Nachiappan Nagappan Microsoft Research, USA, Laurie Williams North Carolina State University Media Attached |
Tue 27 OctDisplayed time zone: Lisbon change
10:00 - 11:00 | Testing toolsTesting Tools Track at Infante +11h Chair(s): René Just University of Washington, USA, Andy Zaidman Delft University of Technology | ||
10:00 15mTalk | Callisto: Entropy-based Test Generation and Data Quality Assessment for Machine Learning Systems Testing Tools Track Sakshi Udeshi , Xingbin Jiang Singapore University of Technology and Design, Sudipta Chattopadhyay Singapore University of Technology and Design Link to publication DOI | ||
10:15 15mTalk | Run Java Applications and Test Them In-Vivo Meantime Testing Tools Track Antonia Bertolino CNR-ISTI, Guglielmo De Angelis CNR-IASI, CNR-ISTI, Breno Miranda Federal University of Pernambuco, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
10:30 15mTalk | AFLNet: A Greybox Fuzzer for Network Protocols Testing Tools Track Van-Thuan Pham Monash University, Marcel Böhme Monash University, Australia, Abhik Roychoudhury National University of Singapore, Singapore Link to publication DOI | ||
10:45 15mTalk | ct-fuzz: Fuzzing for Timing Leaks Testing Tools Track Shaobo He University of Utah, Michael Emmi Amazon Web Services, Gabriela Ciocarlie SRI International Link to publication DOI |
21:00 - 22:00 | Testing toolsTesting Tools Track at Infante Chair(s): René Just University of Washington, USA, Andy Zaidman Delft University of Technology | ||
21:00 15mTalk | Callisto: Entropy-based Test Generation and Data Quality Assessment for Machine Learning Systems Testing Tools Track Sakshi Udeshi , Xingbin Jiang Singapore University of Technology and Design, Sudipta Chattopadhyay Singapore University of Technology and Design Link to publication DOI | ||
21:15 15mTalk | Run Java Applications and Test Them In-Vivo Meantime Testing Tools Track Antonia Bertolino CNR-ISTI, Guglielmo De Angelis CNR-IASI, CNR-ISTI, Breno Miranda Federal University of Pernambuco, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
21:30 15mTalk | AFLNet: A Greybox Fuzzer for Network Protocols Testing Tools Track Van-Thuan Pham Monash University, Marcel Böhme Monash University, Australia, Abhik Roychoudhury National University of Singapore, Singapore Link to publication DOI | ||
21:45 15mTalk | ct-fuzz: Fuzzing for Timing Leaks Testing Tools Track Shaobo He University of Utah, Michael Emmi Amazon Web Services, Gabriela Ciocarlie SRI International Link to publication DOI |
Accepted Papers
Title | |
---|---|
AFLNet: A Greybox Fuzzer for Network Protocols Testing Tools Track Link to publication DOI | |
Callisto: Entropy-based Test Generation and Data Quality Assessment for Machine Learning Systems Testing Tools Track Link to publication DOI | |
CDST: A Toolkit for Testing Cockpit Display Systems Testing Tools Track Link to publication DOI | |
ct-fuzz: Fuzzing for Timing Leaks Testing Tools Track Link to publication DOI | |
Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing Testing Tools Track Link to publication DOI | |
Run Java Applications and Test Them In-Vivo Meantime Testing Tools Track Link to publication DOI |
Call for Papers
The Tools Track seeks to bridge the gap between research and practice, focusing on software testing, verification, and validation. Its main goal is to advance both the state of the art and the state of the practice.
The Tools Track invites submissions that describe tools at several stages of maturity, including promising research prototypes, widely used research tools, and commercial tools.
A Tools Track submission should clearly describe the complexity of the addressed problem, solved technical challenges, and possibilities for technology transfer into practice. Researchers are welcome to submit papers that describe novel approaches and how these approaches support tool developers in solving challenging problems. Moreover, this track seeks non-academic submissions to foster discussions between researchers and practitioners.
Areas of interest:
The Tools Track invites submissions related, but not limited, to the following areas:
- Design and development of novel tools for software testing, verification, and validation;
- Working prototypes for novel research approaches, reporting on the technical challenges and early feedback obtained from practitioners;
- Strategies and challenges for tool adoption as well as lessons learned from technology transfer of academic approaches into open source or commercial tools;
- Case studies and/or experiments involving tools in particular contexts, reporting on lessons learned and negative results (if any).
Evaluation:
Each submission will be evaluated based on:
- The relevance and significance of the addressed problem.
- The innovation element of the approach.
- The availability, maturity, and adoption of the tool.
- The presence of lessons learned from developing or using the tool.
- The quality of the presentation.
Accepted papers will appear in the conference proceedings and the IEEE digital library.
Submission:
Submissions will be handled via easychair (Testing Tools Track): https://easychair.org/my/conference?conf=icst2020
The Testing Tools Track of ICST 2020 uses single-blind reviewing, which means that papers and tools need not be anonymized. All submitted papers must conform to the two column IEEE conference publication format. Templates for Latex and Word are available at: http://www.ieee.org/conferences_events/conferences/publishing/templates.html;
- Use the letter format templates and the “conference” option.
- The paper must be submitted as PDF and m ust not exceed 6 pages.
Presentation format:
Author(s) of an accepted paper will present their work at the ICST conference on two occasions:
- Lightning talk to advertise the tool and talk (~1 minute).
- Paper presentation (~15 minutes).