Dates
Tracks
Plenary
Sun 25 OctDisplayed time zone: Lisbon change
Sun 25 Oct
Displayed time zone: Lisbon change
09:00 - 09:15 | Intro & WelcomeResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room +11h Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC, Rui Abreu Faculty of Engineering, University of Porto, Portugal | ||
09:00 15mDay opening | Intro & Welcome Research Papers | ||
09:15 - 10:45 | RT1 - Fault Localization and Debugging InfanteResearch Papers at Infante +11h Chair(s): Andreas Zeller CISPA, Germany | ||
09:15 30mTalk | Can We Predict the Quality of Spectrum-based Fault Localization? Research Papers Mojdeh Golagha Technical University of Munich, Alexander Pretschner Technical University of Munich, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI | ||
09:45 30mTalk | Substate Profiling for Enhanced Fault Detection and Localization: An Empirical Study Research Papers Rawad Abou Assi American University of Beirut, Wes Masri American University of Beirut, Chadi Trad American University of Beirut Link to publication DOI | ||
10:15 30mTalk | More Accurate Dynamic Slicing for Better Supporting Software Debugging Research Papers Link to publication DOI | ||
11:00 - 12:30 | RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria) +11h Chair(s): Antonio Filieri Imperial College London | ||
11:00 30mTalk | An Empirical Evaluation of Mutation Operators for Deep Learning Systems Research Papers Link to publication DOI | ||
11:30 30mTalk | Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study Research Papers Fitash Ul Haq University of Luxembourg, Donghwan Shin University of Luxembourg, Shiva Nejati University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI | ||
12:00 30mTalk | A Study on Challenges of Testing Robotic Systems Research Papers Afsoon Afzal Carnegie Mellon University, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA, Christopher Steven Timperley Carnegie Mellon University Link to publication DOI | ||
11:00 - 12:30 | RT2 - Test Generation InfanteResearch Papers at Infante +11h Chair(s): Marcelo d'Amorim Federal University of Pernambuco | ||
11:00 30mTalk | Language-Agnostic Generation of Compilable Test Programs Research Papers Patrick Kreutzer Friedrich-Alexander University Erlangen-Nürnberg, Stefan Kraus Friedrich-Alexander University Erlangen-Nürnberg, Michael Philippsen Friedrich-Alexander University Erlangen-Nürnberg (FAU) Link to publication DOI | ||
11:30 30mTalk | MiMIs: Simple, Efficient, and Fast Bounded-Exhaustive Test Case Generators Research Papers Kyle Dewey California State University, Northridge, Shant Hairapetian University of Oregon, Miroslav Gavrilov University of California, Santa Barbara Link to publication DOI | ||
12:00 30mTalk | Learning How to Search: Generating Exception-Triggering Tests Through Adaptive Fitness Function Selection Research Papers Link to publication DOI | ||
14:00 - 15:00 | RT4 - Misc 1Research Papers at Infante +11h Chair(s): Andrea Stocco Università della Svizzera italiana (USI) | ||
14:00 30mTalk | Determining Method-Call Sequences for Object Creation in C++ Research Papers Link to publication DOI | ||
14:30 30mTalk | NodeRacer: Event Race Detection for Node.js Applications Research Papers André T. Endo Federal University of Technology - Paraná (UTFPR), Anders Møller Aarhus University, Denmark Link to publication DOI | ||
16:15 - 17:15 | Keynote 1Research Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC | ||
16:15 60mKeynote | One-click formal methods Research Papers Liana Hadarean Amazon Link to publication | ||
20:00 - 20:15 | Intro & WelcomeResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC, Rui Abreu Faculty of Engineering, University of Porto, Portugal | ||
20:00 15mDay opening | Intro & Welcome Research Papers | ||
20:15 - 21:45 | RT1 - Fault Localization and Debugging InfanteResearch Papers at Infante Chair(s): José Campos University of Lisbon, Portugal | ||
20:15 30mTalk | Can We Predict the Quality of Spectrum-based Fault Localization? Research Papers Mojdeh Golagha Technical University of Munich, Alexander Pretschner Technical University of Munich, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI | ||
20:45 30mTalk | Substate Profiling for Enhanced Fault Detection and Localization: An Empirical Study Research Papers Rawad Abou Assi American University of Beirut, Wes Masri American University of Beirut, Chadi Trad American University of Beirut Link to publication DOI | ||
21:15 30mTalk | More Accurate Dynamic Slicing for Better Supporting Software Debugging Research Papers Link to publication DOI | ||
22:00 - 23:30 | RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria) Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC | ||
22:00 30mTalk | An Empirical Evaluation of Mutation Operators for Deep Learning Systems Research Papers Link to publication DOI | ||
22:30 30mTalk | Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study Research Papers Fitash Ul Haq University of Luxembourg, Donghwan Shin University of Luxembourg, Shiva Nejati University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI | ||
23:00 30mTalk | A Study on Challenges of Testing Robotic Systems Research Papers Afsoon Afzal Carnegie Mellon University, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA, Christopher Steven Timperley Carnegie Mellon University Link to publication DOI | ||
22:00 - 23:30 | RT2 - Test Generation InfanteResearch Papers at Infante Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center | ||
22:00 30mTalk | Language-Agnostic Generation of Compilable Test Programs Research Papers Patrick Kreutzer Friedrich-Alexander University Erlangen-Nürnberg, Stefan Kraus Friedrich-Alexander University Erlangen-Nürnberg, Michael Philippsen Friedrich-Alexander University Erlangen-Nürnberg (FAU) Link to publication DOI | ||
22:30 30mTalk | MiMIs: Simple, Efficient, and Fast Bounded-Exhaustive Test Case Generators Research Papers Kyle Dewey California State University, Northridge, Shant Hairapetian University of Oregon, Miroslav Gavrilov University of California, Santa Barbara Link to publication DOI | ||
23:00 30mTalk | Learning How to Search: Generating Exception-Triggering Tests Through Adaptive Fitness Function Selection Research Papers Link to publication DOI | ||
Mon 26 OctDisplayed time zone: Lisbon change
Mon 26 Oct
Displayed time zone: Lisbon change
01:00 - 02:00 | RT4 - Misc 1Research Papers at Infante Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center | ||
01:00 30mTalk | Determining Method-Call Sequences for Object Creation in C++ Research Papers Link to publication DOI | ||
01:30 30mTalk | NodeRacer: Event Race Detection for Node.js Applications Research Papers André T. Endo Federal University of Technology - Paraná (UTFPR), Anders Møller Aarhus University, Denmark Link to publication DOI | ||
09:00 - 09:30 | Most Influential Paper AwardsResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room +11h Chair(s): Luís Cruz Deflt University of Technology | ||
09:00 15mAwards | Using Mutation to Automatically Suggest Fixes for Faulty Programs Research Papers Media Attached | ||
09:15 15mAwards | Searching for a needle in a haystack predicting security vulnerabilities for Windows Vista Research Papers Thomas Zimmermann Microsoft Research, Nachiappan Nagappan Microsoft Research, USA, Laurie Williams North Carolina State University Media Attached | ||
09:30 - 10:30 | |||
10:45 - 12:15 | RT6 - Web TestingResearch Papers at Infante +11h Chair(s): José Campos University of Lisbon, Portugal | ||
10:45 30mTalk | Fostering the Diversity of Exploratory Testing in Web Applications Research Papers Julien Leveau LaBRI, Xavier Blanc LaBRI, Laurent Réveillère LaBRI, Jean-Rémy Falleri Bordeaux INP, Romain Rouvoy Univ. Lille / Inria / IUF Link to publication DOI | ||
11:15 30mTalk | Dependency-Aware Web Test Generation Research Papers Matteo Biagiola Fondazione Bruno Kessler (FBK), Andrea Stocco Università della Svizzera italiana (USI), Filippo Ricca Università di Genova, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
11:45 30mTalk | Metamorphic Security Testing for Web Systems Research Papers Phu X. Mai University of Luxembourg, Fabrizio Pastore University of Luxembourg, Arda Goknil SnT, University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI | ||
13:45 - 15:15 | Journal First 1Journal-First Papers at Farfetch (D. Maria) +11h Chair(s): Maurício Aniche Delft University of Technology, Netherlands | ||
13:45 30mTalk | Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems Journal-First Papers Tao Ma Simula Research Laboratory, Shaukat Ali Simula Research Laboratory, Tao Yue Nanjing University of Aeronautics and Astronautics Link to publication DOI | ||
14:15 30mTalk | Empirical evaluation of mutation-based test case prioritization techniques Journal-First Papers Donghwan Shin University of Luxembourg, Shin Yoo Korea Advanced Institute of Science and Technology, Mike Papadakis University of Luxembourg, Luxembourg, Doo-Hwan Bae Korea Advanced Institute of Science and Technology Link to publication DOI | ||
14:45 30mTalk | Are Unit and Integration Test Definitions Still Valid for Modern Java Projects? An Empirical Study on Open-Source Projects Journal-First Papers Fabian Trautsch University of Göttingen, Steffen Herbold University of Göttingen, Jens Grabowski University of Göttingen Link to publication DOI | ||
13:45 - 15:15 | RT7 - Optimizing TestingResearch Papers at Infante +11h Chair(s): Fabiano Ferrari Federal University of São Carlos | ||
13:45 30mTalk | Optimizing Mutation Testing by Discovering Dynamic Mutant Subsumption Relations Research Papers Marcio Augusto Guimarães Federal University of Alagoas (UFAL), Leo Fernandes Federal Institute of Alagoas (IFAL), Márcio Ribeiro Federal University of Alagoas, Brazil, Marcelo d'Amorim Federal University of Pernambuco, Rohit Gheyi Federal University of Campina Grande Link to publication DOI | ||
14:15 30mTalk | Massively Parallel, Highly Efficient, but What About the Test Suite Quality? Applying Mutation Testing to GPU Programs Research Papers Link to publication DOI Pre-print | ||
14:45 30mTalk | STICCER: Fast and Effective Database Test Suite Reduction Through Merging of Similar Test Cases Research Papers Abdullah Alsharif The University of Sheffield, Gregory Kapfhammer Allegheny College, USA, Phil McMinn University of Sheffield Link to publication DOI | ||
15:30 - 17:00 | RT9 - Empirical Analysis and Program RepairResearch Papers at Farfetch (D. Maria) +11h Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center | ||
15:30 30mTalk | An Empirical Analysis of Blind Tests Research Papers Link to publication DOI | ||
16:00 30mTalk | A Family of Experiments to Assess the Impact of Page Object Pattern in Web Test Suite Development Research Papers Maurizio Leotta Università di Genova, Matteo Biagiola Fondazione Bruno Kessler (FBK), Filippo Ricca Università di Genova, Mariano Ceccato University of Verona, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
16:30 30mTalk | Human-In-The-Loop Automatic Program Repair Research Papers Marcel Böhme Monash University, Australia, Charaka Geethal Monash University, Van-Thuan Pham Monash University Link to publication DOI | ||
15:30 - 17:00 | RT8 - Misc 2Journal-First Papers / Research Papers at Infante +11h Chair(s): Alin Stefanescu University of Bucharest | ||
15:30 30mTalk | Implementation-induced Inconsistency and Nondeterminism in Deterministic Clustering Algorithms Research Papers Xin Yin New Jersey Institute of Technology, Iulian Neamtiu New Jersey Institute of Technology, USA, Saketan Patil New Jersey Institute of Technology, Sean Andrews New Jersey Institute of Technology Link to publication DOI | ||
16:00 30mTalk | CBR: Controlled Burst Recording Research Papers Oscar Cornejo University of Milano Bicocca, Italy, Daniela Briola University of Milano Bicocca, Daniela Micucci University of Milano Bicocca, Leonardo Mariani University of Milano Bicocca Link to publication DOI | ||
16:30 30mTalk | Mahtab: Phase-wise acceleration of regression testing for C Journal-First Papers Link to publication DOI Media Attached | ||
20:00 - 20:30 | Most Influential Paper AwardsResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): Rui Abreu Faculty of Engineering, University of Porto, Portugal, João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC | ||
20:00 15mAwards | Using Mutation to Automatically Suggest Fixes for Faulty Programs Research Papers Media Attached | ||
20:15 15mAwards | Searching for a needle in a haystack predicting security vulnerabilities for Windows Vista Research Papers Thomas Zimmermann Microsoft Research, Nachiappan Nagappan Microsoft Research, USA, Laurie Williams North Carolina State University Media Attached | ||
21:45 - 23:15 | RT6 - Web TestingResearch Papers at Infante Chair(s): Fabiano Ferrari Federal University of São Carlos | ||
21:45 30mTalk | Fostering the Diversity of Exploratory Testing in Web Applications Research Papers Julien Leveau LaBRI, Xavier Blanc LaBRI, Laurent Réveillère LaBRI, Jean-Rémy Falleri Bordeaux INP, Romain Rouvoy Univ. Lille / Inria / IUF Link to publication DOI | ||
22:15 30mTalk | Dependency-Aware Web Test Generation Research Papers Matteo Biagiola Fondazione Bruno Kessler (FBK), Andrea Stocco Università della Svizzera italiana (USI), Filippo Ricca Università di Genova, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
22:45 30mTalk | Metamorphic Security Testing for Web Systems Research Papers Phu X. Mai University of Luxembourg, Fabrizio Pastore University of Luxembourg, Arda Goknil SnT, University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI | ||
Tue 27 OctDisplayed time zone: Lisbon change
Tue 27 Oct
Displayed time zone: Lisbon change
00:45 - 02:15 | Journal First 1Journal-First Papers at Farfetch (D. Maria) Chair(s): Fabiano Ferrari Federal University of São Carlos | ||
00:45 30mTalk | Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems Journal-First Papers Tao Ma Simula Research Laboratory, Shaukat Ali Simula Research Laboratory, Tao Yue Nanjing University of Aeronautics and Astronautics Link to publication DOI | ||
01:15 30mTalk | Empirical evaluation of mutation-based test case prioritization techniques Journal-First Papers Donghwan Shin University of Luxembourg, Shin Yoo Korea Advanced Institute of Science and Technology, Mike Papadakis University of Luxembourg, Luxembourg, Doo-Hwan Bae Korea Advanced Institute of Science and Technology Link to publication DOI | ||
01:45 30mTalk | Are Unit and Integration Test Definitions Still Valid for Modern Java Projects? An Empirical Study on Open-Source Projects Journal-First Papers Fabian Trautsch University of Göttingen, Steffen Herbold University of Göttingen, Jens Grabowski University of Göttingen Link to publication DOI | ||
02:30 - 04:00 | RT9 - Empirical Analysis and Program RepairResearch Papers at Farfetch (D. Maria) Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center | ||
02:30 30mTalk | An Empirical Analysis of Blind Tests Research Papers Link to publication DOI | ||
03:00 30mTalk | A Family of Experiments to Assess the Impact of Page Object Pattern in Web Test Suite Development Research Papers Maurizio Leotta Università di Genova, Matteo Biagiola Fondazione Bruno Kessler (FBK), Filippo Ricca Università di Genova, Mariano Ceccato University of Verona, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
03:30 30mTalk | Human-In-The-Loop Automatic Program Repair Research Papers Marcel Böhme Monash University, Australia, Charaka Geethal Monash University, Van-Thuan Pham Monash University Link to publication DOI | ||
02:30 - 04:00 | |||
02:30 30mTalk | Implementation-induced Inconsistency and Nondeterminism in Deterministic Clustering Algorithms Research Papers Xin Yin New Jersey Institute of Technology, Iulian Neamtiu New Jersey Institute of Technology, USA, Saketan Patil New Jersey Institute of Technology, Sean Andrews New Jersey Institute of Technology Link to publication DOI | ||
03:00 30mTalk | CBR: Controlled Burst Recording Research Papers Oscar Cornejo University of Milano Bicocca, Italy, Daniela Briola University of Milano Bicocca, Daniela Micucci University of Milano Bicocca, Leonardo Mariani University of Milano Bicocca Link to publication DOI | ||
03:30 30mTalk | Mahtab: Phase-wise acceleration of regression testing for C Journal-First Papers Link to publication DOI Media Attached | ||
09:00 - 10:00 | RT10 - Misc 3Research Papers at Infante +11h Chair(s): Thomas Durieux KTH Royal Institute of Technology, Sweden | ||
09:00 30mTalk | A Framework for In-Vivo Testing of Mobile Applications Research Papers Mariano Ceccato University of Verona, Davide Corradini Fondazione Bruno Kessler, Luca Gazzola Università degli Studi di Milano-Bicocca, Fitsum Kifetew Fondazione Bruno Kessler, Leonardo Mariani University of Milano Bicocca, Matteo Orru University of Milano Bicocca, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
09:30 30mTalk | Prioritizing Runtime Verification Violations Research Papers Breno Miranda Federal University of Pernambuco, Igor Lima Federal University of Pernambuco, Owolabi Legunsen Cornell University, Marcelo d'Amorim Federal University of Pernambuco Link to publication DOI | ||
11:15 - 12:15 | Open Steering Commitee & ICST 2021 PresentationResearch Papers at Plenary Room Chair(s): Shin Yoo Korea Advanced Institute of Science and Technology | ||
11:15 60mMeeting | Open Steering Commitee & ICST 2021 Presentation Research Papers | ||
13:45 - 14:45 | Keynote 3Research Papers at Plenary Room Chair(s): Rui Abreu Faculty of Engineering, University of Porto, Portugal | ||
13:45 60mKeynote | SunDew: Systematic Automated Security Testing Research Papers Franjo Ivancic Google | ||
20:00 - 21:00 | |||
20:00 30mTalk | A Framework for In-Vivo Testing of Mobile Applications Research Papers Mariano Ceccato University of Verona, Davide Corradini Fondazione Bruno Kessler, Luca Gazzola Università degli Studi di Milano-Bicocca, Fitsum Kifetew Fondazione Bruno Kessler, Leonardo Mariani University of Milano Bicocca, Matteo Orru University of Milano Bicocca, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
20:30 30mTalk | Prioritizing Runtime Verification Violations Research Papers Breno Miranda Federal University of Pernambuco, Igor Lima Federal University of Pernambuco, Owolabi Legunsen Cornell University, Marcelo d'Amorim Federal University of Pernambuco Link to publication DOI | ||
Accepted Papers
Call for Journal-First Presentations
ICST is inviting journal-first presentations for papers published recently in prestigious software engineering journals in all areas of software testing, verification, and validation. This will both enrich the ICST program as well as offer the authors an opportunity to speak to the community.
Scope
We invite applications for journal papers published in:
- Software Testing, Verification, and Reliability (STVR)
- Journal of Systems and Software (JSS)
- Information and Software Technology (IST)
- Software Quality Journal (SQJ)
Other journals may be considered on a case-by-case basis.
A journal-first presentation submitted to ICST 2020 must adhere to the following criteria:
- The paper was accepted for publication (i.e., the date of the acceptance notification) no earlier than October 1st 2018 and no later than October 1st 2019.
- The paper is in the scope of the conference, as defined in the call for ICST 2020 research papers.
- The paper reports completely new research results or presents novel contributions that were not previously reported in prior published work.
- The paper has not been presented and is not under consideration for journal-first programs of other conferences.
Submission of Proposals
Authors of manuscripts that respect these criteria are invited to fill out this application form, including the paper title, authors, an extended abstract, a statement that attests the nature of journal-first paper, and a pointer to the original journal paper.
Evaluation and Selection
Authors will be invited to present their paper at ICST 2020 after a check that the paper is in scope for the conference and it adheres to the criteria above. The papers will not be reviewed again for technical content.
In case an exceptionally high number of proposals is received, presentation proposals will be prioritized according to their fit to the conference theme and structure of sessions. If there is further need to select from papers with the same priority, then they will be selected based on a lottery.
Publication
The journal-first manuscripts are published through the journals and will not be part of the ICST proceedings. The journal-first papers will be listed in the conference program and the proceeding will only contain the abstract and a pointer to the journal publication.
Presentation
If a submission is accepted for the journal-first program, at least one author of the associated journal paper must register and attend the conference to present the paper.
The journal-first manuscripts are published through the journals and will not be part of the ICST proceedings. The journal-first papers will be listed in the conference program.
At least one author of each presentation accepted for the journal-first program must register and attend the conference to present the paper.
Important Dates
Submission deadline: January 10, 2020
Notification: January 28, 2020
Submissions close at 23.59 AoE (Anywhere on Earth, UTC-12)
Journal-First Co-Chairs
Gordon Fraser, University of Passau
Maurício Aniche, Delft University of Technology
Important Dates AoE (UTC-12h)
| Tue 28 Jan 2020 Author notification |
| Fri 10 Jan 2020 Submission deadline |
Submission Link
