Filter Program
Dates
Rooms
Tracks
Badges
Your Program
Sun 16 AprDisplayed time zone: Dublin change
Sun 16 Apr
Displayed time zone: Dublin change
08:45 - 10:30 | |||
08:45 15mDay opening | Welcome and introductions Doctoral Symposium | ||
09:00 30mKeynote | Keynote: How to Give a Great Presentation Doctoral Symposium Tanja E. J. Vos Universitat Politècnica de València and Open Universiteit | ||
09:30 30mTalk | On The Efficiency Of Combination Of Program Slicing and Spectrum-Based Fault Localization Doctoral Symposium Péter Attila Soha Department of Software Engineering, University of Szeged | ||
10:00 30mTalk | Fully Automated Game Testing via Neuroevolution Doctoral Symposium Patric Feldmeier University of Passau |
08:50 - 10:30 | |||
08:50 10mDay opening | Opening Remarks for IWCT IWCT | ||
09:00 60mKeynote | Combinatorial Testing: From Theory to Practice IWCT Rachel Tzoref-Brill IBM Research | ||
10:00 30mTalk | Applying CT-FLA for AEB Function Testing: A Virtual Driving Case Study IWCT Ludwig Kampel MATRIS Research Group, SBA Research, Michael Wagner SBA Research, Dimitris Simos SBA Research, Mihai Nica AVL List GmbH Graz, Austria, Dino Dodig AVL List GmbH Maribor, Slovenia, David Kaufmann AVL List GmbH Graz, Austria, Franz Wotawa Graz University of Technology |
09:00 - 10:30 | |||
09:30 5mDay opening | Mutation Opening Mutation | ||
09:35 55mKeynote | Keynote: Mutation Testing of Deep Learning Systems: from Real Faults Investigation to Practical Applications Mutation Gunel Jahangirova King's College London |
09:00 - 10:30 | |||
09:30 60mKeynote | Teaching Software Testing for Fun TestEd |
09:00 - 10:30 | |||
09:00 5mTalk | ITEQS Opening ITEQS | ||
09:05 55mKeynote | Keynote: Learning-based Testing of Robustness and Time ITEQS | ||
10:00 30mTalk | Automated and Systematic Digital Twins Testing for Industrial Processes ITEQS Yunpeng Ma Karlstads Universitet, Khalil Younis Karlstads Universitet, Bestoun S. Ahmed Karlstad University, Andreas Kassler Karlstad University, Pavel Krakhmalev Karlstad University, Andreas Thore RISE Research Institutes of Sweden, Hans Lindback Bharat Forge Kilsta AB Pre-print |
11:00 - 12:30 | |||
11:00 30mTalk | Challenging Autonomy with Combinatorial Testing IWCT | ||
11:30 30mTalk | Metric Learning Improves the Ability of Combinatorial Coverage Metrics to Anticipate Classification Error IWCT | ||
12:00 30mTalk | Synthetic Data Generation Using Combinatorial Testing and Variational Autoencoder IWCT Krishna Khadka The University of Texas at Arlington, Jaganmohan Chandrasekaran Virginia Tech, Jeff Yu Lei University of Texas at Arlington, Raghu Kacker National Institute of Standards and Technology, Richard Kuhn National Institute of Standards and Technology |
11:00 - 12:30 | |||
11:00 30mTalk | Mining Attributed Input Grammars and their Applications in Fuzzing Doctoral Symposium Andreas Pointner University of Applied Sciences Upper Austria, Hagenberg, Austria | ||
11:30 30mTalk | Towards Context-Aware Spectrum-Based Fault Localization Doctoral Symposium Attila Szatmári Szegedi Tudományegyetem | ||
12:00 30mTalk | Automatic Benchmark Generation for Object Constraint Language Doctoral Symposium Ankit Jha Maynooth University |
11:00 - 12:30 | |||
11:00 30mTalk | Analysis of mutation operators for FSM testing Mutation | ||
11:30 30mTalk | A Tool for Mutation Analysis in Racket Mutation Bambi Zhuang Northeastern University, James Perretta Northeastern University, Arjun Guha Northeastern University and Roblox Research, Jonathan Bell Northeastern University | ||
12:00 30mTalk | The Inversive Relationship Between Bugs and Patches: An Empirical Study Mutation Pre-print |
11:00 - 12:30 | |||
11:00 20mTalk | Gamekins: Gamifying a Software Testing Course with Continuous Integration TestEd | ||
11:20 20mPaper | ISTQB-based Software Testing Education: Advantages and Challenges TestEd A: Attila Szatmári Szegedi Tudományegyetem, A: Tamás Gergely Department of Software Engineering, University of Szeged, A: Árpád Beszédes Department of Software Engineering, University of Szeged | ||
11:40 20mPaper | On the Current State of Academic Software Testing Education in Sweden TestEd A: Ayodele Barrett Mälardalen University, A: Eduard Paul Enoiu Mälardalen University, A: Wasif Afzal Mälardalen University Pre-print |
11:00 - 12:30 | |||
11:00 30mTalk | Preliminary results in using attention for increasing attack identification efficiency ITEQS Tanwir Ahmad Åbo Akademi University, Dragos Truscan Åbo Akademi University, Jüri Vain Tallinn University of Technology, Estonia | ||
11:30 30mTalk | Lightweight Method for On-the-fly Detection of Multivariable Atomicity Violations (Best Paper) ITEQS Changhui Bae Gyeongsang National University, Euteum Choi Gyeongsang National Unviersity, Yong-Kee Jun Gyeongsang National University, Ok-Kyoon Ha Kyungwoon University | ||
12:00 30mTalk | Using Assurance Cases to assure the fulfillment of non-functional requirements of AI-based systems - Lessons learned ITEQS Marc Hauer TU Kaiserslautern - Algorithm Accountability Lab , Lena Müller-Kress winnovation consulting gmbh, Gertraud Leimüller winnovation consulting gmbh & leiwand.ai gmbh, Katharina Zweig TU Kaiserslautern - Algorithm Accountability Lab |
14:00 - 15:30 | |||
14:00 30mTalk | Incremental generation of combinatorial test suites starting from existing seed tests IWCT | ||
14:30 30mTalk | Meta-Heuristic Algorithm for Constructing Higher-Index Covering Arrays for Combinatorial Interaction Testing IWCT | ||
15:00 30mTalk | Ordered t-way Combinations for Testing State-based Systems IWCT Rick Kuhn National Institute of Standards and Technology, M S Raunak National Institute of Standards and Technology, Raghu Kacker National Institute of Standards and Technology |
14:00 - 15:30 | |||
14:00 30mTalk | Mutation Testing in Continuous Integration: An Exploratory Industrial Case Study Mutation Jonatan Örgård Chalmers | University of Gothenburg, Gregory Gay Chalmers | University of Gothenburg, Francisco Gomes de Oliveira Neto Chalmers University of Technology, Sweden / University of Gothenburg, Sweden, Kim Viggedal Zenseact | ||
14:30 30mTalk | Validation of Mutation Testing in the Safety Critical Industry through a Pilot Study Mutation Sten Vercammen University of Antwerp, Belgium, Markus Borg CodeScene, Serge Demeyer University of Antwerp; Flanders Make | ||
15:00 30mAwards | Best paper award and closing Mutation |
14:00 - 15:30 | |||
14:00 20mPaper | An Empirical Evaluation of Regular and Extreme Mutation Testing for Teaching Software Testing TestEd A: Martin Balfroid , A: Pierre Luycx University of Namur, A: Benoît Vanderose University of Namur, A: Xavier Devroey University of Namur Pre-print | ||
14:20 20mPaper | Teaching Test-Driven Development and Object-Oriented Design by Example TestEd | ||
14:40 20mPaper | Process Oriented Guided Inquiry-based learning -like pedagogy (POGIL-like) in Online Software Testing and DevOps – A Replication Study TestEd A: Bhuvaneswari Gopal University of Nebraska-Lincoln, A: Steve Cooper University of Nebraska, Lincoln |
14:00 - 15:30 | |||
14:00 30mTalk | Bottleneck Analysis via Grammar-based Performance Fuzzing ITEQS | ||
14:30 30mTalk | Test Generation and Mutation Analysis of Energy Consumption using UPPAAL SMC and MATS ITEQS | ||
15:00 10mTalk | Best paper award and closing ITEQS |
16:00 - 17:30 | |||
16:00 10mPaper | Intracompany Training in Software Testing: Experience Report TestEd A: Iosif Itkin Exactpro Systems, A: Natia Sirbiladze Exactpro Systems, A: Elena Treshcheva Exactpro Systems, A: Rostislav Yavorskiy Exactpro Systems | ||
16:10 10mPaper | Code Critters: A Block-Based Testing Game TestEd A: Philipp Straubinger University of Passau, A: Laura Caspari University of Passau, A: Gordon Fraser University of Passau Pre-print | ||
16:20 20mPaper | ChatGPT and Software Testing Education: Promises & Perils TestEd A: Sajed Jalil George Mason University, A: Suzzana Rafi , A: Thomas LaToza George Mason University, A: Kevin Moran George Mason University, A: Wing Lam George Mason University Pre-print | ||
16:40 50mPanel | Panel Discussion on ChatGPT TestEd |
17:30 - 19:00 | ReceptionSocial | ||
17:45 - 18:30 | Steering Committee Meeting IWCTIWCT at Grand canal Open invitation to all participants of IWCT to join this session. | ||
17:45 45mMeeting | Steering Committee Meeting IWCT (1745 -- 1845) IWCT |
Mon 17 AprDisplayed time zone: Dublin change
Mon 17 Apr
Displayed time zone: Dublin change
09:00 - 10:30 | Keynote I - Jeff OffuttKeynotes at Grand canal Chair(s): Mike Papadakis University of Luxembourg, Luxembourg | ||
09:00 90mKeynote | Test Automation: From slow & weak to fast, flaky, & blind to smart & effective Keynotes |
11:00 - 12:30 | Session 1: Automated Testing Journal-First Papers / Research Papers / Previous Editions / Testing Tools / Tool Demo at Grand canal Chair(s): Gilles Perrouin Fonds de la Recherche Scientifique - FNRS & University of Namur | ||
11:00 20mTalk | JUGE: An infrastructure for benchmarking Java unit test generators Journal-First Papers Xavier Devroey University of Namur, Alessio Gambi IMC University of Applied Sciences Krems, Juan Pablo Galeotti University of Buenos Aires, René Just University of Washington, Fitsum Kifetew Fondazione Bruno Kessler, Annibale Panichella Delft University of Technology, Sebastiano Panichella Zurich University of Applied Sciences DOI Authorizer link Pre-print | ||
11:20 20mTalk | Metamorphic Testing with Causal Graphs Research Papers Andrew Graham Clark University of Sheffield, Michael Foster University of Sheffield, Neil Walkinshaw University of Sheffield, Robert Hierons University of Sheffield | ||
11:40 20mTalk | QEX: Automated Testing Observability and QA Developer Experience Framework Testing Tools | ||
12:00 10mTalk | ASDF - A Differential Testing Framework for Automatic Speech Recognition Systems Tool Demo Daniel Hao Xian Yuen School of Information Technology, Monash University Malaysia, Andrew Yong Chen Pang School of Information Technology, Monash University Malaysia, Zhou Yang Singapore Management University, Chun Yong Chong Monash University Malaysia, Mei Kuan Lim Monash University Malaysia, David Lo Singapore Management University | ||
12:10 20mTalk | A Framework for Automated API Fuzzing at Enterprise Scale Previous Editions Riyadh Mahmood The Aerospace Corporation, Jay Pennington The Aerospace Corporation, Danny Tsang The Aerospace Corporation, Tan Tran The Aerospace Corporation, Andrea Bogle The Aerospace Corporation DOI |
11:00 - 12:30 | Session 2: Autonomous & Cyberphysical Systems IResearch Papers / Journal-First Papers at Pearse suite Chair(s): Shaukat Ali Simula Research Laboratory | ||
11:00 20mTalk | A Robustness-Based Confidence Measure for Hybrid System Falsification Journal-First Papers Toru Takisaka University of Electronic Science and Technology of China, Zhenya Zhang Kyushu University, Paolo Arcaini National Institute of Informatics
, Ichiro Hasuo National Institute of Informatics, Japan Link to publication DOI | ||
11:20 20mTalk | A Coverage-Driven Systematic Test Approach for Simultaneous Localization and Mapping Research Papers | ||
11:40 20mTalk | Property-Based Mutation Testing Research Papers Ezio Bartocci Technische Universität Wien, Leonardo Mariani University of Milano-Bicocca, Dejan Nickovic Austrian Institute of Technology, Drishti Yadav Technische Universität Wien | ||
12:00 20mTalk | Constraint-Guided Automatic Side Object Placement for Steering Control Testing in Virtual Environment Research Papers Baekgyu Kim DGIST |
14:00 - 15:30 | Session 3: Autonomous & Cyberphysical Systems IIPrevious Editions / Industry / Research Papers at Grand canal Chair(s): Fabrizio Pastore University of Luxembourg | ||
14:00 20mTalk | Test Maintenance for Machine Learning Systems: A Case Study in the Automotive Industry Industry Lukas Berglund Chalmers | University of Gothenburg, Tim Grube Chalmers | University of Gothenburg, Gregory Gay Chalmers | University of Gothenburg, Francisco Gomes de Oliveira Neto Chalmers University of Technology, Sweden / University of Gothenburg, Sweden, Dimitrios Platis Zenseact | ||
14:20 20mTalk | Digital Twin-based Anomaly Detection in Cyber-physical Systems Previous Editions DOI | ||
14:40 20mTalk | Quality Metrics and Oracles for Autonomous Vehicles Testing Previous Editions Gunel Jahangirova USI Lugano, Switzerland, Andrea Stocco Technical University of Munich & fortiss, Paolo Tonella USI Lugano DOI | ||
15:00 20mTalk | Simulation-based Test Case Generation for Unmanned Aerial Vehicles in the Neighborhood of Real Flights Research Papers Sajad Khatiri USI-Lugnao & Zurich University of Applied Sciences, Sebastiano Panichella Zurich University of Applied Sciences, Paolo Tonella USI Lugano Pre-print |
14:00 - 15:30 | Session 4: Fault Localization & DebuggingResearch Papers / Tool Demo / Industry / Journal-First Papers at Pearse suite Chair(s): Shin Yoo KAIST | ||
14:00 20mTalk | Flake Aware Culprit Finding Industry Tim A. D. Henderson Google LLC, Bobby Dorward Google, Eric Nickell Google, Collin Johnson Google, Avi Kondareddy Google LLC Pre-print | ||
14:20 20mTalk | An Empirical Characterization of Software Bugs in Open-Source Cyber-Physical Systems Journal-First Papers Fiorella Zampetti University of Sannio, Italy, Ritu Kapur University of Sannio, Massimiliano Di Penta University of Sannio, Italy, Sebastiano Panichella Zurich University of Applied Sciences | ||
14:40 20mTalk | A Case Against Coverage-Based Program Spectra Research Papers Péter Attila Soha Department of Software Engineering, University of Szeged, Tamás Gergely Department of Software Engineering, University of Szeged, Ferenc Horv�th University of Szeged, Department of Software Engineering, Béla Vancsics Department of Software Engineering, University of Szeged, Árpád Beszédes Department of Software Engineering, University of Szeged | ||
15:00 10mTalk | SFLaaS: Software Fault Localization as a Service Tool Demo Qusay Idrees Sarhan Department of Software Engineering, University of Szeged, Hassan Bapeer Hassan University of Duhok, Árpád Beszédes Department of Software Engineering, University of Szeged |
16:00 - 18:00 | Session 5: Testing AI/ML systemsResearch Papers / Previous Editions at Grand canal Chair(s): Jie M. Zhang King's College London | ||
16:00 20mTalk | Robustness assessment and improvement of a neural network for blood oxygen pressure estimation Previous Editions Paolo Arcaini National Institute of Informatics
, Andrea Bombarda University of Bergamo, Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo, Daniele Gamba AISent S.r.l., Rita Pedercini AISent S.r.l. DOI | ||
16:20 20mTalk | An Empirical Evaluation of Mutation Operators for Deep Learning Systems Previous Editions DOI | ||
16:40 20mTalk | Distributed Repair of Deep Neural Networks Research Papers Davide Li Calsi Politecnico di Milano, Matias Duran National Institute of Informatics, Xiao-Yi Zhang School of Computer and Communication Engineering, University of Science and Technology Beijing, Paolo Arcaini National Institute of Informatics
, Fuyuki Ishikawa National Institute of Informatics | ||
17:00 20mTalk | Mutation Testing of Deep Reinforcement Learning Based on Real Faults Research Papers Florian Tambon Polytechnique Montréal, Vahid Majdinasab Polytechnique Montréal, Amin Nikanjam École Polytechnique de Montréal, Foutse Khomh Polytechnique Montréal, Giuliano Antoniol Polytechnique Montréal Pre-print | ||
17:20 20mTalk | Repairing DNN Architecture: Are We There Yet? Research Papers Jinhan Kim KAIST, Nargiz Humbatova USI Lugano, Gunel Jahangirova King's College London, Paolo Tonella USI Lugano, Shin Yoo KAIST Pre-print |
16:00 - 18:00 | Session 7: Testing for Safery & Security Industry / Research Papers / Journal-First Papers / Previous Editions at Hanover Chair(s): Eric Bodden Heinz Nixdorf Institut, Paderborn University and Fraunhofer IEM | ||
16:00 20mTalk | Learning Non-robustness using Simulation-based Testing: a Network Traffic-shaping Case Study Industry Baharin Aliashrafi Jodat University of Ottawa, Shiva Nejati University of Ottawa, Mehrdad Sabetzadeh University of Ottawa, Patricio Saavedra RabbitRun Technologies Inc Pre-print | ||
16:20 20mTalk | Test environments for large-scale software systems – an industrial study of intrinsic and extrinsic success factors Journal-First Papers | ||
16:40 20mTalk | Assessing the Effectiveness of Input and Output Coverage Criteria for Testing Quantum Programs Previous Editions Shaukat Ali Simula Research Laboratory, Paolo Arcaini National Institute of Informatics
, Xinyi Wang , Tao Yue Simula Research Laboratory DOI | ||
17:00 20mTalk | Heap Fuzzing: Automatic Garbage Collection Testing with Directed Random Events Research Papers Guillermo Polito Inria, Cristal, UMR 9189, Université de Lille, Pablo Tesone Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 CRIStAL, Pharo Consortium, Jean Privat Université du Québec à Montréal (UQAM), Nahuel Palumbo Université Lille, CNRS, Centrale Lille, Inria, UMR 9189 - CRIStAL, Stéphane Ducasse Inria; University of Lille; CNRS; Centrale Lille; CRIStAL | ||
17:20 20mTalk | MagicMirror: Towards High-Coverage Fuzzing of Smart Contracts Research Papers Huadong Feng University of Texas at Arlington, Xiaolei Ren University of Texas at Arlington, Qiping Wei University of Texas at Arlington, Jeff Yu Lei University of Texas at Arlington, Raghu Kacker National Institute of Standards and Technology, Richard Kuhn National Institute of Standards and Technology, Dimitris Simos SBA Research |
16:00 - 18:00 | Session 6: GUI/API testingTesting Tools / Previous Editions / Research Papers / Posters at Pearse suite Chair(s): Phil McMinn University of Sheffield | ||
16:00 20mTalk | Repairing Fragile GUI Test Cases Using Word and Layout Embedding Previous Editions Juyeon Yoon Korea Advanced Institute of Science and Technology, Seungjun Chung , Kihyuck Shin Samsung Electronics, Jinhan Kim KAIST, Shin Hong Handong Global University, Shin Yoo KAIST DOI | ||
16:20 20mTalk | RIDA: Cross-App Record and Replay for Android Research Papers Jiayuan Liang Southern University of Science and Technology, Sinan Wang Southern University of Science and Technology, Xiangbo Deng Southern University of Science and Technology, Yepang Liu Southern University of Science and Technology | ||
16:40 20mTalk | EMB: A Curated Corpus of Web/Enterprise Applications And Library Support for Software Testing Research Testing Tools Andrea Arcuri Kristiania University College and Oslo Metropolitan University, Man Zhang Kristiania University College, Norway, Amid Golmohammadi Kristiania University College, Asma Belhadi Kristiania University College, Juan Pablo Galeotti University of Buenos Aires, Bogdan Marculescu Kristiania University College, Norway, Susruthan Seran Kristiania University College | ||
17:00 20mTalk | LatteArt: A Platform for Recording and Analyzing Exploratory Testing Testing Tools | ||
17:20 20mTalk | POWER: Program Option-Aware Fuzzer for High Bug Detection Ability Previous Editions DOI | ||
17:40 5mTalk | Poster: Link between Bias, Node Sensitivity and Long-Tail Distribution in trained DNNs Posters |
19:00 - 21:00 | ReceptionSocial | ||
Tue 18 AprDisplayed time zone: Dublin change
Tue 18 Apr
Displayed time zone: Dublin change
09:00 - 10:30 | Keynote II - Mark Harman and Nadia AlshahwanKeynotes at Grand canal Chair(s): Sreedevi Sampath University of Maryland Baltimore County | ||
09:00 90mKeynote | Software Testing Research Challenges: An Industrial Perspective Keynotes |
11:00 - 12:30 | Session 8: Mutation TestingJournal-First Papers / Research Papers at Grand canal Chair(s): Renzo Degiovanni SnT, University of Luxembourg | ||
11:00 20mTalk | Mutation testing of PL/SQL programs Journal-First Papers | ||
11:20 20mTalk | How Closely are Common Mutation Operators Coupled to Real Faults? Research Papers | ||
11:40 20mTalk | Batching Non-Conflicting Mutations for Efficient, Safe, Parallel Mutation Analysis in Rust Research Papers | ||
12:00 20mTalk | MUTAGEN: Reliable Coverage-Guided, Property-Based Testing using Exhaustive Mutations Research Papers Agustín Mista Chalmers University of Technology, Alejandro Russo Chalmers University of Technology, Sweden |
14:00 - 15:30 | Session 10: Program RepairResearch Papers / Previous Editions / Posters at Grand canal Chair(s): Gunel Jahangirova USI Lugano, Switzerland | ||
14:00 20mTalk | Exploring True Test Overfitting in Dynamic Automated Program Repair using Formal Methods Previous Editions Amirfarhad Nilizadeh University of Central Florida, Gary T. Leavens University of Central Florida, Xuan Bach D. Le The University of Melbourne, Corina S. Păsăreanu Carnegie Mellon University, David Cok Safer Software Consulting, LLC DOI | ||
14:20 20mTalk | Embedding Context as Code Dependencies for Neural Program Repair Research Papers Noor Nashid University of British Columbia, Mifta Sintaha University of British Columbia, Ali Mesbah University of British Columbia (UBC) | ||
14:40 20mTalk | CorCA: An Automatic Program Repair Tool for Checking and Removing Effectively C Flaws Research Papers João Inácio LASIGE, Faculdade de Ciências da Universidade de Lisboa, Ibéria Medeiros LaSIGE, Faculdade de Ciências da Universidade de Lisboa | ||
15:00 20mTalk | Set the right example when teaching programming: Test Informed Learning with Examples (TILE) Research Papers Niels Doorn Open Universiteit and NHL Stenden University of Applied Sciences, Tanja E. J. Vos Universitat Politècnica de València and Open Universiteit, Beatriz Marín Universitat Politècnica de València, Erik Barendsen Open Universiteit | ||
15:20 5mTalk | Poster: Software Fault Localization as a Service (SFLaaS) Posters Qusay Idrees Sarhan Department of Software Engineering, University of Szeged, Hassan Bapeer Hassan University of Duhok, Árpád Beszédes Department of Software Engineering, University of Szeged | ||
15:25 5mTalk | Poster: Improving Spectrum Based Fault Localization For Python Programs Using Weighted Code Elements Posters Qusay Idrees Sarhan Department of Software Engineering, University of Szeged, Árpád Beszédes Department of Software Engineering, University of Szeged |
14:00 - 15:30 | Session 11: Test GenerationJournal-First Papers / Previous Editions / Research Papers / Tool Demo at Pearse suite Chair(s): Gregory Gay Chalmers | University of Gothenburg | ||
14:00 20mTalk | Automatic Creation of Acceptance Tests by Extracting Conditionals from Requirements: NLP Approach and Case Study Journal-First Papers Jannik Fischbach Netlight GmbH / fortiss GmbH, Julian Frattini Blekinge Institute of Technology, Andreas Vogelsang University of Cologne, Daniel Mendez Blekinge Institute of Technology, Michael Unterkalmsteiner Blekinge Institute of Technology, Andreas Wehrle Allianz Deutschland AG, Pablo Restrepo Henao Technical University of Munich, Parisa Yousefi Ericsson, Tedi Juricic Ericsson, Jeannette Radduenz Allianz Deutschland, Carsten Wiecher Kostal Automobil Elektrik GmbH & Co. KG | ||
14:20 20mTalk | Scaling Test Case Generation For Expressive Decision Tables Previous Editions Supriya Agrawal Tata Consultancy Services Ltd. (TCS), R. Venkatesh , Ulka Shrotri Tata Consultancy Services Ltd. (TCS), Amey Zare TCS Research, Sagar Verma Tata Consultancy Services Ltd. (TCS) DOI | ||
14:40 20mTalk | Spectacular: Finding Laws from 25 Trillion Programs Research Papers Matthías Páll Gissurarson Chalmers University of Technology, Sweden, Diego Roque Dark Forest Technologies, James Koppel Massachusetts Institute of Technology, USA | ||
15:00 20mTalk | Pairwise Testing Revisited for Structured Data With Constraints Research Papers | ||
15:20 10mTalk | RICK: Generating Mocks from Production Data Tool Demo Deepika Tiwari KTH Royal Institute of Technology, Martin Monperrus KTH Royal Institute of Technology, Benoit Baudry KTH |
16:00 - 17:30 | |||
16:00 45mTalk | CrowdOracles: Can the Crowd Solve the Oracle Problem? MIPs Fabrizio Pastore University of Luxembourg, Leonardo Mariani University of Milano-Bicocca, Gordon Fraser University of Passau DOI | ||
16:45 45mTalk | ACTS: A Combinatorial Test Generation Tool MIPs Linbin Yu , Yu Lei , Raghu Kacker National Institute of Standards and Technology, Richard Kuhn National Institute of Standards and Technology DOI |
17:30 - 18:00 | |||
17:30 30mMeeting | Open Steering Committee Meeting Keynotes |
Wed 19 AprDisplayed time zone: Dublin change
Wed 19 Apr
Displayed time zone: Dublin change
09:00 - 10:30 | Keynote III - Yves Le TraonKeynotes at Grand canal Chair(s): Anthony Ventresque Trinity College Dublin & Lero, Ireland | ||
09:00 90mKeynote | AI is a game-changing technology: how to test and robustify Machine-Learning software? Keynotes |
11:00 - 12:30 | Session 13: Testing with Static Analysis MethodsResearch Papers / Previous Editions at Pearse suite Chair(s): Paolo Arcaini National Institute of Informatics | ||
11:00 20mTalk | Address-Aware Query Caching for Symbolic Execution Previous Editions DOI | ||
11:20 20mTalk | Automating Differential Testing with Overapproximate Symbolic Execution Previous Editions DOI | ||
11:40 20mTalk | Two Sparsification Strategies for Accelerating Demand-Driven Pointer Analysis Research Papers Pre-print Media Attached | ||
12:00 20mTalk | Model Generation For Java Frameworks Research Papers Linghui Luo Amazon Web Services, Goran Piskachev Amazon Web Services, Ranjith Krishnamurthy Fraunhofer IEM, Julian Dolby IBM Research, Eric Bodden Heinz Nixdorf Institut, Paderborn University and Fraunhofer IEM, Martin Schäf Amazon Web Services |
14:00 - 15:40 | Session 14: Web TestingJournal-First Papers / Industry / Research Papers at Grand canal Chair(s): Thomas Laurent JSPS@National Institute of Informatics, Japan | ||
14:00 20mTalk | Challenges of End-to-End Testing with Selenium WebDriver and How to Face Them: A Survey Industry Maurizio Leotta DIBRIS, University of Genova, Italy, Boni Garcia Universidad Carlos III de Madrid, Filippo Ricca Università di Genova, Jim Whitehead University of California, Santa Cruz | ||
14:20 20mTalk | E2E-Loader: A Framework to Support Performance Testing of Web Applications Industry Ermanno Battista Fervento srl, Sergio Di Martino Università degli Studi di Napoli Federico II, Sergio Di Meglio Department of Electrical Engineering and Information Technology Università degli Studi di Napoli Federico II, Fabio Scippacercola Fervento srl, Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II | ||
14:40 20mTalk | Automated Web Application Testing driven by Pre-recorded Test Cases Journal-First Papers | ||
15:00 20mTalk | Robust web element identification for evolving applications by considering visual overlaps Research Papers Michel Nass Blekinge Institute of Technology, Riccardo Coppola Politecnico di Torino, Emil Alégroth Blekinge Institute of Technology, Robert Feldt Chalmers University of Technology, Sweden | ||
15:20 20mTalk | Automating Endurance Test for Flash-based Storage Devices in Samsung Electronics Industry Jinkook Kim Samsung Electronics Co., Minseok Jeon Korea University, Sejeong Jang Samsung Electronics Co., Hakjoo Oh Korea University |
14:00 - 15:40 | Session 15: Flaky TestsPrevious Editions / Research Papers at Pearse suite Chair(s): John Micco VMware | ||
14:00 20mTalk | Evaluating Features for Machine Learning Detection of Order- and Non-Order-Dependent Flaky Tests Previous Editions Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, Phil McMinn University of Sheffield DOI | ||
14:20 20mTalk | An Empirical Study of Flaky Tests in Python Previous Editions Martin Gruber BMW Group, University of Passau, Stephan Lukasczyk University of Passau, Florian Kroiß , Gordon Fraser University of Passau DOI | ||
14:40 20mTalk | A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It Previous Editions DOI | ||
15:00 20mTalk | Practical Flaky Test Prediction using Common Code Evolution and Test History Data Research Papers Martin Gruber BMW Group, University of Passau, Michael Heine BMW Group; Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Programming Systems Group, Norbert Oster Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Programming Systems Group, Michael Philippsen Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Programming Systems Group, Gordon Fraser University of Passau Pre-print | ||
15:20 20mTalk | A Qualitative Study on the Sources, Impacts, and Mitigation Strategies of Flaky Tests Previous Editions Sarra Habchi Ubisoft, Guillaume Haben University of Luxembourg, Mike Papadakis University of Luxembourg, Luxembourg, Maxime Cordy University of Luxembourg, Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg DOI |
Thu 20 AprDisplayed time zone: Dublin change
Thu 20 Apr
Displayed time zone: Dublin change
09:00 - 10:30 | |||
09:00 15mDay opening | Welcome by the General Chair NEXTA Sahar Tahvili Ericsson AB | ||
09:15 45mKeynote | What's Next After AI-driven Conversational Test Automation? NEXTA Robert Feldt Chalmers | University of Gothenburg, Blekinge Institute of Technology | ||
10:00 30mResearch paper | Test Cost Reduction for 5G and Beyond using Machine Learning NEXTA maryam havakeshian , Yvan Labiche , Shiva Nejati University of Ottawa, Stéphane Desjardins , Kourosh Haghighi |
09:00 - 10:30 | Opening and Research Papers 1AIST at Grand canal 3 Chair(s): Gregory Gay Chalmers | University of Gothenburg | ||
09:00 30mTalk | Generating concrete test cases from vehicle data using models obtained from clustering AIST Nour Chetouane Institute for Software Technology, Graz University of Technology, Franz Wotawa Graz University of Technology | ||
09:30 30mTalk | Towards Explainable Test Case Prioritisation with Learning-to-Rank Models AIST Aurora Ramírez University of Córdoba, Mario Berrios University of Córdoba, José Raúl Romero University of Cordoba, Spain, Robert Feldt Chalmers University of Technology, Sweden | ||
10:00 30mTalk | Automating GUI-based Software Testing with GPT-3 AIST Daniel Zimmermann FZI Research Center for Information Technology, Anne Koziolek KASTEL - Institute of Information Security and Dependability |
09:00 - 10:30 | |||
09:00 10mDay opening | Welcome and Opening Message InSTA 2023 InSTA Yasuharu Nishi University of Electro-Communications, Tokyo | ||
09:10 30mTalk | Software Test Architecture and UTP Test Architecture InSTA Jon D. Hagar Grand Software Testing, LLC, Hot Sulphur Springs, CO, Marc-Florian Wendland Fraunhofer Fokus | ||
09:40 30mTalk | Semantic-based and Learning-based Regression Test Selection focusing on Test Objectives InSTA Junji Suzuki , Yasuharu Nishi University of Electro-Communications, Tokyo, Shoma Tanaka , Kimihiko Naruse , Minako Shimoji , Zhen Zhong | ||
10:10 20mOther | Information exchange in InSTA InSTA |
09:00 - 10:30 | |||
09:00 15mDay opening | Welcome and Opening Message A-MOST 23 A-MOST Florian Lorber Aalborg University, Cristina Seceleanu Mälardalen University, Uraz Cengiz Türker Lancaster University (UK) | ||
09:15 75mKeynote | Keynote: Principles of Model-Based Testing A-MOST Jan Tretmans Radboud University Nijmegen, TNO-ESI |
09:00 - 10:30 | |||
09:00 30mTalk | Welcome to CCIW CCIW | ||
09:30 30mTalk | Release Agility through Continuous Quality across Partner Companies CCIW | ||
10:00 30mTalk | Optimal resource allocation for tasks in Continuous Integration Systems CCIW Link to publication |
09:00 - 10:30 | |||
09:00 15mDay opening | Welcome and Opening Message INTUITESTBEDS Riccardo Coppola Politecnico di Torino, Andreas Bauer Blekinge Institute of Technology, SERL Sweden, Michel Nass Blekinge Institute of Technology | ||
09:15 45mKeynote | I. S. W. B. Prasetya - Ready Agent One: Automatically Play Testing Computer Games INTUITESTBEDS Wishnu Prasetya Utrecht University | ||
10:00 30mPaper | Open Benchmark Testbed to Evaluate Effectiveness of Path-based Tests INTUITESTBEDS Matej Klima , Miroslav Bures Czech Technical University, Czechia, Michaela Kubisova , Pavel Herout University of West Bohemia, Pilsen, CZ |
11:00 - 12:30 | |||
11:00 30mResearch paper | Systematically Generated Formulas for Spectrum-Based Fault Localization NEXTA Qusay Idrees Sarhan Department of Software Engineering, University of Szeged, Tamás Gergely Department of Software Engineering, University of Szeged, Árpád Beszédes Department of Software Engineering, University of Szeged | ||
11:30 30mResearch paper | An Intelligent Monitoring Algorithm to Detect Dependencies between Test Cases in the Manual Integration Process NEXTA | ||
12:00 30mResearch paper | Marco Polo - A Tool for Automated Exploratory Testing of Previously Unseen Online Stores NEXTA Cristina Gatt University of Malta, Mark Micallef University of Malta, Mark Bugeja University of Malta |
11:00 - 12:30 | |||
11:00 90mKeynote | Testing and Development Challenges for Complex Cyber-Physical Systems: Insights from the COSMOS H2020 Project AIST Sebastiano Panichella Zurich University of Applied Sciences |
11:00 - 12:30 | |||
11:00 30mTalk | Semantic Metamorphic Testing focusing on Object Rarity InSTA Yasuharu Nishi University of Electro-Communications, Tokyo, Hidenori Hidenori , Yuma Torikoshi The University of Electro-Communications | ||
11:30 30mTalk | Elements for a Test Architecture Language InSTA | ||
12:00 5mDay closing | Closing InSTA |
11:00 - 12:30 | |||
11:00 30mTalk | An Experiment in Requirements Engineering and Testing using EARS Notation for PLC Systems A-MOST Mikael Ebrahimi Salari Mälardalen University, Eduard Paul Enoiu Mälardalen University, Wasif Afzal Mälardalen University, Cristina Seceleanu Mälardalen University | ||
11:30 30mTalk | Model-Based Policy Synthesis and Test-Case Generation for Autonomous Systems A-MOST | ||
12:00 30mTalk | We Tried and Failed: An Experience Report on a Collaborative Workflow for GUI-based Testing A-MOST Andreas Bauer Blekinge Institute of Technology, SERL Sweden, Emil Alégroth Blekinge Institute of Technology |
11:00 - 12:30 | |||
11:00 30mTalk | How we use Hermetic, Ephemeral Test Environments at Google to reduce Test Flakiness CCIW Carlos Arguelles Google LLC | ||
11:30 30mTalk | Enabling Pre-Merge CI on your TV CCIW | ||
12:00 30mTalk | What Breaks Google? CCIW |
11:00 - 12:30 | |||
11:00 30mPaper | Action-Based Test Carving for Android Apps INTUITESTBEDS Alessio Gambi IMC University of Applied Sciences Krems, Hemant Gouni University of Minnesota at Twin Cities, Daniel Berreiter , Vsevolod Tymofyeyev University of Passau, Mattia Fazzini University of Minnesota | ||
11:30 30mPaper | An analysis of widget layout attributes to support Android GUI-based testing INTUITESTBEDS Tommaso Fulcini Politecnico di Torino, Riccardo Coppola Politecnico di Torino, Marco Torchiano Politecnico di Torino, Luca Ardito Politecnico di Torino | ||
12:00 30mPaper | From User Stories to End-to-end Web Testing INTUITESTBEDS |
14:00 - 15:30 | |||
14:00 30mResearch paper | Cloudify the RAN System Test Strategy NEXTA | ||
14:30 30mResearch paper | On factors that impact the relationship between code coverage and test suite effectiveness: a survey NEXTA maryam barani Department of Systems and Computer Engineering, Carleton University, Yvan Labiche , Antoine Rollet | ||
15:00 30mResearch paper | Modification-Impact based Test Prioritization for Process-Driven Applications NEXTA |
14:00 - 15:30 | |||
14:00 30mTalk | Similarities of Testing Programmed and Learnt Software AIST | ||
14:30 30mTalk | Evaluating the Effectiveness of Attacks and Defenses on Machine Learning Through Adversarial Samples AIST | ||
15:00 30mTalk | Regression Test Generation by Usage Coverage Driven Clustering on User Traces AIST Frédéric Tamagnan Femto-ST / Univ. of Franche-comte, Fabrice Bouquet University of Bourgogne Franche-Comté, Alexandre Vernotte smartesting, Bruno Legeard Université de Bourgogne Franche-Comté and Smartesting |
14:00 - 15:30 | |||
14:00 30mTalk | From BDD Scenarios to Test Case Generation A-MOST Tannaz Zameni University of Twente, Petra van den Bos University of Twente, The Netherlands, Jan Tretmans Radboud University Nijmegen, TNO-ESI, Johan Foederer Topic Embedded Systems, Arend Rensink University of Twente, The Netherlands | ||
14:30 30mTalk | ADAS Verification in Co-Simulation: Towards a Meta-Model for Defining Test Scenarios A-MOST Francesco Basciani University of L'Aquila, Vittorio Cortellessa University of L'Aquila, Sergio Di Martino Università degli Studi di Napoli Federico II, Dario Di Nucci University of Salerno, Daniele Di Pompeo University of L'Aquila, Carmine Gravino University of Salerno, Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II | ||
15:00 30mPanel | Discussion: "Testing Autonomous Systems: Some Immediate Questions" A-MOST |
14:00 - 15:30 | |||
14:00 30mTalk | Cloud-native Continuous Integration system for large enterprise software projects CCIW | ||
14:30 30mTalk | Predicting Compiler Resource Utilization CCIW Marc Türke SAP SE, Bartosz Bogacz SAP SE, Eric Heim SAP SE, Torsten Mandel SAP SE, Stephan Kraft SAP SE | ||
15:00 30mTalk | Automating Combinatorial Test Coverage for Cloud Virtualization CCIW File Attached |
14:00 - 15:30 | |||
14:00 30mPaper | Identifying Redundancies and Gaps Across Testing Levels During Verification of Automotive Software INTUITESTBEDS Rohini Bisht , Selomie Kindu Ejigu , Gregory Gay Chalmers | University of Gothenburg, Predrag Filipovikj |
14:00 - 15:30 | |||
14:30 30mPaper | Beyond Combinatorial Interaction Testing: On the need for transition testing in dynamically adaptive context-aware systems CoAST Pierre Martou UCLouvain / ICTEAM, Benoît Duhoux Université catholique de Louvain, Belgium, Kim Mens Université catholique de Louvain, ICTEAM institute, Belgium, Axel Legay | ||
15:00 30mPaper | Deep Industry Use Cases on Context-Aware Adaptive Mobile Systems Experience Testing CoAST |
16:00 - 17:30 | |||
16:00 90mDay closing | Closing Remarks and Presentation of Best Paper Award NEXTA Sahar Tahvili Ericsson AB |
16:00 - 17:30 | Discussion: Software Testing in 2030AIST at Grand canal 3 Chair(s): Gregory Gay Chalmers | University of Gothenburg | ||
16:00 - 17:30 | |||
16:00 30mTalk | Improving Model Learning by Inferring Separating Sequences from Traces A-MOST Rafael Braz ICMC/USP, Adenilso Simão University of São Paulo, Roland Groz LIG/UGA, Catherine Oriat LIG/UGA | ||
16:30 30mTalk | MUPPAAL: Reducing and Removing Equivalent and Duplicate Mutants in UPPAAL A-MOST Jaime Cuartas Universidad del Valle, Jesus Aranda Universidad del Valle, Maxime Cordy University of Luxembourg, Luxembourg, James Ortiz Université de Namur, Gilles Perrouin Fonds de la Recherche Scientifique - FNRS & University of Namur, Pierre Yves Schobbens University of Namur | ||
17:00 15mDay closing | Closing A-MOST 23 and Welcoming A-MOST 24! A-MOST Florian Lorber Aalborg University, Cristina Seceleanu Mälardalen University, Uraz Cengiz Türker Lancaster University (UK) |
16:00 - 17:30 | |||
16:00 90mPanel | What are the biggest challenges in large scale CI/CD? CCIW |
16:00 - 17:30 | |||
16:00 90mLive Q&A | Activity: Focus Group on Challenges for GUI and Context Aware Testing INTUITESTBEDS |
16:00 - 17:30 | |||
16:00 90mLive Q&A | Activity: Focus Group on Challenges for GUI and Context Aware Testing CoAST |