Filter Program
Dates
Rooms
Tracks
Badges
Your Program
Mon 27 MayDisplayed time zone: Eastern Time (US & Canada) change
Mon 27 May
Displayed time zone: Eastern Time (US & Canada) change
08:00 - 09:00 | Breakfast & RegistrationSocial | ||
08:00 60mOther | Breakfast & Registration Social | ||
09:00 - 10:30 | |||
09:00 15mDay opening | Opening Remarks for IWCT 2024 IWCT | ||
09:15 60mKeynote | Keynote IWCT | ||
10:15 15mTalk | Summary of "An empirical comparison of combinatorial testing and search-based testing in the context of automated and autonomous driving systems" IWCT Florian Klück AVL List GmbH, Yihao Li , Jianbo Tao AVL List GmbH, Franz Wotawa Graz University of Technology | ||
09:00 - 10:30 | |||
09:15 15mDay opening | Welcome to NEXTA2024 NEXTA Sahar Tahvili Ericsson AB | ||
09:30 60mKeynote | Risk-Driven Testing and Certification in Simulated Environments NEXTA Michael Felderer German Aerospace Center (DLR) & University of Cologne | ||
09:00 - 10:30 | ITEQS IITEQS at Room 4 Chair(s): Eduard Paul Enoiu Mälardalen University, Mehrdad Saadatmand RISE Research Institutes of Sweden, Dragos Truscan Åbo Akademi University | ||
09:00 10mTalk | ITEQS 2024 Opening ITEQS Dragos Truscan Åbo Akademi University, Eduard Paul Enoiu Mälardalen University, Mehrdad Saadatmand RISE Research Institutes of Sweden | ||
09:15 60mKeynote | Keynote: The Challenges of Integrating Static Analysis and Dynamic Security Testing in the Context of Increasing Regulation ITEQS Martin A. Schneider Fraunhofer FOKUS | ||
11:00 - 12:30 | |||
11:00 30mDay opening | Welcome to 20 Years of A-MOST A-MOST Florian Lorber Silicon Austria Labs, Cristina Seceleanu Mälardalen University, Martin Tappler TU Wien, Austria | ||
11:30 30mFull-paper | Testing the Evolution of Feature Models with Specific Combinatorial Tests A-MOST Andrea Bombarda University of Bergamo, Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo File Attached | ||
12:00 30mFull-paper | Annotating Control-Flow Graphs for Formalized Test Coverage Criteria A-MOST Sean Kauffman Queen's University, Canada, Carlos Moreno , Sebastian Fischmeister University of Waterloo, Canada | ||
11:00 - 12:30 | |||
11:00 25mTalk | Algorithmic Optimizations for Deriving Minimal Forbidden Tuples IWCT Michael Wagner SBA Research, Irene Hiess , Ludwig Kampel , Dimitris Simos SBA Research, Jeff Yu Lei University of Texas at Arlington | ||
11:25 25mTalk | Double T-Wise Fault Localization: A Novel Approach to Root Cause Analysis via Combinatorial Test Set Completion IWCT Andrew Hicks IBM, Deborah Furman IBM, Ryan Rawlins IBM, Michael Gildein IBM, Eitan Farchi IBM Haifa Research Lab | ||
11:50 25mTalk | Use of binary decision diagrams to handle constraints in combinatorial interaction testing IWCT Tatsuhiro Tsuchiya Osaka University | ||
12:15 15mTalk | Summary of ``Constrained Detecting Arrays: Mathematical Structures for Fault Identification in Combinatorial Interaction Testing'' IWCT Hao Jin Osaka University, Ce Shi Shanghai Lixin University of Accounting and Finance, Tatsuhiro Tsuchiya Osaka University | ||
11:00 - 12:30 | |||
11:00 30mResearch paper | Automated Hybrid Fuzzing of Web APIs NEXTA Andrea Bogle The Aerospace Corporation, Tan Tran The Aerospace Corporation, Rafael Ceja The Aerospace Corporation, Joshua Sasaki The Aerospace Corporation, Riyadh Mahmood The Aerospace Corporation | ||
11:30 30mShort-paper | Improving security analysis rule set by relationship identification NEXTA | ||
12:00 30mShort-paper | TCPGraphix: A Visualization Tool for ML-Powered Test Case Prioritization Data Analysis NEXTA Yara Q Mahmoud Ontario Tech University, Akramul Azim Ontario Tech University, Md Asif Khan Ontario Tech University | ||
11:00 - 12:30 | |||
11:00 30mFull-paper | Automated SQA Framework with Predictive Machine Learning in Airfield Software ITEQS Ridwan Hossain , Akramul Azim Ontario Tech University, Linda Cato Team Eagle, Bruce Wilkins Team Eagle | ||
11:30 30mFull-paper | Early Detection with Explainability of Network Attacks Using Deep Learning ITEQS | ||
12:00 30mFull-paper | Testing cyber-physical systems with explicit output coverage ITEQS Jarkko Peltomäki Åbo Akademi University, Jesper Winsten , Maxime Methais , Ivan Porres Åbo Akademi University | ||
14:00 - 15:30 | |||
14:00 30mFull-paper | Active Model Learning for Software Interrogation and Diagnosis A-MOST | ||
14:30 30mShort-paper | Active Model Learning of Git Version Control System A-MOST Edi Muskardin , Tamim Burgstaller , Martin Tappler TU Wien, Austria, Bernhard Aichernig Graz University of Technology | ||
15:00 30mFull-paper | Bridging the Gap Between Models in RL: Test Models vs. Neural Networks A-MOST | ||
14:00 - 15:30 | |||
14:00 30mTalk | Assessing the Degree of Feature Interactions that Determine a Model Prediction IWCT Krishna Khadka The University of Texas at Arlington, Sunny Shree , Jeff Yu Lei University of Texas at Arlington, Raghu Kacker National Institute of Standards and Technology, Richard Kuhn | ||
14:30 30mTalk | Coverage for Identifying Critical Metadata in Machine Learning Operating Envelopes IWCT Erin Lanus Virginia Tech, Brian Lee Virginia Tech, Luis Pol Virginia Tech, Daniel Sobien Virginia Tech, Justin Kauffman Virginia Tech, Laura Freeman Virginia Tech | ||
15:00 30mTalk | Integrating Product Sampling and Behavioral Testing for Software Product Lines with Combinatorial Testing IWCT | ||
14:00 - 15:30 | |||
14:00 30mShort-paper | Elevating Software Quality in Agile Environments: The Role of Testing Professionals in Unit Testing NEXTA Lucas Neves Cox Automotive Inc., Oscar Campos Cox Automotive Inc., Robson T. de Souza Santos , Cleyton Vanut Cordeiro de Magalhães , Italo Santos Northern Arizona University, Ronnie de Souza Santos University of Calgary | ||
14:30 30mResearch paper | Selecting "good" regression tests based on a classification of side-effects NEXTA | ||
15:00 30mResearch paper | ODACE: An Appium-based Testing Automation Platform for Android Mobile Devices Certification NEXTA Sundos Mojahed École de technologie supérieure (ÉTS), Rejean Drouin , Lokman Sboui École de technologie supérieure (ÉTS) | ||
14:00 - 15:30 | |||
14:00 30mFull-paper | A Survey on the Verification and Validation of Artificial Pancreas Software Systems ITEQS Bara' Nazzal Queen's University, Canada, Manar Alalfi Toronto Metropolitan University, James Cordy Queen's University, Canada | ||
14:30 30mFull-paper | ConDU: Method for On-the-fly Detection of Non-deadlock Concurrency Errors in UAV Software ITEQS Jinseok Park Gyeongsang National University, Changhui Bae Gyeongsang National University, Seongjin Lee Gyeongsang National Unviersity | ||
15:00 30mFull-paper | Java Lock Contention Anti-Patterns and Their Associated Recommendations ITEQS Aritra Ahmed Ontario Tech University, Ramiro Liscano Ontario Tech University, Akramul Azim Ontario Tech University, Yee-Kang Chang International Business Machines Corporation (IBM), Vijay Sundaresan IBM Canada | ||
16:00 - 17:30 | |||
16:00 30mShort-paper | Coverage measurement in model-based testing of web applications: Tool support and an industrial experience report A-MOST Vahid Garousi Queen's University Belfast, Alper Buğra Keleş , Yunus Balaman , Alper Mermer , Zeynep Özdemir Güler | ||
16:30 30mShort-paper | Modeling and Safety Analysis of Autonomous Underwater Vehicles Behaviors A-MOST Sergio Quijano IT University of Copenhagen, Mahsa Varshosaz IT University of Copenhagen, Denmark, Andrzej Wąsowski IT University of Copenhagen, Denmark | ||
17:00 30mFull-paper | Optimizing Model-based Generated Tests: Leveraging Machine Learning for Test Reduction A-MOST Muhammad Nouman Zafar Malardalen University, Wasif Afzal Mälardalen University, Eduard Paul Enoiu Mälardalen University, Zulqarnain Haider , Inderjeet Singh Alstom | ||
16:00 - 17:30 | |||
16:00 25mTalk | On Combinatorial Security Testing for the Tor Anonymity Network Client IWCT Dimitris Simos SBA Research, Bernhard Garn SBA Research, Dominik-Philip Schreiber MATRIS Research Group, SBA Research, Manuel Leithner SBA Research, Rick Kuhn National Institute of Standards and Technology, Raghu Kacker National Institute of Standards and Technology | ||
16:25 30mTalk | Summary of CT tools IWCT | ||
16:55 35mDay closing | Closing Remarks for IWCT 2024 IWCT | ||
16:00 - 17:30 | |||
16:00 30mAwards | Closing and Best Paper Award NEXTA Sahar Tahvili Ericsson AB | ||
16:00 - 17:30 | |||
16:00 10mTalk | Closing ITEQS Dragos Truscan Åbo Akademi University, Eduard Paul Enoiu Mälardalen University, Mehrdad Saadatmand RISE Research Institutes of Sweden | ||
Tue 28 MayDisplayed time zone: Eastern Time (US & Canada) change
Tue 28 May
Displayed time zone: Eastern Time (US & Canada) change
08:00 - 09:00 | BreakfastSocial | ||
08:00 60mOther | Breakfast & Registration Social | ||
08:30 - 10:30 | |||
08:30 20mDay opening | Welcome to CCIW CCIW Tim A. D. Henderson Google | ||
08:50 25mTalk | Thinktank: Leveraging LLM Reasoning for Advanced Task Execution in CI/CD CCIW Tim Keller SAP SE | ||
09:15 25mTalk | Widespread Error Detection in Large Scale Continuous Integration Systems CCIW Stanislaw Swierc Meta Platforms, Inc., James Lu Meta Platforms, Inc., Thomas Yi Meta Platforms, Inc. Link to publication | ||
09:40 25mTalk | Scalable Continuous Integration using Remote Execution CCIW | ||
10:05 25mTalk | Replay-Based Continual Learning for Test Case Prioritization CCIW Asma Fariha Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University | ||
09:00 - 10:30 | |||
09:00 15mDay opening | Workshop Opening AIST Gregory Gay Chalmers | University of Gothenburg, Sebastiano Panichella Zurich University of Applied Sciences, Aitor Arrieta Mondragon University | ||
09:15 60mKeynote | Towards Better Software Quality in the Era of Large Language Models AIST Lingming Zhang University of Illinois at Urbana-Champaign | ||
10:15 15mTalk | Generating Minimalist Adversarial Perturbations to Test Object-Detection Models: An Adaptive Multi-Metric Evolutionary Search Approach AIST Cristopher McIntyre-Garcia , Adrien Heymans University of Ottawa, Beril Borali University of Ottawa, Won-Sook Le University of Ottawa, Shiva Nejati University of Ottawa | ||
09:00 - 10:30 | |||
09:30 15mDay opening | Welcome ceremony MODAL | ||
09:45 45mKeynote | Keynote: Julia Rubin MODAL | ||
09:00 - 10:30 | |||
09:00 10mOther | TestEd 2024 Opening TestEd Upsorn Praphamontripong University of Virginia | ||
09:10 80mKeynote | Why Testing is Even More Important in the Age of Generative AI TestEd | ||
09:00 - 10:30 | |||
09:30 5mDay opening | MUTATION opening Mutation | ||
09:35 55mKeynote | Keynote: Mutation for AI and with AI Mutation | ||
11:00 - 12:30 | |||
11:00 22mTalk | "No Free Lunch" when using Large Language Models to Verify Self-Generated Programs AIST | ||
11:22 22mTalk | An End-to-End Test Case Prioritization Framework using Optimized Machine Learning Models AIST Md Asif Khan Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University, Kevin Smith International Business Machines Corporation (IBM), Yee-Kang Chang International Business Machines Corporation (IBM), Qasim Tauseef International Business Machines Corporation (IBM), Gkerta Seferi International Business Machines Corporation (IBM) | ||
11:45 22mTalk | Iterative Optimization of Hyperparameter-based Metamorphic Transformations AIST Gaadha Sudheerbabu Åbo Akademi University, Tanwir Ahmad Åbo Akademi University, Dragos Truscan Åbo Akademi University, Jüri Vain Tallinn University of Technology, Estonia, Ivan Porres Åbo Akademi University | ||
12:07 22mTalk | Machine Learning for Cross-Vulnerability Prediction in Smart Contracts AIST | ||
11:00 - 12:30 | Lightning Talks & Program Analysis PanelMODAL at Room 2 Chair(s): Kevin Moran University of Central Florida | ||
11:00 45mTalk | Lightning (5-10 min.) Talks - All Participants MODAL | ||
11:45 45mPanel | Panel: Program Analysis for Mobile Apps MODAL Julia Rubin University of British Columbia, Safwat Hassan University of Toronto, Canada, Weiyi Shang University of Waterloo, Yousra Aafer Purdue University | ||
11:00 - 12:30 | |||
11:00 30mResearch paper | Course Design of Introducing Selenium WebDriver TestEd | ||
11:30 30mResearch paper | Engaging Young Learners with Testing Using the Code Critters Mutation Game TestEd Pre-print | ||
12:00 30mResearch paper | Fostering a Testing Mindset through Automated Feedback on Multiple Submissions Using Git-keeper TestEd | ||
11:00 - 12:30 | |||
11:00 30mTalk | Mutant-Kraken: A Mutation Testing Tool for Kotlin Mutation Josue Morales Towson University, Lin Deng Towson University, Josh Dehlinger Towson University, Suranjan Chakraborty Towson University | ||
11:30 30mTalk | Timed Model-Based Mutation Operators for Simulink Models Mutation | ||
12:00 30mTalk | Improving the Efficacy of Testing Scientific Software: Insights from Mutation Testing Mutation | ||
11:00 - 12:30 | |||
11:00 25mTalk | Future of Google Testing CCIW | ||
11:25 25mTalk | The Effects of Computational Resources on Flaky Tests CCIW Jonathan Bell Northeastern University, Wing Lam George Mason University, Marcelo d'Amorim North Carolina State University, Alexi Turcotte Northeastern University, Ellen Arteca Google MTV , Satyajit Gokhale Northeastern University, Martin Gruber BMW Group, University of Passau, Denini Silva Federal University of Pernambuco Media Attached File Attached | ||
11:50 40mPanel | What are the biggest challenges in large scale CI/CD? CCIW Tim A. D. Henderson Google | ||
14:00 - 15:30 | |||
14:00 45mTutorial | Tutorial: A Hands-on Tutorial for Automatic Test Case Generation and Fuzzing for JavaScript AIST Mitchell Olsthoorn Delft University of Technology, Annibale Panichella Delft University of Technology | ||
14:45 45mTutorial | Tutorial: SoKotHban - Competitive Adversarial Testing of Sokoban Solvers AIST Addison Crump CISPA Helmholtz Center for Information Security | ||
14:00 - 15:30 | Industry Keynote & Mobile Testing PanelMODAL at Room 2 Chair(s): Kevin Moran University of Central Florida | ||
14:00 45mKeynote | Keynote: Jiangfan Shi - Difficulties and Challenges of Mobile Testing in Industry MODAL | ||
14:45 45mPanel | Panel: Mobile Testing MODAL Jiangfan Shi , Mattia Fazzini University of Minnesota, Wenyu Wang University of Illinois Urbana-Champaign, Wing Lam George Mason University | ||
14:00 - 15:30 | |||
14:00 30mResearch paper | A pragmatic look at education and training of software test engineers: Further cooperation of academia and industry is needed TestEd | ||
14:30 30mResearch paper | Factors Influencing the Performance of Students in Software Automated Test Tools Course TestEd | ||
15:00 30mOther | Closing TestEd 2024 TestEd Upsorn Praphamontripong University of Virginia | ||
14:00 - 15:30 | |||
14:00 30mTalk | Test Harness Mutilation Mutation Samuel Moelius Trail of Bits | ||
14:30 30mTalk | An Empirical Evaluation of Manually Created Equivalent Mutants Mutation Philipp Straubinger University of Passau, Alexander Degenhart University of Passau, Gordon Fraser University of Passau Pre-print | ||
15:00 30mTalk | A Study of Flaky Failure De-Duplication to Identify Unreliably Killed Mutants Mutation Abdulrahman Alshammari George Mason University, Paul Ammann George Mason University, USA, Michael Hilton Carnegie Mellon University, Jonathan Bell Northeastern University | ||
14:00 - 15:30 | |||
14:00 10mTalk | Welcome and Opening Messages InSTA 2024 InSTA | ||
14:10 30mResearch paper | Design and construction of requirement specifications ambiguity detection support method InSTA | ||
14:40 30mIndustry talk | Prompt Engineering Impacts to Software Test Architectures for Beginner to Experts InSTA Jon D. Hagar Grand Software Testing, LLC, Hot Sulphur Springs, CO, Satoshi Masuda Tokyo City University | ||
15:10 20mTalk | Information exchange in InSTA. (free discussion) InSTA | ||
16:00 - 17:30 | |||
16:00 75mPanel | Panel Discussion AIST | ||
17:15 15mDay closing | Workshop Closing AIST Aitor Arrieta Mondragon University, Gregory Gay Chalmers | University of Gothenburg, Sebastiano Panichella Zurich University of Applied Sciences | ||
16:00 - 17:30 | |||
16:00 45mPanel | Panel: Community Dataset and Infrastructure MODAL August Shi The University of Texas at Austin, Kevin Moran University of Central Florida, Mei Nagappan University of Waterloo, Shin Yoo Korea Advanced Institute of Science and Technology | ||
16:45 15mDay closing | Closing discussions MODAL | ||
16:00 - 17:30 | |||
16:00 30mResearch paper | Software Bug Prediction Model using Graph Neural Network InSTA | ||
16:30 10mTalk | Closing InSTA | ||
Wed 29 MayDisplayed time zone: Eastern Time (US & Canada) change
Wed 29 May
Displayed time zone: Eastern Time (US & Canada) change
07:30 - 08:30 | BreakfastSocial | ||
07:30 60mOther | Breakfast & Registration Social | ||
08:30 - 09:00 | OpeningSocial at Room 1 Chair(s): Hadi Hemmati York University, Gregory Gay Chalmers | University of Gothenburg, Shiva Nejati University of Ottawa | ||
08:30 30mDay opening | Opening Social | ||
09:00 - 10:30 | |||
09:00 90mKeynote | Synergy of Software Reliability and Large Language Models Keynotes | ||
11:00 - 12:40 | Testing and LLMsIndustry / Research Papers at Room 2 & 3 Chair(s): Sudipta Chattopadhyay Singapore University of Technology and Design | ||
11:00 20mIndustry talk | Are We Testing or Being Tested? Exploring the Practical Applications of Large Language Models in Software Testing Industry Robson T. de Souza Santos , Italo Santos Northern Arizona University, Cleyton V. C. de Magalhaes CESAR School, Ronnie de Souza Santos University of Calgary | ||
11:20 20mResearch paper | Improving Patch Correctness Analysis via Random Testing and Large Language Models Research Papers Facundo Molina IMDEA Software Institute, Juan Manuel Copia IMDEA Software Institute; Universidad Politécnica de Madrid, Alessandra Gorla IMDEA Software Institute Pre-print | ||
11:40 20mResearch paper | Intent-Driven Mobile GUI Testing with Autonomous Large Language Model Agents Research Papers Juyeon Yoon Korea Advanced Institute of Science and Technology, Robert Feldt Chalmers University of Technology, Sweden, Shin Yoo Korea Advanced Institute of Science and Technology Pre-print | ||
12:00 20mResearch paper | KAT: Dependency-aware Automated API Testing with Large Language Models Research Papers Tri Le , Thien Tran , Duy Cao , Vy Le , Vu Nguyen Head of Research, Katalon Inc.; University of Science, VNU-HCM, Vietnam, Tien N. Nguyen University of Texas at Dallas | ||
12:20 20mResearch paper | Quantizing Large-Language Models for Predicting Flaky Tests Research Papers Shanto Rahman The University of Texas at Austin, Abdelrahman Baz , Sasa Misailovic University of Illinois at Urbana-Champaign, August Shi The University of Texas at Austin | ||
14:00 - 15:00 | |||
14:00 60mKeynote | We build the world we measure Keynotes | ||
15:30 - 17:00 | FuzzingJournal-First Papers / Research Papers / Testing Tools and Demonstration at Room 1 Chair(s): Sahar Tahvili Ericsson AB | ||
15:30 20mResearch paper | MSGFuzzer: Message Sequence Guided Industrial Robot Protocol Fuzzing Research Papers Yang Zhang Beijing Key Laboratory of IOT Information Security Technology, Institute of Information Engineering, CAS, Beijing, China; School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China, Dongliang Fang Beijing Key Laboratory of IOT Information Security Technology, Institute of Information Engineering, CAS, China; School of Cyber Security, University of Chinese Academy of Sciences, China, Puzhuo Liu Beijing Key Laboratory of IOT Information Security Technology, Institute of Information Engineering, CAS, Beijing, China； School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China；, Laile Xi , Xiao Lu , Xin Chen , Shuaizong Si , Limin Sun Institute of Information Engineering, Chinese Academy of Sciences, School of Cyber Security, University of Chinese Academy of Sciences, | ||
15:50 20mResearch paper | U-Fuzz: Stateful Fuzzing of IoT Protocols on COTS Devices Research Papers Shang Zewen , Matheus Eduardo Garbelini , Sudipta Chattopadhyay Singapore University of Technology and Design | ||
16:10 20mResearch paper | Formatted Stateful Greybox Fuzzing of TLS server Research Papers Fan Hu , Jiangan Ji , Hui Shu , Zheming Li Tsinghua University, Tieming Liu , Chao Zhang Tsinghua University | ||
16:30 20mLong-paper | A Fuzzing-Based Test-Creation Approach for Evaluating Digital TV Receivers via Transport Streams Journal-First Papers Fabrício Izumi Banceira , Eddie Lima Samsung Electronics, Brazil, Lucas C. Cordeiro University of Manchester, UK and Federal University of Amazonas, Brazil, Orlewilson Maia , Rômulo Fabrício , Bruno Farias University of Manchester, UK, Aguinaldo Silva | ||
16:50 10mDemonstration | MOTIF: A tool for Mutation Testing with Fuzzing Testing Tools and Demonstration Jaekwon Lee University of Ottawa & University of Luxembourg, Enrico Viganò University of Luxembourg, Fabrizio Pastore University of Luxembourg, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland | ||
17:00 - 18:00 | |||
17:00 60mMeeting | Open Steering Committee Meeting Keynotes | ||
Thu 30 MayDisplayed time zone: Eastern Time (US & Canada) change
Thu 30 May
Displayed time zone: Eastern Time (US & Canada) change
08:00 - 09:00 | BreakfastSocial | ||
08:00 60mOther | Breakfast & Registration Social | ||
09:00 - 10:30 | |||
09:00 90mKeynote | Beyond Alt Text: Emerging Software Engineering Techniques for a More Accessible Software Keynotes | ||
11:00 - 12:40 | Test FlakinessJournal-First Papers / Research Papers / Industry at Room 1 Chair(s): Andrea Stocco Technical University of Munich, fortiss | ||
11:00 20mLong-paper | Test Code Flakiness in Mobile Apps: The Developer's Perspective Journal-First Papers Valeria Pontillo Vrije Universiteit Brussel, Fabio Palomba University of Salerno, Filomena Ferrucci University of Salerno Link to publication | ||
11:20 20mLong-paper | Flakiness goes live: Insights from an In Vivo testing simulation study Journal-First Papers Morena Barboni University of Camerino, Antonia Bertolino National Research Council, Italy, Guglielmo De Angelis CNR-IASI | ||
11:40 20mResearch paper | 262,447 Test Failures Later: An Empirical Evaluation of Flaky Failure Classifiers Research Papers Abdulrahman Alshammari George Mason University, Paul Ammann George Mason University, USA, Michael Hilton Carnegie Mellon University, Jonathan Bell Northeastern University | ||
12:00 20mResearch paper | Automatically Reproducing Timing-Dependent Flaky-Test Failures Research Papers Shanto Rahman The University of Texas at Austin, Aaron Massey George Mason University, Wing Lam George Mason University, August Shi The University of Texas at Austin, Jonathan Bell Northeastern University | ||
12:20 20mIndustry talk | Cost of Flaky Tests in CI: An Industrial Case Study Industry Fabian Leinen Technical University of Munich, Daniel Elsner TU Munich, Alexander Pretschner TU Munich, Andreas Stahlbauer , Michael Sailer , Elmar Juergens CQSE GmbH Pre-print | ||
11:00 - 12:40 | Mutation Testing and Test PrioritizaitonResearch Papers / Journal-First Papers / Industry at Room 2 & 3 Chair(s): Facundo Molina IMDEA Software Institute | ||
11:00 20mIndustry talk | Towards Mutation-guided Test Suites for Smart Contracts Industry Pre-print | ||
11:20 20mResearch paper | On the Coupling between Vulnerabilities and LLM-generated Mutants: A Study on Vul4J dataset Research Papers Aayush Garg Luxembourg Institute of Science and Technology, Renzo Degiovanni Luxembourg Institute of Science and Technology, Mike Papadakis University of Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg Pre-print | ||
11:40 20mLong-paper | Mutation Testing Optimisations using the Clang Front-end Journal-First Papers Sten Vercammen , Serge Demeyer University of Antwerp; Flanders Make, Markus Borg CodeScene, Niklas Pettersson , Görel Hedin Lund University | ||
12:00 20mResearch paper | MACS: Multi-agent Adversarial Reinforcement Learning for Finding Diverse Critical Driving Scenarios Research Papers Shuting Kang University of Chinese Academy of Sciences, Qian Dong Institute of Software Chinese Academy of Sciences, Yunzhi Xue Institute of Software Chinese Academy of Sciences, Yanjun Wu Institute of Software, Chinese Academy of Sciences | ||
12:20 20mLong-paper | Lessons learned from replicating a study on information-retrieval-based test case prioritization Journal-First Papers Nasir Mehmood Minhas Mälardalen University, Mohsin Irshad , Kai Petersen University of Applied Sciences Flensburg, Germany / Blekinge Institute of Technology, Sweden, Jürgen Börstler Blekinge Institute of Technology | ||
11:00 - 12:40 | |||
11:00 25mDoctoral symposium paper | Agile Regression Testing Doctoral Symposium Suddhasvatta Das Arizona State University | ||
11:25 25mDoctoral symposium paper | Insights into System Failures: ML-Assisted Testing and Failure Models for Cyber-Physical Systems Doctoral Symposium Baharin Aliashrafi Jodat University of Ottawa | ||
11:50 25mDoctoral symposium paper | Search-based Security Testing of Enterprise Microservices Doctoral Symposium | ||
12:15 25mDoctoral symposium paper | Teaching Model-Driven Engineering from a model-testing perspective Doctoral Symposium Felix Cammaerts KU Leuven File Attached | ||
12:40 - 14:00 | |||
12:40 80mLunch | Lunch Social | ||
14:00 - 15:00 | Software Testing Education and Fault LocalizationResearch Papers / Journal-First Papers at Room 1 Chair(s): Shin Yoo Korea Advanced Institute of Science and Technology | ||
14:00 20mResearch paper | State of the Practice in Software Testing Teaching in Four European Countries Research Papers Porfirio Tramontana Department of Electrical Engineering and Information Technologies, University of Naples Federico II, Italy, Beatriz Marín Universitat Politècnica de València, Ana Paiva Faculty of Engineering, University of Porto and INESC TEC, Alexandra Mendes Faculty of Engineering, University of Porto & INESC TEC, Tanja E. J. Vos Universitat Politècnica de València and Open Universiteit, Domenico Amalfitano University of Naples Federico II, Felix Cammaerts KU Leuven, Monique Snoeck Katholieke Universiteit Leuven, Anna Rita Fasolino Federico II University of Naples | ||
14:20 20mLong-paper | Can gamification help in software testing education? Findings from an empirical study Journal-First Papers Raquel Blanco , Manuel Trinidad , María José Suárez-Cabal , Alejandro Calderón Sánchez , Mercedes Ruiz University of Cadiz, Javier Tuya Computer Science Department, University of Oviedo | ||
14:40 20mResearch paper | FusionFL: A statement-level feature fusion based fault localization approach Research Papers Yanbo Zhang , Yawen Wang State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Dongming Zhu , Wenjing Liu | ||
14:00 - 15:00 | |||
14:00 60mPanel | Doctoral Symposium Panel (Open) Doctoral Symposium | ||
15:30 - 16:30 | Most Influential PaperMost Influential Paper at Room 1 Chair(s): Gregory Gay Chalmers | University of Gothenburg, Shiva Nejati University of Ottawa | ||
15:30 60mTalk | Ask the Mutants: Mutating Faulty Programs for Fault Localization Most Influential Paper Seokhyeon Moon Samsung SDS, Yunho Kim Hanyang University, Moonzoo Kim KAIST / VPlusLab Inc. , Shin Yoo Korea Advanced Institute of Science and Technology | ||
Fri 31 MayDisplayed time zone: Eastern Time (US & Canada) change
Fri 31 May
Displayed time zone: Eastern Time (US & Canada) change
08:00 - 09:00 | BreakfastSocial | ||
08:00 60mOther | Breakfast & Registration Social | ||
09:00 - 09:15 | |||
09:00 15mAwards | Awards Social | ||
09:15 - 10:30 | |||
09:15 75mKeynote | DIDACT: Large sequence models for software development activities Keynotes | ||
11:00 - 12:20 | Testing and ApplicationsResearch Papers / Testing Tools and Demonstration / Industry at Room 1 Chair(s): Jeremy Bradbury Ontario Tech University | ||
11:00 20mIndustry talk | In industrial embedded software, are some compilation errors easier to localize and fix than others? Industry Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden | ||
11:20 20mResearch paper | Brewing Up Reliability: Espresso Test Generation for Android Apps Research Papers Iván Arcuschin Moreno University of Buenos Aires, Argentina, Lisandro Di Meo , Michael Auer University of Passau, Juan Pablo Galeotti University of Buenos Aires, Gordon Fraser University of Passau DOI Pre-print | ||
11:40 20mResearch paper | Differential Optimization Testing of Gremlin-Based Graph Database Systems Research Papers Yingying Zheng Institute of Software Chinese Academy of Sciences, Wensheng Dou Institute of Software Chinese Academy of Sciences, Lei Tang Institute of Software Chinese Academy of Sciences, Ziyu Cui Institute of Software Chinese Academy of Sciences, Jiansen Song Institute of Software Chinese Academy of Sciences, Ziyue Cheng , Wei Wang , Jun Wei Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; University of Chinese Academy of Sciences Chongqing School, Hua Zhong , Tao Huang Institute of Software Chinese Academy of Sciences | ||
12:00 10mDemonstration | MLHCBugs: A Framework to Reproduce Real Faults in Healthcare Machine Learning Applications Testing Tools and Demonstration Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida | ||
12:10 10mDemonstration | The GitHub Recent Bugs Dataset for Evaluating LLM-based Debugging Applications Testing Tools and Demonstration Jae Yong Lee , Sungmin Kang , Juyeon Yoon Korea Advanced Institute of Science and Technology, Shin Yoo Korea Advanced Institute of Science and Technology | ||
11:00 - 12:20 | Testing with and for Deep and Reinforcement LearningResearch Papers / Industry at Room 2 & 3 Chair(s): Paolo Arcaini National Institute of Informatics | ||
11:00 20mResearch paper | METAL: Metamorphic Testing Framework for Analyzing Large-Language Model Qualities Research Papers Sangwon Hyun University of Adelaide, Mingyu Guo , Muhammad Ali Babar School of Computer Science, The University of Adelaide | ||
11:20 20mIndustry talk | End-to-end RPA-like testing using reinforcement learning Industry Ciprian Paduraru University of Bucharest, Rares Cristea University of Bucharest, Alin Stefanescu University of Bucharest | ||
11:40 20mResearch paper | Spectral Analysis of the Relation between Deep Learning Faults and Neural Activation Values Research Papers | ||
12:00 20mResearch paper | Learning Environment Models with Continuous Stochastic Dynamics - with an Application to Deep RL Testing Research Papers Martin Tappler TU Wien, Austria, Edi Muskardin , Bernhard Aichernig Graz University of Technology, Bettina Könighofer | ||
13:30 - 14:30 | Testing and RepairResearch Papers / Industry at Room 1 Chair(s): August Shi The University of Texas at Austin | ||
13:30 20mResearch paper | Evolutionary Testing for Program Repair Research Papers Haifeng Ruan , Hoang Lam Nguyen Humboldt-Universität zu Berlin, Ridwan Salihin Shariffdeen National University of Singapore, Yannic Noller Singapore University of Technology and Design, Abhik Roychoudhury National University of Singapore | ||
13:50 20mResearch paper | Does Going Beyond Branch Coverage Make Program Repair Tools More Reliable? Research Papers Amirfarhad Nilizadeh University of Central Florida, Gary T. Leavens University of Central Florida, Corina Pasareanu CMU, NASA, KBR, Xuan-Bach D. Le The University of Melbourne, David Cok CEA, LIST, Software Safety and Security Laboratory | ||
14:10 20mIndustry talk | SafeRevert: When Can Breaking Changes be Automatically Reverted? Industry Pre-print | ||
13:30 - 14:30 | Metamorphic and Combinatorial TestingIndustry / Journal-First Papers / Research Papers at Room 2 & 3 Chair(s): Wishnu Prasetya Utrecht University | ||
13:30 20mIndustry talk | Metamorphic Testing of an Autonomous Delivery Robots Scheduler Industry Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics
, Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics Pre-print | ||
13:50 20mLong-paper | Design, implementation, and validation of a benchmark generator for combinatorial interaction testing tools Journal-First Papers | ||
14:30 - 15:30 | |||
14:30 60mPanel | Fishbowl Panel - The Role of AI in Software Testing Keynotes Joana Coutinho , Mehrdad Saadatmand RISE Research Institutes of Sweden, Jeremy Bradbury Ontario Tech University, Renzo Degiovanni Luxembourg Institute of Science and Technology | ||
16:00 - 16:30 | ClosingSocial at Room 1 Chair(s): Hadi Hemmati York University, Gregory Gay Chalmers | University of Gothenburg, Shiva Nejati University of Ottawa | ||
16:00 30mDay closing | Closing Social | ||
Thu 30 May 2024 17:00 - 22:30 - Banquet
Info for session
Thursday, May 30: Cruise and Dinner on Lake Ontario
The main social event of the conference will be a cruise dinner on Lake Ontario, one of the Great Lakes, and a true Canadian experience! The cruise will be on the Trillium Deck of the Odyssey, a three-level yacht. Attendees are welcome to go to the upper deck and enjoy the Toronto skyline by night, including the imposing CN Tower, and gaze at the Toronto Islands from afar. Magnificent dishes and plenty of drinks comprise the dinner of the cruise, which also includes a DJ just for the entertainment of the ICST attendees!
Boarding begins at 6:30 PM sharp from 207 Queen’s Quay West, so make sure you navigate yourselves there right after the technical program ends for the day. The mooring of Odyssey is about 1 hour away from the conference venue by transit (see map) or a 14-minute walk from Union station (which is on the same subway line, the Yellow Line 1, with York University). The Odyssey will depart at 7:00 PM sharp. A bus service will be available for the trip back to York and Vaughn region hotels. Please make sure to choose your desired meal for the cruise (choices between chicken, beef, vegetarian, and fish are available until supplies last), and let us know if you will be taking the bus back to York at the registration desk.
