The proposed 16th edition of the Workshop on Automated Testing (A-TEST) extends the previous editions of the A-TEST workshops (previously titled Workshop on Automated Test Execution) by joining with another well-known workshop that focuses on similar topics, i.e, INTUITESTBEDS (International Workshop on User Interface Test Automation and Testing Techniques for Event-Based Software). This unified event combines the strengths of both workshops to create a broader and more meaningful discussion, involving, at the same time, a wider range of researchers from both academia and industry. By bringing together experts from diverse fields, A-TEST aims to encourage richer collaboration and knowledge exchange across the testing community.
The proposed 16th edition of the Workshop on Automated Testing (A-TEST) will focus on the specific theme of automated UI Testing and automated UI-based Testing, including both Character User Interface (CUI) and Graphical User Interface (GUI) testing.
A-TEST 2025 will serve as a unique venue for sharing the latest research, ideas, and techniques surrounding automated UI Testing and automated UI-based Testing. The workshop aims to encourage collaboration and knowledge exchange across the testing community, bringing together experts to discuss advancements, challenges, and future directions.
A-TEST aims to bring together researchers, practitioners, and tool developers working on topics related to:
- Automated user interfaces (UI) Testing of applications including both CUI and GUI.
- Automated GUI testing of mobile, desktop, and web applications.
- Automated testing of applications through their UI, including CUI and GUI.
- Automated GUI-based testing of mobile, desktop and web applications, and web applications.
- Automated CUI testing and CUI-based testing of legacy systems.
- Testing of other types of event-driven software, such as network protocols, embedded software, IoT applications and devices, web services and device drivers.
The relevant topics on UI Testing and UI-based Testing include modeling and model inference, test case generation and execution, test oracles, coverage and metrics, evaluation, analysis and reporting, abstraction and reusability, interoperability and cross-platform testing, prioritization and optimization, and tooling and industrial experiences.
This program is tentative and subject to change.
Tue 1 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
08:00 - 09:00 | |||
08:00 60mRegistration | Registration Social | ||
09:15 - 10:30 | |||
09:15 75mKeynote | Keynote (TBD) A-TEST | ||
10:30 - 11:00 | |||
10:30 30mCoffee break | Break Social | ||
14:00 - 15:30 | |||
14:00 30mTalk | Test Case Generation for Dialogflow Task-Based Chatbots A-TEST Rocco Gianni Rapisarda University of Milano-Bicocca, Davide Ginelli University of Milano-Bicocca, Diego Clerissi DIBRIS, University of Genova, Italy, Leonardo Mariani University of Milano-Bicocca | ||
14:30 30mTalk | Automated Testing of the GUI of a Real-Life Engineering Software using Large Language Models A-TEST Tim Rosenbach German Aerospace Center (DLR) Institute for Software Technology, Alexander Weinert German Aerospace Center (DLR) Institute for Software Technology, David Heidrich German Aerospace Center (DLR) | ||
15:00 30mTalk | SleepReplacer-GPT: AI-based Thread Sleep Replacement in Selenium WebDriver Tests A-TEST Dario Olianas , Maurizio Leotta DIBRIS, University of Genova, Italy, Filippo Ricca Università di Genova | ||
15:30 - 16:00 | |||
15:30 30mCoffee break | Break Social | ||
16:00 - 16:30 | |||
16:00 30mTalk | Curiosity Driven Multi-agent Reinforcement Learning for 3D Game Testing A-TEST Raihana Ferdous Consiglio Nazionale delle Ricerche (CNR), Fitsum Kifetew Fondazione Bruno Kessler, Davide Prandi Fondazione Bruno Kessler, Angelo Susi Fondazione Bruno Kessler | ||
Accepted Papers
Call for Papers
16th edition of the Workshop on Automated Testing (A-TEST) co-located with the 18th IEEE International Conference on Software Testing, Verification and Validation (ICST 2025)
The proposed 16th edition of the Workshop on Automated Testing (A-TEST) will focus on the specific theme of automated UI Testing and automated UI-based Testing, including both Character User Interface (CUI) and Graphical User Interface (GUI) testing.
Topics for submission
We solicit novel papers related to the following topics (not strictly limited) in the context of user interface testing, testing through the user interface, and other event-based systems:
- Model-Based UI Testing and Model Inference,
- Test case generation and execution,
- Test oracles design,
- Test coverage criteria,
- Metrics and evaluation for test effectiveness,
- Scalability and performance optimization of automated UI Testing,
- Context-Aware UI testing (i.e addressing the challenges of UI state variation during test execution)
- Data analysis and reporting,
- Abstraction and re-usability,
- Interoperability and cross-platform testing,
- Testing of non-functional requirements through the UI (i.g. security, reliability, usability, and performance)
- AI and LLMs in Automated UI Testing
- Automated testing strategies for event-driven software like network protocols, embedded software, and IoT applications and devices
- Model-based testing for complex event-driven systems, including web services and device drivers
- Tools and industrial experiences
The workshop will pay special attention to and actively encourage discussion on novel UI Testing and UI-based Testing techniques that leverage Large Language Models (LLMs).
Submission Guidelines
Submissions must conform to the IEEE conference proceedings template, specified in the IEEE Conference Proceedings Formatting Guidelines.
Paper formats:
- Full paper: (max. 8-10 pages) describing original and completed research - either empircal or theoretical - in A-TEST related techniques, tools, ora industrial case studies;
- Work-in-progress papers: (max. 4 pages) that describe novel, interesting, and highly potential work in progress, but not necessarily reaching its full completion;
- Tool papers: (max. 4 pages) presenting some academic testing tool in a way that it could be presented to industry as a start of successful technology transfer;
EasyChair instance of ICST 2025, please select track ‘A-TEST 2025’: https://easychair.org/conferences/?conf=icst2025 .
Submissions will be peer-evaluated. Each submission will undergo a review process, receiving three reviews from members of the program committee, using a standard bidding process. Following reviews, there will be an online discussion, and finally, the organizers will make final decisions on acceptance, using referee reviews and conclusions of the discussions. Submissions accepted for presentation in the workshop will also be published in the workshop’s proceedings, which will appear in the IEEE digital library.
| Sat 8 Mar 2025 Camera-ready submission (all categories) |
| Mon 3 Feb 2025 Notification |
| Fri 10 Jan 2025 Submission deadline (all categories) |
Pekka Aho
Open University of the Netherlands
Netherlands
Riccardo Coppola
Politecnico di Torino
Italy
Damiano Distante
Unitelma Sapienza University
Santiago Matalonga
University of the West of Scotland
Filippo Ricca
Università di Genova
Italy
Jean-Carlo Rossa-Hauk
Universidade Federal de Santa Catarina
Martín Solari
Universidad ORT Uruguay
Uruguay
Tanja E. J. Vos
Universitat Politècnica de València and Open Universiteit