Test automation has been an acknowledged software engineering best practice for years. However, the topic involves more than the repeated execution of test cases that often comes first to mind. Simply running test cases using a unit testing framework is no longer enough for test automation to keep up with the ever-shorter release cycles driven by continuous deployment and technological innovations such as microservices and DevOps pipelines. Now test automation needs to rise to the next level by going beyond mere test execution. The NEXTA workshop will explore how to advance test automation to further contribute to software quality in the context of tomorrow’s rapid release cycles. Take-aways for industry practitioners and academic researchers will encompass test case generation, automated test result analysis, test suite assessment and maintenance, and infrastructure for the future of test automation.
All information about this workshop can be found at the workshop’s official website: https://www.testomatproject.eu/nexta2020.
Sat 24 OctDisplayed time zone: Lisbon change
09:00 - 10:30 | Welcome + Session: Process ImprovementNEXTA 2020 at D. Luis Chair(s): Pasqualina Potena RISE Research Institutes of Sweden AB | ||
09:00 15mDay opening | Welcome address and practical arrangements NEXTA 2020 | ||
09:15 30mFull-paper | Test Automation Process Improvement in a DevOps Team: Experience report NEXTA 2020 Link to publication DOI | ||
09:45 20mShort-paper | Test Automation Challenges for Application Landscape Frameworks NEXTA 2020 Nils Wild Research Group Software Construction RWTH Aachen University, Horst Lichter RWTH Aachen University, Peter Kehren Research Group Software Construction RWTH Aachen University Link to publication DOI | ||
10:05 20mFull-paper | Test Automation Improvement Model - TAIM 2.0 NEXTA 2020 Sigrid Eldh Ericsson Link to publication DOI |
11:00 - 12:30 | |||
11:00 30mFull-paper | Optimization of automated executions based on integration test configurations of embedded software NEXTA 2020 Masashi Mizoguchi Hitachi Ltd., Takahiro Iida Hitachi Automotive Systems Ltd., Toru Irie Hitachi Automotive Systems Ltd. Link to publication DOI | ||
11:30 30mFull-paper | Selective Regression Testing based on Big Data: Comparing Feature Extraction Techniques NEXTA 2020 Khaled Al-Sabbagh University of Gothenburg, Miroslaw Staron University of Gothenburg, Regina Hebig Chalmers | Gothenburg University, Miroslaw Ochodek Poznan University of Technology, Wilhelm Meding Ericsson Link to publication DOI | ||
12:00 20mFull-paper | Runtime Prioritization with the Classification Tree Method for Test Automation NEXTA 2020 Link to publication DOI |
14:00 - 15:30 | Session: Test GenerationNEXTA 2020 at D. Luis Chair(s): Serge Demeyer University of Antwerp, Belgium | ||
14:00 30mFull-paper | Optimizing the Parameters of an Evolutionary Algorithm for Fuzzing and Test Data Generation NEXTA 2020 Ralf Gerlich Dr. Rainer Gerlich System and Software Engineering, Christian R. Prause German Aerospace Center - Space Administration Link to publication DOI | ||
14:30 30mFull-paper | Boundary Value Exploration for Software Analysis NEXTA 2020 Felix Dobslaw Chalmers University of Technology, Francisco Gomes de Oliveira Neto Chalmers | University of Gothenburg, Robert Feldt Chalmers University of Technology Link to publication DOI | ||
15:00 20mShort-paper | Test Data Generation for MC/DC Criterion using Reinforcement Learning NEXTA 2020 Ján Čegiň Faculty of Informatics and Information Technologies Slovak Technical University, Karol Rástočný Faculty of Informatics and Information Technologies, Slovak University of Technology in Bratislava Link to publication DOI |
16:00 - 17:30 | Session: User-Interface Testing + ClosingNEXTA 2020 at D. Luis Chair(s): Kristian Wiklund Ericsson AB | ||
16:00 30mFull-paper | On the Industrial Applicability of Augmented Testing: An Empirical Study NEXTA 2020 Michel Nass Blekinge Institute of Technology, Emil Alégroth Blekinge Institute of Technology, Robert Feldt Chalmers University of Technology Link to publication DOI | ||
16:30 20mFull-paper | Session-Based Recommender Systems for Action Selection in GUI Test Generation NEXTA 2020 Link to publication DOI | ||
16:50 40mAwards | Award Ceremony -- Best Question Award; Best Presentation Award; Most influential tweet award NEXTA 2020 |
Accepted Papers
Call for Submissions
NEXTA solicits contributions targeting all aspects of test automation, from initial test design to automated verdict analysis. Topics of interest include, but are not limited to, the following:
- Test execution automation
- Test case generation
- Automatic test design generation
- Analytics, learning and big data in relation to test automation
- Automatic aspects management in test, progress, reporting, planning etc.
- Visualization of test
- Evolution of test automation
- Test suite architecture and infrastructure
- Test environment, simulation, and other contextual issues for automated testing
- Test tools, frameworks, and general support for test automation
- Testing in an agile and continuous integration context, and testing within DevOps
- Orchestration of test
- Metrics, benchmarks, and estimation on any type of test automation
- Any type of test technologies relying on automation of test
- Process improvements and assessments related to test automation
- Test automation maturity and experience reports on test automation
- Automatic retrieval of test data and test preparation aspect
- Maintainability, monitoring and refactoring of automated test suites
- Training and education on automated testing
- Automated test for product lines and high-variability systems
- Test automation patterns
- Automated test oracles
NEXTA accepts the following types of original papers
- Technical Papers (max. 8 pages in IEEE format) Full papers presenting research results or industrial practices related to the next generation of test automation.
- Tool Papers (max. 4 pages in IEEE format) Tool papers introduce tools that implement an approach to support the transition to the next generation of test automation. A tool paper submission must include either 1) a URL to a screencast of the tool in action, or 2) a runnable version of the tool for evaluation by the program committee.
- Position and Experience Papers (max. 4 pages in IEEE format) Short papers introducing challenges, visions, positions or preliminary results within the scope of the workshop. Experience reports and papers on open challenges in industry are especially welcome.
Authors should submit a PDF version of their paper through the NEXTA 2020 paper submission site: https://easychair.org/conferences/?conf=nexta2020. Note that all accepted papers will be part of the ICST joint workshop proceedings published in the IEEE Digital Library.