NEXTA 2020
Sat 24 Oct 2020 Porto, Portugal
co-located with ICST 2020

Test automation has been an acknowledged software engineering best practice for years. However, the topic involves more than the repeated execution of test cases that often comes first to mind. Simply running test cases using a unit testing framework is no longer enough for test automation to keep up with the ever-shorter release cycles driven by continuous deployment and technological innovations such as microservices and DevOps pipelines. Now test automation needs to rise to the next level by going beyond mere test execution. The NEXTA workshop will explore how to advance test automation to further contribute to software quality in the context of tomorrow’s rapid release cycles. Take-aways for industry practitioners and academic researchers will encompass test case generation, automated test result analysis, test suite assessment and maintenance, and infrastructure for the future of test automation.

All information about this workshop can be found at the workshop’s official website: https://www.testomatproject.eu/nexta2020.

You're viewing the program in a time zone which is different from your device's time zone - change time zone

Sat 24 Oct

Displayed time zone: Lisbon change

09:00 - 10:30
Welcome + Session: Process ImprovementNEXTA 2020 at D. Luis
Chair(s): Pasqualina Potena RISE Research Institutes of Sweden AB
09:00
15m
Day opening
Welcome address and practical arrangements
NEXTA 2020

09:15
30m
Full-paper
Test Automation Process Improvement in a DevOps Team: Experience report
NEXTA 2020
Yuqing Wang University of Oulu, Maaret Pyhäjärvi F-Secure, Mika Mäntylä University of Oulu
Link to publication DOI
09:45
20m
Short-paper
Test Automation Challenges for Application Landscape Frameworks
NEXTA 2020
Nils Wild Research Group Software Construction RWTH Aachen University, Horst Lichter RWTH Aachen University, Peter Kehren Research Group Software Construction RWTH Aachen University
Link to publication DOI
10:05
20m
Full-paper
Test Automation Improvement Model - TAIM 2.0
NEXTA 2020
Sigrid Eldh Ericsson
Link to publication DOI
11:00 - 12:30
Session: OptimisationNEXTA 2020 at D. Luis
Chair(s): Adnan Causevic Mälardalen University
11:00
30m
Full-paper
Optimization of automated executions based on integration test configurations of embedded software
NEXTA 2020
Masashi Mizoguchi Hitachi Ltd., Takahiro Iida Hitachi Automotive Systems Ltd., Toru Irie Hitachi Automotive Systems Ltd.
Link to publication DOI
11:30
30m
Full-paper
Selective Regression Testing based on Big Data: Comparing Feature Extraction Techniques
NEXTA 2020
Khaled Al-Sabbagh University of Gothenburg, Miroslaw Staron University of Gothenburg, Regina Hebig Chalmers | Gothenburg University, Miroslaw Ochodek Poznan University of Technology, Wilhelm Meding Ericsson
Link to publication DOI
12:00
20m
Full-paper
Runtime Prioritization with the Classification Tree Method for Test Automation
NEXTA 2020
Barbara Jung Expleo Germany, Peter M. Kruse Expleo Group
Link to publication DOI
14:00 - 15:30
Session: Test GenerationNEXTA 2020 at D. Luis
Chair(s): Serge Demeyer University of Antwerp, Belgium
14:00
30m
Full-paper
Optimizing the Parameters of an Evolutionary Algorithm for Fuzzing and Test Data Generation
NEXTA 2020
Ralf Gerlich Dr. Rainer Gerlich System and Software Engineering, Christian R. Prause German Aerospace Center - Space Administration
Link to publication DOI
14:30
30m
Full-paper
Boundary Value Exploration for Software Analysis
NEXTA 2020
Felix Dobslaw Chalmers University of Technology, Francisco Gomes Chalmers | University of Gothenburg, Robert Feldt Chalmers University of Technology
Link to publication DOI
15:00
20m
Short-paper
Test Data Generation for MC/DC Criterion using Reinforcement Learning
NEXTA 2020
Ján Čegiň Faculty of Informatics and Information Technologies Slovak Technical University, Karol Rástočný Faculty of Informatics and Information Technologies, Slovak University of Technology in Bratislava
Link to publication DOI
16:00 - 17:30
Session: User-Interface Testing + ClosingNEXTA 2020 at D. Luis
Chair(s): Kristian Wiklund Ericsson AB
16:00
30m
Full-paper
On the Industrial Applicability of Augmented Testing: An Empirical Study
NEXTA 2020
Michel Nass Blekinge Institute of Technology, Emil Alégroth Blekinge Institute of Technology, Robert Feldt Chalmers University of Technology
Link to publication DOI
16:30
20m
Full-paper
Session-Based Recommender Systems for Action Selection in GUI Test Generation
NEXTA 2020
Varun Nayak ReTest GmbH, Daniel Kraus ReTest GmbH
Link to publication DOI
16:50
40m
Awards
Award Ceremony -- Best Question Award; Best Presentation Award; Most influential tweet award
NEXTA 2020

Call for Submissions

NEXTA solicits contributions targeting all aspects of test automation, from initial test design to automated verdict analysis. Topics of interest include, but are not limited to, the following:

  • Test execution automation
  • Test case generation
  • Automatic test design generation
  • Analytics, learning and big data in relation to test automation
  • Automatic aspects management in test, progress, reporting, planning etc.
  • Visualization of test
  • Evolution of test automation
  • Test suite architecture and infrastructure
  • Test environment, simulation, and other contextual issues for automated testing
  • Test tools, frameworks, and general support for test automation
  • Testing in an agile and continuous integration context, and testing within DevOps
  • Orchestration of test
  • Metrics, benchmarks, and estimation on any type of test automation
  • Any type of test technologies relying on automation of test
  • Process improvements and assessments related to test automation
  • Test automation maturity and experience reports on test automation
  • Automatic retrieval of test data and test preparation aspect
  • Maintainability, monitoring and refactoring of automated test suites
  • Training and education on automated testing
  • Automated test for product lines and high-variability systems
  • Test automation patterns
  • Automated test oracles

NEXTA accepts the following types of original papers

  • Technical Papers (max. 8 pages in IEEE format) Full papers presenting research results or industrial practices related to the next generation of test automation.
  • Tool Papers (max. 4 pages in IEEE format) Tool papers introduce tools that implement an approach to support the transition to the next generation of test automation. A tool paper submission must include either 1) a URL to a screencast of the tool in action, or 2) a runnable version of the tool for evaluation by the program committee.
  • Position and Experience Papers (max. 4 pages in IEEE format) Short papers introducing challenges, visions, positions or preliminary results within the scope of the workshop. Experience reports and papers on open challenges in industry are especially welcome.

Authors should submit a PDF version of their paper through the NEXTA 2020 paper submission site: https://easychair.org/conferences/?conf=nexta2020. Note that all accepted papers will be part of the ICST joint workshop proceedings published in the IEEE Digital Library.

Accepted Papers

Title
Boundary Value Exploration for Software Analysis
NEXTA 2020
Link to publication DOI
On the Industrial Applicability of Augmented Testing: An Empirical Study
NEXTA 2020
Link to publication DOI
Optimization of automated executions based on integration test configurations of embedded software
NEXTA 2020
Link to publication DOI
Optimizing the Parameters of an Evolutionary Algorithm for Fuzzing and Test Data Generation
NEXTA 2020
Link to publication DOI
Runtime Prioritization with the Classification Tree Method for Test Automation
NEXTA 2020
Link to publication DOI
Selective Regression Testing based on Big Data: Comparing Feature Extraction Techniques
NEXTA 2020
Link to publication DOI
Session-Based Recommender Systems for Action Selection in GUI Test Generation
NEXTA 2020
Link to publication DOI
Test Automation Challenges for Application Landscape Frameworks
NEXTA 2020
Link to publication DOI
Test Automation Improvement Model - TAIM 2.0
NEXTA 2020
Link to publication DOI
Test Automation Process Improvement in a DevOps Team: Experience report
NEXTA 2020
Link to publication DOI
Test Data Generation for MC/DC Criterion using Reinforcement Learning
NEXTA 2020
Link to publication DOI