Test Automation Process Improvement in a DevOps Team: Experience report
How to successfully conduct test automation process improvement (TAPI) for continuous development, consisting of iterative software development, continuous testing, and delivery, is the challenge faced by many software organizations. In this paper, we present an experience report on TAPI in one DevOps team in F-Secure (a Finnish software company). The team builds Windows application software and exists in F-Secure’s TAPI culture. The team self-reports high satisfaction and maturity in test automation for continuous development. To study their TAPI, we reviewed a collection of experience notes, team reflection reports and telemetry result reports. Then several meetings were held to discuss the details. We found that based on the understanding of the team, test automation maturity for continuous development is defined as a set of indicators, e.g., the increasing speed to release, improving the productivity of the team, high test efficiency. Second, the team indicated that a set of critical success factors have a major impact on successfully carrying out its TAPI, e.g., incremental approach, the whole team effort, test tool choice and architecture, telemetry. Third, we compare the TAPI practices in the observed team with the practices described in prior literature. The team believes that the existing test automation maturity approaches should include the identified practices like the whole team effort to build a more comprehensive test automation improvement model for the software industry.
Sat 24 OctDisplayed time zone: Lisbon change
09:00 - 10:30 | Welcome + Session: Process ImprovementNEXTA 2020 at D. Luis Chair(s): Pasqualina Potena RISE Research Institutes of Sweden AB | ||
09:00 15mDay opening | Welcome address and practical arrangements NEXTA 2020 | ||
09:15 30mFull-paper | Test Automation Process Improvement in a DevOps Team: Experience report NEXTA 2020 Link to publication DOI | ||
09:45 20mShort-paper | Test Automation Challenges for Application Landscape Frameworks NEXTA 2020 Nils Wild Research Group Software Construction RWTH Aachen University, Horst Lichter RWTH Aachen University, Peter Kehren Research Group Software Construction RWTH Aachen University Link to publication DOI | ||
10:05 20mFull-paper | Test Automation Improvement Model - TAIM 2.0 NEXTA 2020 Sigrid Eldh Ericsson Link to publication DOI |