Automatic Creation of Acceptance Tests by Extracting Conditionals from Requirements: NLP Approach and Case Study
Acceptance testing is crucial to determine whether a system fulfills end-user requirements. However, the creation of acceptance tests is a laborious task entailing two major challenges: (1) practitioners need to determine the right set of test cases that fully covers a requirement, and (2) they need to create test cases manually due to insufficient tool support. Existing approaches for automatically deriving test cases require semi-formal or even formal notations of requirements, though unrestricted natural language is prevalent in practice. In this paper, we present our tool-supported approach CiRA (Conditionals in Requirements Artifacts) capable of creating the minimal set of required test cases from conditional statements in informal requirements. We demonstrate the feasibility of CiRA in a case study with three industry partners. In our study, out of 578 manually created test cases, 71.8 % can be generated automatically. Additionally, CiRA discovered 80 relevant test cases that were missed in manual test case design. CiRA is publicly available at www.cira.bth.se/demo/.
Tue 18 AprDisplayed time zone: Dublin change
14:00 - 15:30 | Session 11: Test GenerationJournal-First Papers / Previous Editions / Research Papers / Tool Demo at Pearse suite Chair(s): Gregory Gay Chalmers | University of Gothenburg | ||
14:00 20mTalk | Automatic Creation of Acceptance Tests by Extracting Conditionals from Requirements: NLP Approach and Case Study Journal-First Papers Jannik Fischbach Netlight GmbH / fortiss GmbH, Julian Frattini Blekinge Institute of Technology, Andreas Vogelsang University of Cologne, Daniel Mendez Blekinge Institute of Technology, Michael Unterkalmsteiner Blekinge Institute of Technology, Andreas Wehrle Allianz Deutschland AG, Pablo Restrepo Henao Technical University of Munich, Parisa Yousefi Ericsson, Tedi Juricic Ericsson, Jeannette Radduenz Allianz Deutschland, Carsten Wiecher Kostal Automobil Elektrik GmbH & Co. KG | ||
14:20 20mTalk | Scaling Test Case Generation For Expressive Decision Tables Previous Editions Supriya Agrawal Tata Consultancy Services Ltd. (TCS), R. Venkatesh , Ulka Shrotri Tata Consultancy Services Ltd. (TCS), Amey Zare TCS Research, Sagar Verma Tata Consultancy Services Ltd. (TCS) DOI | ||
14:40 20mTalk | Spectacular: Finding Laws from 25 Trillion Programs Research Papers Matthías Páll Gissurarson Chalmers University of Technology, Sweden, Diego Roque Dark Forest Technologies, James Koppel Massachusetts Institute of Technology, USA | ||
15:00 20mTalk | Pairwise Testing Revisited for Structured Data With Constraints Research Papers | ||
15:20 10mTalk | RICK: Generating Mocks from Production Data Tool Demo Deepika Tiwari KTH Royal Institute of Technology, Martin Monperrus KTH Royal Institute of Technology, Benoit Baudry KTH |