Automated Performance Testing Based on Active Deep Learning
Generating test cases that can reveal performance issues in large and complex software systems within a reasonable amount of time is a challenging task. On one hand, there are numerous combinations of input data values to explore. On the other hand, we have a limited test budget to execute test cases. What makes this task even more difficult is the lack of access to source code and the internal details of these systems.In this paper, we present an automated test case generation method called ACTA for black-box performance testing. ACTA is based on active learning, which means that it does not require a large set of historical test data to learn about the performance characteristics of the system under test. Instead, it dynamically chooses the test cases to execute using uncertainty sampling. ACTA relies on a conditional variant of generative adversarial networks, and facilitates specifying performance requirements in terms of some conditions and generating test cases that address those conditions. We have evaluated ACTA on a benchmark web application, and the experimental results indicate that this method is comparable with random testing, and two other machine learning methods, i.e. PerfXRL and DN.
Thu 20 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
12:00 - 13:15 | |||
12:00 30mLong-paper | Automatic Property-based Testing of GraphQL APIs AST 2021 Stefan Karlsson ABB AB, Mälardalen University, Adnan Causevic Mälardalen University, Daniel Sundmark Mälardalen University Pre-print Media Attached | ||
12:30 30mLong-paper | Automated Performance Testing Based on Active Deep Learning AST 2021 Ali Sedaghatbaf RISE Research Institutes of Sweden, Mahshid Helali Moghadam RISE Research Institutes of Sweden , Mehrdad Saadatmand RISE Research Institutes of Sweden Pre-print Media Attached | ||
13:00 15mShort-paper | Towards exhaustive branch coverage with PathCrawler AST 2021 Nicky Williams CEA - LIST Pre-print Media Attached |
Go directly to this room on Clowdr