ITEQS 2020
Sat 24 Oct 2020 Porto, Portugal
co-located with ICST 2020
Sat 24 Oct 2020 09:30 - 10:00 at São João - Session I Chair(s): Mehrdad Saadatmand

We present a novel exploratory performance testing algorithm that uses supervised learning to optimize the test suite generation process. The goal of the proposed approach is to generate test suites that contain a large number of positive tests, revealing performance defects or other issues of interest in the system under test. The key idea is to use a deep neural network to predict which test could be positive and to train this network online during the test generation process, designing and executing the test suite simultaneously. The proposed algorithm assumes that the system under test is stateless and the outcome of the tests is deterministic. Also, only integer and floating point inputs are supported. Otherwise, the approach is completely automatic and it does not require any prior knowledge about the internals of the system under test. It can also be used effectively in a continuous integration setting where small variations of a system are tested successively. We evaluate our algorithm using two example problems: searching for bottlenecks in a web service and searching for efficient hardware configurations in a single-board computer. In both examples, the presented algorithm performed several times better than a random test generator and significantly better compared to our previously published algorithm, producing test suites with a large proportion of positive tests.

Sat 24 Oct

Displayed time zone: Lisbon change

09:15 - 10:30
Session IITEQS 2020 at São João
Chair(s): Mehrdad Saadatmand RISE Research Institutes of Sweden

ITEQS 2020 is held as a virtual workshop via Zoom. Contact iteqs2020@easychair.org for the details.

09:15
15m
Day opening
Welcome and opening message
ITEQS 2020

09:30
30m
Full-paper
Automatic exploratory performance testing using a discriminator neural network
ITEQS 2020
Ivan Porres Åbo Akademi University, Tanwir Ahmad Åbo Akademi University, Hergys Rexha Åbo Akademi University, Sebastien Lafond Åbo Akademi University, Dragos Truscan Åbo Akademi University
Link to publication DOI
10:00
30m
Full-paper
Performance Evaluation of Container's Shared Volumes
ITEQS 2020
Naylor Garcia University of São Paulo - USP, Paulo Sergio Lopes de Souza University of São Paulo - USP, Sarita M. Bruschi University of São Paulo - USP, Simone do Rocio Senger de Souza University of São Paulo - USP
Link to publication DOI