E2E-Loader: A Framework to Support Performance Testing of Web Applications
Performance testing is crucial to assess that Web Applications provide a good user experience under different workloads. A workload reproduces the interactions of a number of concurrent users with the system, to observe its actual behavior under stress. Defining meaningful workloads is a key challenge in performance testing, and many solutions have been proposed in the literature to support testers in this task, mostly based on analysing system logs describing real user behaviours. However, in our industrial and academic experience, we found that these solutions present some limitations, hindering the applicability and the productivity of performance testers. In particular, (I) they require the system under test to be actually deployed in order to collect real user behaviours; (II) they offer limited support to automated management of data dependencies; (III) they lack support for emerging protocols, such as WebSocket. In this paper, we present E2E-Loader, a novel approach to automate the design of performance testing workloads for web applications. E2E-Loader generates workloads by exploiting existing End-to-End functional test cases, and can be used at an early stage, before the system is deployed and actual user behaviours have been collected. Our solution features full WebSocket support, and includes a customizable heuristic to automatically detect data dependencies. We empirically evaluate the proposed approach on an industrial case study. Results are promising and show that the workloads generated with E2E-Loader are generally comparable to those that were manually crated by practitioners working with our industrial partner, while requiring a fraction of the time to be obtained. Finally, we make E2E-Loader and its source code publicly available for interested practitioners and researchers.
Wed 19 AprDisplayed time zone: Dublin change
14:00 - 15:40 | Session 14: Web TestingJournal-First Papers / Industry / Research Papers at Grand canal Chair(s): Thomas Laurent JSPS@National Institute of Informatics, Japan | ||
14:00 20mTalk | Challenges of End-to-End Testing with Selenium WebDriver and How to Face Them: A Survey Industry Maurizio Leotta DIBRIS, University of Genova, Italy, Boni Garcia Universidad Carlos III de Madrid, Filippo Ricca Università di Genova, Jim Whitehead University of California, Santa Cruz | ||
14:20 20mTalk | E2E-Loader: A Framework to Support Performance Testing of Web Applications Industry Ermanno Battista Fervento srl, Sergio Di Martino Università degli Studi di Napoli Federico II, Sergio Di Meglio Department of Electrical Engineering and Information Technology Università degli Studi di Napoli Federico II, Fabio Scippacercola Fervento srl, Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II | ||
14:40 20mTalk | Automated Web Application Testing driven by Pre-recorded Test Cases Journal-First Papers | ||
15:00 20mTalk | Robust web element identification for evolving applications by considering visual overlaps Research Papers Michel Nass Blekinge Institute of Technology, Riccardo Coppola Politecnico di Torino, Emil Alégroth Blekinge Institute of Technology, Robert Feldt Chalmers University of Technology, Sweden | ||
15:20 20mTalk | Automating Endurance Test for Flash-based Storage Devices in Samsung Electronics Industry Jinkook Kim Samsung Electronics Co., Minseok Jeon Korea University, Sejeong Jang Samsung Electronics Co., Hakjoo Oh Korea University |