Fostering the Diversity of Exploratory Testing in Web Applications
Mon 26 Oct 2020 21:45 - 22:15 at Infante - RT6 - Web Testing Chair(s): Fabiano Ferrari
Exploratory testing (ET) is a software testing approach that complements automated testing by leveraging business expertise. It has gained momentum over the last decades as it appeals testers to exploit their business knowledge to stress the system under test (SUT). Exploratory tests, unlike automated tests, are defined and executed on-the-fly by testers. Testers who perform exploratory tests may be biased by their past experience and therefore may miss anomalies or unusual interactions proposed by the SUT. This is even more complex in the context of web applications, which typically expose a huge number of interaction paths to their users. As testers of these applications cannot remember all the sequences of interactions they performed, they may fail to deeply explore the application scope. This paper therefore introduces a new approach to assist testers in widely exploring any web application. In particular, our approach monitors the online interactions performed by the testers to suggest in real-time the probabilities of performing next interactions. Looking at these probabilities, we claim that the testers who favour interactions that have a low probability (because they were rarely performed), will increase the diversity of their explorations. Our approach defines a prediction model, based on n-grams, that encodes the history of past interactions and that supports the estimation of the probabilities. Integrated within a web browser extension, it automatically and transparently injects feedback within the application itself. We conduct a controlled experiment and a qualitative study to assess our approach. Results show that it prevents testers to be trapped in already tested loops, and succeeds to assist them in performing deeper explorations of the SUT.
Mon 26 OctDisplayed time zone: Lisbon change
10:45 - 12:15 | RT6 - Web TestingResearch Papers at Infante +11h Chair(s): José Campos University of Lisbon, Portugal | ||
10:45 30mTalk | Fostering the Diversity of Exploratory Testing in Web Applications Research Papers Julien Leveau LaBRI, Xavier Blanc LaBRI, Laurent Réveillère LaBRI, Jean-Rémy Falleri Bordeaux INP, Romain Rouvoy Univ. Lille / Inria / IUF Link to publication DOI | ||
11:15 30mTalk | Dependency-Aware Web Test Generation Research Papers Matteo Biagiola Fondazione Bruno Kessler (FBK), Andrea Stocco Università della Svizzera italiana (USI), Filippo Ricca Università di Genova, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
11:45 30mTalk | Metamorphic Security Testing for Web Systems Research Papers Phu X. Mai University of Luxembourg, Fabrizio Pastore University of Luxembourg, Arda Goknil SnT, University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI |
21:45 - 23:15 | RT6 - Web TestingResearch Papers at Infante Chair(s): Fabiano Ferrari Federal University of São Carlos | ||
21:45 30mTalk | Fostering the Diversity of Exploratory Testing in Web Applications Research Papers Julien Leveau LaBRI, Xavier Blanc LaBRI, Laurent Réveillère LaBRI, Jean-Rémy Falleri Bordeaux INP, Romain Rouvoy Univ. Lille / Inria / IUF Link to publication DOI | ||
22:15 30mTalk | Dependency-Aware Web Test Generation Research Papers Matteo Biagiola Fondazione Bruno Kessler (FBK), Andrea Stocco Università della Svizzera italiana (USI), Filippo Ricca Università di Genova, Paolo Tonella Università della Svizzera Italiana (USI) Link to publication DOI | ||
22:45 30mTalk | Metamorphic Security Testing for Web Systems Research Papers Phu X. Mai University of Luxembourg, Fabrizio Pastore University of Luxembourg, Arda Goknil SnT, University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI |