Repairing Fragile GUI Test Cases Using Word and Layout Embedding
Smartphone vendors apply both device and brand-specific customisations to the underlying operating systems, resulting in a wide range of device configurations. It is crucial that all of the device variations provide compatibility with the default version of the underlying operating system, such as Android. To ensure that widely and commonly used apps run on each of these device variations without any problem, vendors depend on automated GUI level testing of widely and commonly used apps: the failure of a GUI test script that emulates a routine usage of these apps would raise an alarm that a recent change made to a specific device variation may have caused a regression fault. These GUI level compatibility smoke tests are unique in the sense that they are GUI level automated test scripts that are written outside the software development life cycle of the target apps: they are written and maintained by the engineers of the smartphone vendors, and not the app developers. As such, these test scripts are extra vulnerable to the fragility of GUI test scripts, which are already known to be fragile when maintained by app developers. This paper introduces a repair technique for View Identification Failures (VIFs) in those smoke tests so that the smartphone vendors can quickly update their GUI test scripts when they break due to changed view ids. Our technique matches view ids between old and new versions of the target app based on various similarity metrics such as the semantic embedding similarity between ids and GUI labels, and layout similarity based on node embeddings of the GUI layout tree. We evaluate the proposed technique using 512 VIFs collected from real-world Android mobile apps. The proposed technique can repair 72 % of the 512 studied VIFs with only one attempt, compared to 28 % repaired using lexical distance-based matching.
Mon 17 AprDisplayed time zone: Dublin change
16:00 - 18:00 | Session 6: GUI/API testingTesting Tools / Previous Editions / Research Papers / Posters at Pearse suite Chair(s): Phil McMinn University of Sheffield | ||
16:00 20mTalk | Repairing Fragile GUI Test Cases Using Word and Layout Embedding Previous Editions Juyeon Yoon Korea Advanced Institute of Science and Technology, Seungjun Chung , Kihyuck Shin Samsung Electronics, Jinhan Kim KAIST, Shin Hong Handong Global University, Shin Yoo KAIST DOI | ||
16:20 20mTalk | RIDA: Cross-App Record and Replay for Android Research Papers Jiayuan Liang Southern University of Science and Technology, Sinan Wang Southern University of Science and Technology, Xiangbo Deng Southern University of Science and Technology, Yepang Liu Southern University of Science and Technology | ||
16:40 20mTalk | EMB: A Curated Corpus of Web/Enterprise Applications And Library Support for Software Testing Research Testing Tools Andrea Arcuri Kristiania University College and Oslo Metropolitan University, Man Zhang Kristiania University College, Norway, Amid Golmohammadi Kristiania University College, Asma Belhadi Kristiania University College, Juan Pablo Galeotti University of Buenos Aires, Bogdan Marculescu Kristiania University College, Norway, Susruthan Seran Kristiania University College | ||
17:00 20mTalk | LatteArt: A Platform for Recording and Analyzing Exploratory Testing Testing Tools | ||
17:20 20mTalk | POWER: Program Option-Aware Fuzzer for High Bug Detection Ability Previous Editions DOI | ||
17:40 5mTalk | Poster: Link between Bias, Node Sensitivity and Long-Tail Distribution in trained DNNs Posters |