The Ineffectiveness of Domain-Specific Word Embedding Models for GUI Test Reuse
Reusing test cases across similar applications can significantly reduce testing effort and improve quality. Some recent approaches for automatically reusing Android GUI tests successfully exploit word embedding models to semantically match GUI events across applications. It is a common understanding that word embedding techniques trained on domain-specific corpora perform better on specialized tasks. Our recent study confirms this understanding in the context of test reuse. It shows that word embedding models trained with a corpus of the English descriptions of apps in the Google Play Store lead to a better semantic matching of Android GUI events. Motivated by this result, we hypothesize that we can further increase the effectiveness of semantic matching by partitioning the corpus of app descriptions into domain-specific corpora, obtaining a word embedding model for each domain-specific corpus and selecting the word embedding model most related to the apps considered for a test reuse task. We experimented with 240 configurations built with five general and domain-specific corpora. The experiments do not confirm our hypothesis. This paper sheds light on this unexpected negative result that contradicts the common understanding.
Tue 17 MayDisplayed time zone: Eastern Time (US & Canada) change
03:00 - 03:40 | Session 12: Search and Reuse: CodeResearch / Early Research Achievements (ERA) / Replications and Negative Results (RENE) at ICPC room Chair(s): Fuxiang Chen University of British Columbia | ||
03:00 7mTalk | CSRS: Code Search with Relevance Matching and Semantic Matching Research Media Attached | ||
03:07 4mTalk | Clone-based code method usage pattern mining Early Research Achievements (ERA) Zhipeng Xue National University of Defense Technology Media Attached | ||
03:11 7mTalk | Towards Exploring the Code Reuse from Stack Overflow during Software Development Research Yuan Huang School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China, Furen Xu School of Software Engineering, Sun Yat-sen University, Zhuhai 519082, China, Haojie Zhou School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China, Xiangping Chen Guangdong Key Laboratory for Big Data Analysis and Simulation of Public Opinion, School of Communication and Design, Sun Yat-sen University, Guangzhou 510006, China., Xiaocong Zhou School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China, Tong Wang School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China Pre-print Media Attached | ||
03:18 4mTalk | The Ineffectiveness of Domain-Specific Word Embedding Models for GUI Test Reuse Replications and Negative Results (RENE) Farideh Sadat Khalili Sharif University of Technology, Ali Mohebbi USI Lugano, Valerio Terragni University of Auckland, Mauro Pezze USI Lugano; Schaffhausen Institute of Technology, Leonardo Mariani University of Milano-Bicocca, Abbas Heydarnoori Sharif University of Technology Media Attached | ||
03:22 18mLive Q&A | Q&A-Paper Session 12 Research |