Automated Visual Testing for Mobile Apps in an Industrial Setting
Thu 12 May 2022 22:00 - 22:05 at ICSE room 4-even hours - Software Testing 10 Chair(s): Xiao Qu
User Interface (UI) testing has become a common practice for quality assurance of industrial mobile applications (in short as apps). While many automated tools have been developed, they often do not satisfy two major industrial requirements that make a tool desirable in industrial settings: compatibility across platforms (e.g., AliOS, Android, iOS, and Harmony OS) and capability to handle apps with non-standard UI elements (whose internal structures cannot be acquired using platform system APIs). Toward addressing these industrial requirements, automated visual testing emerges to take only device screenshots as input in order to support automated test generation. In this paper, we report our experiences of developing and deploying VTEST, our industrial visual testing framework to assure high quality of Taobao, a highly-popular industrial app with about \textit{one billion} monthly active users. VTEST includes carefully designed techniques and infrastructure support, outperforming Monkey (which has been popularly deployed in industry and shown to perform superiorly or similarly compared to state-of-the-art tools) with 87.6% more activity coverage. VTEST has been deployed both internally in Alibaba and externally in the Software Green Alliance to provide testing services for the Top 500 most popular industrial apps in China. We summarize five major lessons learned from developing and deploying VTEST.
Thu 12 MayDisplayed time zone: Eastern Time (US & Canada) change
03:00 - 04:00 | Software Testing 4Technical Track / Journal-First Papers / SEIP - Software Engineering in Practice at ICSE room 5-odd hours Chair(s): Aldeida Aleti Monash University | ||
03:00 5mTalk | Mutation Analysis for Cyber-Physical Systems: Scalable Solutions and Results in the Space Domain Journal-First Papers Oscar Cornejo SnT Centre, University of Luxembourg, Fabrizio Pastore University of Luxembourg, Lionel Briand University of Luxembourg; University of Ottawa Link to publication DOI Pre-print Media Attached | ||
03:05 5mTalk | Automated Visual Testing for Mobile Apps in an Industrial Setting SEIP - Software Engineering in Practice Dezhi Ran Peking University, Zongyang Li Peking University, Chenxu Liu Peking University, Wenyu Wang University of Illinois Urbana-Champaign, Weizhi Meng Alibaba Group, Xionglin Wu Alibaba Group, Hui Jin Alibaba Group, Jing Cui Alibaba Group, Xing Tang Alibaba Group, Tao Xie Peking University DOI Pre-print | ||
03:10 5mTalk | FADATest: Fast and Adaptive Performance Regression Testing of Dynamic Binary Translation Systems Technical Track Jin Wu Harbin Institute of Technology, Jian Dong Harbin Institute Of Technology, Ruili Fang University of Georgia, Wen Zhang University of Georgia, Wenwen Wang University of Georgia, Decheng Zuo Harbin Institute of Technology Pre-print Media Attached | ||
03:15 5mTalk | Repairing Order-Dependent Flaky Tests via Test Generation Technical Track Chengpeng Li University of Texas at Austin, Chenguang Zhu University of Texas at Austin, Wenxi Wang University of Texas at Austin, August Shi University of Texas at Austin Link to publication DOI Media Attached | ||
03:20 5mTalk | Controlled Concurrency Testing via Periodical Scheduling Technical Track Cheng Wen Xidian University, Mengda He SCEDT, Teesside University, Bohao Wu CSSE, Shenzhen University, Zhiwu Xu Shenzhen University, Shengchao Qin Huawei Hong Kong Research Centre, China DOI Pre-print Media Attached | ||
03:25 5mTalk | BeDivFuzz: Integrating Behavioral Diversity into Generator-based Fuzzing Technical Track Pre-print Media Attached | ||
22:00 - 23:00 | Software Testing 10Technical Track / SEIP - Software Engineering in Practice at ICSE room 4-even hours Chair(s): Xiao Qu ABB Corporate Research | ||
22:00 5mTalk | Automated Visual Testing for Mobile Apps in an Industrial Setting SEIP - Software Engineering in Practice Dezhi Ran Peking University, Zongyang Li Peking University, Chenxu Liu Peking University, Wenyu Wang University of Illinois Urbana-Champaign, Weizhi Meng Alibaba Group, Xionglin Wu Alibaba Group, Hui Jin Alibaba Group, Jing Cui Alibaba Group, Xing Tang Alibaba Group, Tao Xie Peking University DOI Pre-print | ||
22:05 5mTalk | Use of Test Doubles in Android Testing: An In-Depth Investigation Technical Track Mattia Fazzini University of Minnesota, Chase Choi University of Minnesota, Juan Manuel Copia IMDEA Software Institute, Gabriel Lee University of Minnesota, Yoshiki Kakehi Georgia Institute of Technology, Alessandra Gorla IMDEA Software Institute, Alessandro Orso Georgia Tech Pre-print Media Attached | ||
22:10 5mTalk | Inference and Test Generation Using Program Invariants in Chemical Reaction Networks Technical Track Michael C. Gerten Iowa State University, Alexis L. Marsh Iowa State University, James I. Lathrop Iowa State University, Myra Cohen Iowa State University, Andrew S. Miner Iowa State University, Titus H. Klinge Drake University DOI Pre-print Media Attached | ||
22:15 5mTalk | Controlled Concurrency Testing via Periodical Scheduling Technical Track Cheng Wen Xidian University, Mengda He SCEDT, Teesside University, Bohao Wu CSSE, Shenzhen University, Zhiwu Xu Shenzhen University, Shengchao Qin Huawei Hong Kong Research Centre, China DOI Pre-print Media Attached | ||
22:20 5mTalk | SymTuner: Maximizing the Power of Symbolic Execution by Adaptively Tuning External ParametersDistinguished Paper Award Technical Track Sooyoung Cha Sungkyunkwan University, Myungho Lee Korea University, Seokhyun Lee Korea University, South Korea, Hakjoo Oh Korea University Pre-print Media Attached | ||
22:25 5mTalk | Path Transitions Tell More: Optimizing Fuzzing Schedules via Runtime Program States Technical Track Kunpeng Zhang Tsinghua Shenzhen International Graduate School, Tsinghua University, Xi Xiao Tsinghua Shenzhen International Graduate School, Tsinghua University, Xiaogang Zhu Swinburne University of Technology, Ruoxi Sun The University of Adelaide, Minhui (Jason) Xue University of Adelaide, Sheng Wen Swinburne University of Technology DOI Pre-print Media Attached | ||