Automated model-based test generation presents a viable alternative to the costly manual test creation currently employed for regression testing of web apps. However, existing model inference techniques rely on threshold-based whole-page comparison to establish state equivalence, which cannot reliably identify near-duplicate web pages in modern web apps. Consequently, existing techniques produce inadequate models for dynamic web apps, and fragile test oracles, rendering the generated regression test suites ineffective. We propose a model-based test generation technique, FRAGGEN, that eliminates the need for thresholds, by employing a novel state abstraction based on page fragmentation to establish state equivalence. FRAGGEN also uses fine-grained page fragment analysis to diversify state exploration and generate reliable test oracles. Our evaluation shows that FRAGGEN outperforms existing whole-page techniques by detecting more near-duplicates, inferring better web app models and generating test suites that are better suited for regression testing. On a dataset of 86,165 state-pairs, FRAGGEN detected 123% more near-duplicates on average compared to whole-page techniques. The crawl models inferred by FRAGGEN have 62% more precision and 70% more recall on average. FRAGGEN also generates reliable regression test suites with test actions that have nearly 100% success rate on the same version of the web app even if the execution environment is varied. The test oracles generated by FRAGGEN can detect 98.7% of the visible changes in web pages while being highly robust, making them suitable for regression testing.
Thu 18 MayDisplayed time zone: Hobart change
11:00 - 12:30 | Testing of mobile, web and gamesTechnical Track / DEMO - Demonstrations / Journal-First Papers / SEIP - Software Engineering in Practice at Meeting Room 109 Chair(s): Wei Yang University of Texas at Dallas | ||
11:00 15mTalk | Fill in the Blank: Context-aware Automated Text Input Generation for Mobile GUI Testing Technical Track Zhe Liu Institute of Software, Chinese Academy of Sciences, Chunyang Chen Monash University, Junjie Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Xing Che Institute of Software, Chinese Academy of Sciences, Yuekai Huang Institute of Software, Chinese Academy of Sciences, Jun Hu Institute of Software, Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences Pre-print | ||
11:15 15mTalk | Detecting Dialog-Related Keyboard Navigation Failures in Web Applications Technical Track Paul T. Chiou University of Southern California, Ali S. Alotaibi University of Southern California, William G.J. Halfond University of Southern California | ||
11:30 15mTalk | COLUMBUS: Android App Testing Through Systematic Callback Exploration Technical Track Priyanka Bose University of California, Santa Barbara, Dipanjan Das University of California, Santa Barbara, Saastha Vasan University of California, Santa Barbara, Sebastiano Mariani VMware, Inc., Ilya Grishchenko University of California, Santa Barbara, Andrea Continella University of Twente, Antonio Bianchi Purdue University, Christopher Kruegel University of California, Santa Barbara, Giovanni Vigna UC Santa Barbara | ||
11:45 15mTalk | GameRTS: A Regression Testing Framework for Video Games Technical Track Jiongchi Yu Singapore Management University, Singapore, Yuechen Wu Fuxi AI Lab, Netease Inc., China, Xiaofei Xie Singapore Management University, Wei Le Iowa State University, Lei Ma University of Alberta, Yingfeng Chen Fuxi AI Lab of Netease, Yujing Hu Fuxi AI Lab, Netease Inc., China, Fan Zhang Zhejiang University, China | ||
12:00 15mTalk | Widget Detection-based Testing for Industrial Mobile Games SEIP - Software Engineering in Practice Xiongfei Wu Kyushu University, Jiaming Ye Kyushu University, Ke Chen Fuxi AI Lab of Netease, Xiaofei Xie Singapore Management University, Yujing Hu Fuxi AI Lab, Netease Inc., China, Ruochen Huang University of Alberta, Lei Ma University of Alberta, Jianjun Zhao Kyushu University | ||
12:15 7mTalk | AVGUST: A Tool for Generating Usage-Based Tests from Videos of App Executions DEMO - Demonstrations Saghar Talebipour University of Southern California, Hyojae Park Sharon High School, Kesina Baral George Mason University, Leon Yee Valley Christian High School, Safwat Ali Khan George Mason University, Kevin Moran George Mason University, Yuriy Brun University of Massachusetts, Nenad Medvidović University of Southern California, Yixue Zhao Information Sciences Institute Pre-print Media Attached | ||
12:22 7mTalk | Fragment-Based Test Generation For Web Apps Journal-First Papers Rahulkrishna Yandrapally University of British Columbia, Canada, Ali Mesbah University of British Columbia (UBC) Link to publication Pre-print |