Ex pede Herculem: Augmenting Activity Transition Graph for Apps via Graph Convolution Network
Mobile apps are indispensable for people’s daily life. With the increase of GUI functions, apps become more complex and diverse. As the Android app is event-driven, Activity Transition Graph (ATG) becomes an important way of app abstract and graphical user interface (GUI) modeling. Although existing works provide static and dynamic analysis to build ATG for applications, the completeness of ATG obtained is poor due to the low coverage of these techniques. To tackle this challenge, we propose a novel approach, ArchiDroid, to automatically augment the ATG via graph convolution network. It models both the semantics of activities and the graph structure of activity transitions to predict the transition between activities based on the seed ATG extracted by static analysis. The evaluation demonstrates that ArchiDroid can achieve 86% precision and 94% recall in predicting the transition between activities for augmenting ATG. We further apply the augmented ATG in two downstream tasks, i.e., guidance in automated GUI testing and assistance in app function design. Results show that the automated GUI testing tool integrated with ArchiDroid achieves 43% more activity coverage and detects 208% more bugs. Besides, ArchiDroid can predict the missing transition with 85% accuracy in real-world apps for assisting the app function design, and an interview case study further demonstrates its usefulness.
Fri 19 MayDisplayed time zone: Hobart change
11:00 - 12:30 | Reverse engineeringTechnical Track / Journal-First Papers / SEIP - Software Engineering in Practice at Meeting Room 104 Chair(s): Wei Le Iowa State University | ||
11:00 15mTalk | SeeHow: Workflow Extraction from Programming Screencasts through Action-Aware Video Analytics Technical Track Dehai Zhao Australian National University, Australia, Zhenchang Xing , Xin Xia Huawei, Deheng Ye Tencent AI Lab, Xiwei (Sherry) Xu CSIRO’s Data61, Liming Zhu CSIRO’s Data61 | ||
11:15 15mTalk | AidUI: Toward Automated Recognition of Dark Patterns in User Interfaces Technical Track S M Hasan Mansur George Mason University, Sabiha Salma George Mason University, Damilola Awofisayo Duke University, Kevin Moran George Mason University | ||
11:30 15mTalk | Carving UI Tests to Generate API Tests and API Specification Technical Track Rahulkrishna Yandrapally University of British Columbia, Canada, Saurabh Sinha IBM Research, Rachel Tzoref-Brill IBM Research, Ali Mesbah University of British Columbia (UBC) Pre-print | ||
11:45 15mTalk | CFG2VEC: Hierarchical Graph Neural Network for Cross-Architectural Software Reverse Engineering SEIP - Software Engineering in Practice Shih-Yuan Yu UCI, Yonatan Achamyeleh UCI, Chonghan Wang UCI, Anton Kocheturov Siemens Technology, Patrick Eisen Siemens Technology, Mohammad Al Faruque UCI | ||
12:00 15mTalk | Ex pede Herculem: Augmenting Activity Transition Graph for Apps via Graph Convolution Network Technical Track Zhe Liu Institute of Software, Chinese Academy of Sciences, Chunyang Chen Monash University, Junjie Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Yuhui Su Institute of Software, Chinese Academy of Sciences, Yuekai Huang Institute of Software, Chinese Academy of Sciences, Jun Hu Institute of Software, Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences | ||
12:15 7mTalk | VID2XML: Automatic Extraction of a Complete XML Data from Mobile Programming Screencasts Journal-First Papers Mohammad D. Alahmadi Department of Software Engineering, College of Computer Science and Engineering, University of Jeddah, Jeddah, Saudi Arabia. |