VID2XML: Automatic Extraction of a Complete XML Data from Mobile Programming Screencasts
Developers often refer to video-hosting online platforms to find screencasts that provide a step-by-step guide to help them solve a programming task at hand or learn a new concept. More specifically, developers search for resources that help them design and implement effective mobile graphical user interfaces (GUI) using XML. Although mobile programming screencasts contain a vast amount of XML data at developers’ disposal, they cannot be easily found and copied-pasted due to the image nature of videos. Given that the most common task developers perform online is copy-pasting, mobile programming screencasts must support that and be complemented with XML data in a textual format. To overcome this challenge and aid developers, this paper presents vid2XML, which is a three-phase approach that leverages both visual and textual information of video frames to locate XML region in video frames, locate the currently opened file, and extract XML data for each file presented in video frames. We evaluated each phase of vid2XML in a comprehensive empirical evaluation on videos collected from YouTube. The results reveal that vid2XML is able to accurately (i) locate XML regions, outperforming four previous work, (ii) locate the bounding box of the selected file, and (iii) extract, fix, and merge XML data for each file opened/created in a video.
Fri 19 MayDisplayed time zone: Hobart change
11:00 - 12:30 | Reverse engineeringTechnical Track / Journal-First Papers / SEIP - Software Engineering in Practice at Meeting Room 104 Chair(s): Wei Le Iowa State University | ||
11:00 15mTalk | SeeHow: Workflow Extraction from Programming Screencasts through Action-Aware Video Analytics Technical Track Dehai Zhao Australian National University, Australia, Zhenchang Xing , Xin Xia Huawei, Deheng Ye Tencent AI Lab, Xiwei (Sherry) Xu CSIRO’s Data61, Liming Zhu CSIRO’s Data61 | ||
11:15 15mTalk | AidUI: Toward Automated Recognition of Dark Patterns in User Interfaces Technical Track S M Hasan Mansur George Mason University, Sabiha Salma George Mason University, Damilola Awofisayo Duke University, Kevin Moran George Mason University | ||
11:30 15mTalk | Carving UI Tests to Generate API Tests and API Specification Technical Track Rahulkrishna Yandrapally University of British Columbia, Canada, Saurabh Sinha IBM Research, Rachel Tzoref-Brill IBM Research, Ali Mesbah University of British Columbia (UBC) Pre-print | ||
11:45 15mTalk | CFG2VEC: Hierarchical Graph Neural Network for Cross-Architectural Software Reverse Engineering SEIP - Software Engineering in Practice Shih-Yuan Yu UCI, Yonatan Achamyeleh UCI, Chonghan Wang UCI, Anton Kocheturov Siemens Technology, Patrick Eisen Siemens Technology, Mohammad Al Faruque UCI | ||
12:00 15mTalk | Ex pede Herculem: Augmenting Activity Transition Graph for Apps via Graph Convolution Network Technical Track Zhe Liu Institute of Software, Chinese Academy of Sciences, Chunyang Chen Monash University, Junjie Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Yuhui Su Institute of Software, Chinese Academy of Sciences, Yuekai Huang Institute of Software, Chinese Academy of Sciences, Jun Hu Institute of Software, Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences | ||
12:15 7mTalk | VID2XML: Automatic Extraction of a Complete XML Data from Mobile Programming Screencasts Journal-First Papers Mohammad D. Alahmadi Department of Software Engineering, College of Computer Science and Engineering, University of Jeddah, Jeddah, Saudi Arabia. |