Write a Blog >>
ICSE 2023
Sun 14 - Sat 20 May 2023 Melbourne, Australia
Fri 19 May 2023 12:15 - 12:22 at Meeting Room 104 - Reverse engineering Chair(s): Wei Le

Developers often refer to video-hosting online platforms to find screencasts that provide a step-by-step guide to help them solve a programming task at hand or learn a new concept. More specifically, developers search for resources that help them design and implement effective mobile graphical user interfaces (GUI) using XML. Although mobile programming screencasts contain a vast amount of XML data at developers’ disposal, they cannot be easily found and copied-pasted due to the image nature of videos. Given that the most common task developers perform online is copy-pasting, mobile programming screencasts must support that and be complemented with XML data in a textual format. To overcome this challenge and aid developers, this paper presents vid2XML, which is a three-phase approach that leverages both visual and textual information of video frames to locate XML region in video frames, locate the currently opened file, and extract XML data for each file presented in video frames. We evaluated each phase of vid2XML in a comprehensive empirical evaluation on videos collected from YouTube. The results reveal that vid2XML is able to accurately (i) locate XML regions, outperforming four previous work, (ii) locate the bounding box of the selected file, and (iii) extract, fix, and merge XML data for each file opened/created in a video.

Fri 19 May

Displayed time zone: Hobart change

11:00 - 12:30
11:00
15m
Talk
SeeHow: Workflow Extraction from Programming Screencasts through Action-Aware Video Analytics
Technical Track
Dehai Zhao Australian National University, Australia, Zhenchang Xing , Xin Xia Huawei, Deheng Ye Tencent AI Lab, Xiwei (Sherry) Xu CSIRO’s Data61, Liming Zhu CSIRO’s Data61
11:15
15m
Talk
AidUI: Toward Automated Recognition of Dark Patterns in User Interfaces
Technical Track
S M Hasan Mansur George Mason University, Sabiha Salma George Mason University, Damilola Awofisayo Duke University, Kevin Moran George Mason University
11:30
15m
Talk
Carving UI Tests to Generate API Tests and API Specification
Technical Track
Rahulkrishna Yandrapally University of British Columbia, Canada, Saurabh Sinha IBM Research, Rachel Tzoref-Brill IBM Research, Ali Mesbah University of British Columbia (UBC)
Pre-print
11:45
15m
Talk
CFG2VEC: Hierarchical Graph Neural Network for Cross-Architectural Software Reverse Engineering
SEIP - Software Engineering in Practice
Shih-Yuan Yu UCI, Yonatan Achamyeleh UCI, Chonghan Wang UCI, Anton Kocheturov Siemens Technology, Patrick Eisen Siemens Technology, Mohammad Al Faruque UCI
12:00
15m
Talk
Ex pede Herculem: Augmenting Activity Transition Graph for Apps via Graph Convolution Network
Technical Track
Zhe Liu Institute of Software, Chinese Academy of Sciences, Chunyang Chen Monash University, Junjie Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Yuhui Su Institute of Software, Chinese Academy of Sciences, Yuekai Huang Institute of Software, Chinese Academy of Sciences, Jun Hu Institute of Software, Chinese Academy of Sciences, Qing Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences
12:15
7m
Talk
VID2XML: Automatic Extraction of a Complete XML Data from Mobile Programming Screencasts
Journal-First Papers
Mohammad D. Alahmadi Department of Software Engineering, College of Computer Science and Engineering, University of Jeddah, Jeddah, Saudi Arabia.