Write a Blog >>
ICSE 2020
Mon 5 - Sun 11 October 2020 Yongsan-gu, Seoul, South Korea
Mon 5 Oct 2020 15:00 - 15:20 at TBD2 - Android and Web Application Testing

Screen recordings of mobile applications are easy to obtain and capture a wealth of information pertinent to software developers (e.g., bugs or feature requests), making them a popular technique for crowdsourced app feedback. Thus, these videos are becoming a common artifact that developers must manage. In light of unique mobile development constraints, including swift release cycles and rapidly evolving platforms, automated techniques for analyzing all types of rich software artifacts provide benefit to mobile developers. Unfortunately, automatically analyzing screen recordings presents serious challenges, due to their graphical nature, compared to other types of (textual) artifacts. To address these challenges, this paper introduces V2S, a lightweight, automated approach for translating video recordings of Android app usages into replayable scenarios. V2S is based primarily on computer vision techniques and adapts recent solutions for object detection and image classification to detect and classify user actions captured in a video, and convert these into a replayable test scenario. We performed an extensive evaluation of V2S involving 175 videos depicting 3,534 GUI-based actions collected from users exercising features and reproducing bugs from over 80 popular Android apps. Our results illustrate that V2S can accurately replay scenarios from screen recordings, and reproduces $\approx$ 89% of our collected videos with minimal overhead. A case study with three industrial partners illustrates the potential usefulness of V2S for developers.

Mon 5 Oct

14:00 - 15:40: Paper Presentations - Android and Web Application Testing at TBD2
icse-2020-papers14:00 - 14:20
Katherine HoughGeorge Mason University, Gebrehiwet Biyane WelearegaiUniversity of Potsdam, Germany, Christian HammerUniversity of Potsdam, Jonathan BellGeorge Mason University
icse-2020-Software-Engineering-in-Practice14:20 - 14:40
Qun XiaTencent Inc., Zhongzhu Zhouzhouzhzh8@mail2.sysu.edu.cn, Zhihao LiTencent Inc., Bin XuTencent Inc., Wei ZouTencent Inc., Zishun ChenTencent Inc., Huafeng MaTencent Inc., Gangqiang LiangTencent Inc., Haochuan LuFudan University, Shiyu GuoTencent Inc., Ting XiongTencent Inc., Yuetang DengTencent, Inc., Tao XiePeking University
icse-2020-papers14:40 - 15:00
Ju QianNanjing University of Aeronautics and Astronautics, Zhengyu ShangNanjing University of Aeronautics and Astronautics, Shuoyan YanNanjing University of Aeronautics and Astronautics, Yan Wang, Lin ChenNanjing University
icse-2020-papers15:00 - 15:20
Carlos Bernal-CárdenasWilliam and Mary, Nathan CooperCollege of William & Mary, Kevin MoranCollege of William & Mary, Oscar ChaparroCollege of William & Mary, Andrian MarcusUniversity of Texas at Dallas, Denys PoshyvanykWilliam and Mary
icse-2020-papers15:20 - 15:40
Jieshan ChenAustralian National University, Chunyang ChenMonash University, Zhenchang XingAustralia National University, Xiwei XuData 61, Liming ZhuCSIRO's Data61 and UNSW, Guoqiang LiShanghai Jiao Tong University, Jinshui WangSchool of Information Science and Engineering, Fujian University of Technology, Fuzhou, China