Write a Blog >>
ASE 2020
Mon 21 - Fri 25 September 2020 Melbourne, Australia
Wed 23 Sep 2020 00:40 - 01:00 at Platypus - Incidents and Bug Reports Chair(s): Yepang Liu

Graphical User Interface (GUI) provides a visual bridge between a software application and end users, through which they can interact with each other. With the development of technology and aesthetics, the visual effects of the GUI are more and more attracting. However, such GUI complexity posts a great challenge to the GUI implementation. According to our pilot study of crowdtesting bug reports, display issues such as text overlap, blurred screen, missing image always occur during GUI rendering on difference devices due to the software or hardware compatibility. They negatively influence the app usability, resulting in poor user experience. To detect these issues, we propose a novel approach, OwlEye, based on deep learning for modelling visual information of the GUI screenshot. Therefore, OwlEye can detect GUIs with display issues and also locate the detailed region of the issue in the given GUI for guiding developers to fix the bug. We manually construct a large-scale labelled dataset with 4,470 GUI screenshots with UI display issues and develop a heuristics-based data augmentation method for boosting the performance of our OwlEye. The evaluation demonstrates that our OwlEye can achieve 85% precision and 84% recall in detecting UI display issues, and 90% accuracy in localizing these issues. We also evaluate OwlEye with popular Android apps on Google Play and F-droid, and successfully uncover 57 previously-undetected UI display issues with 26 of them being confirmed or fixed so far.

Wed 23 Sep

Displayed time zone: (UTC) Coordinated Universal Time change

00:00 - 01:00
Incidents and Bug ReportsResearch Papers at Platypus
Chair(s): Yepang Liu Southern University of Science and Technology
00:00
20m
Talk
How Incidental are the Incidents? Characterizing and Prioritizing Incidents for Large-Scale Online Service SystemsExperience
Research Papers
Junjie Chen Tianjin University, China, Shu Zhang Microsoft Research, Beijing, Xiaoting He Microsoft, Qingwei Lin Microsoft Research, China, Hongyu Zhang University of Newcastle, Australia, Dan Hao Peking University, China, Yu Kang Microsoft Research, China, Feng Gao Microsoft, China, Zhangwei Xu Microsoft, China, Yingnong Dang Microsoft, USA, Dongmei Zhang Microsoft Research, China
00:20
20m
Talk
Stay Professional and Efficient: Automatically Generate Titles for Your Bug Reports
Research Papers
Songqiang Chen School of Computer Science, Wuhan University, Xiaoyuan Xie School of Computer Science, Wuhan University, China, Bangguo Yin School of Computer Science, Wuhan University, Yuanxiang Ji School of Computer Science, Wuhan University, Lin Chen Nanjing University, Baowen Xu State Key Laboratory for Novel Software Technology, Nanjing University
00:40
20m
Talk
Owl Eyes: Spotting UI Display Issues via Visual Understanding
Research Papers
Zhe Liu Laboratory for Internet Software Technologies, Institute of Software Chinese Academy of Sciences, University of Chinese Academy of Sciences, Chunyang Chen Monash University, Australia, Junjie Wang Institute of Software, Chinese Academy of Sciences, Yuekai Huang Institute of Software, Chinese Academy of Sciences, Jun Hu Institute of Software, Chinese Academy of Sciences, Qing Wang Institute of Software, Chinese Academy of Sciences