Discovering UI Display Issues with Visual UnderstandingWinner SRC - Graduate
GUI complexity posts a great challenge to the GUI implementation. According to our pilot study of crowdtesting bug reports, display issues such as text overlap, blurred screen, missing image always occur during GUI rendering on difference devices due to the software or hardware compatibility. They negatively influence the app usability, resulting in poor user experience. To detect these issues, we propose a novel approach, OwlEye, based on deep learning for modelling visual information of the GUI screenshot.Therefore, OwlEye can detect GUIs with display issues and also locate the detailed region of the issue in the given GUI for guiding developers to fix the bug. We manually construct a large-scale labelled dataset with 4,470 GUI screenshots with UI display issues. We develop a heuristics-based data augmentation method and a GAN-based data augmentation method for boosting the performance of our OwlEye. At present, the evaluation demonstrates that our OwlEye can achieve 85% precision and 84% recall in detecting UI display issues, and 90% accuracy in localizing these issues.
Wed 23 SepDisplayed time zone: (UTC) Coordinated Universal Time change
02:20 - 03:20 | |||
02:20 5mPoster | Dynamic Algorithm Selection for SMT Student Research Competition Nikhil Pimpalkhare University of California, Berkeley | ||
02:25 5mPoster | CrossPriv: User Privacy Preservation Model for Cross-Silo Federated Software Student Research Competition Harshita Diddee Guru Gobind Singh Indraprastha University, Bhrigu Kansra Guru Gobind Singh Indraprastha University | ||
02:30 5mPoster | Scalability and Precision Improvement of Neural Program Synthesis Student Research Competition Yating Zhang National University of Defense Technology | ||
02:35 5mPoster | The Classification and Propagation of Program CommentsSecond place SRC - Undergraduate Student Research Competition Xiangzhe Xu Nanjing University | ||
02:40 5mPoster | Source Code and Binary Level Vulnerability Detection and Hot PatchingThird place SRC - Graduate Student Research Competition Zhengzi Xu Nanyang Technological University | ||
02:45 5mPoster | FLUX: From SQL to GQL query translation tool Student Research Competition Chandan Sharma Auckland University of Technology | ||
02:50 5mPoster | Discovering UI Display Issues with Visual UnderstandingWinner SRC - Graduate Student Research Competition Zhe Liu Laboratory for Internet Software Technologies, Institute of Software Chinese Academy of Sciences, University of Chinese Academy of Sciences |