ICST 2024
Mon 27 - Fri 31 May 2024 Canada
Fri 31 May 2024 11:20 - 11:40 at Room 1 - Testing and Applications Chair(s): Jeremy Bradbury

The Espresso testing framework for Android has gained popularity among developers as it allows to write concise and reliable UI tests. State-of-the-art tools for automatically testing Android apps, however, tend to produce crash reports rather than human-readable tests, and even if they produce tests these (1) rarely use the Espresso format; (2) are often unreliable due to the volatile nature of widget identifiers; and (3) usually contain no test assertions to serve as regression oracles. While the lack of Espresso support of test generation tools has been addressed by reverse engineering Espresso tests, the other problems remain even with this workaround. In this paper, we therefore introduce a novel Espresso-based representation that allows test generators to generate Espresso test cases directly that (1) can reliably identify widgets using clear and concise Espresso selectors, and (2) can check test executions using Espresso assertions. Experiments on 1,035 Android apps demonstrate that the proposed approach generates Espresso tests that are significantly more reliable than reverse engineered tests, and the Espresso assertions of the generated tests are effective at detecting faults in Android apps.

Fri 31 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:20
Testing and ApplicationsResearch Papers / Testing Tools and Demonstration / Industry at Room 1
Chair(s): Jeremy Bradbury Ontario Tech University
11:00
20m
Industry talk
In industrial embedded software, are some compilation errors easier to localize and fix than others?
Industry
Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden
11:20
20m
Research paper
Brewing Up Reliability: Espresso Test Generation for Android Apps
Research Papers
Iván Arcuschin Moreno University of Buenos Aires, Argentina, Lisandro Di Meo , Michael Auer University of Passau, Juan Pablo Galeotti University of Buenos Aires, Gordon Fraser University of Passau
DOI Pre-print
11:40
20m
Research paper
Differential Optimization Testing of Gremlin-Based Graph Database Systems
Research Papers
Yingying Zheng Institute of Software Chinese Academy of Sciences, Wensheng Dou Institute of Software Chinese Academy of Sciences, Lei Tang Institute of Software Chinese Academy of Sciences, Ziyu Cui Institute of Software Chinese Academy of Sciences, Jiansen Song Institute of Software Chinese Academy of Sciences, Ziyue Cheng , Wei Wang , Jun Wei Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; University of Chinese Academy of Sciences Chongqing School, Hua Zhong , Tao Huang Institute of Software Chinese Academy of Sciences
12:00
10m
Demonstration
MLHCBugs: A Framework to Reproduce Real Faults in Healthcare Machine Learning Applications
Testing Tools and Demonstration
Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida
12:10
10m
Demonstration
The GitHub Recent Bugs Dataset for Evaluating LLM-based Debugging Applications
Testing Tools and Demonstration
Jae Yong Lee , Sungmin Kang , Juyeon Yoon Korea Advanced Institute of Science and Technology, Shin Yoo Korea Advanced Institute of Science and Technology