Write a Blog >>
LCTES 2019
Sat 22 - Fri 28 June 2019 Phoenix, Arizona, United States
co-located with PLDI 2019
Sun 23 Jun 2019 16:35 - 16:40 at 105A - Session 4: Benchmarking and In-progress Works Chair(s): Hyunok Oh

Android app testing is challenging and time-consuming because fully testing all feasible execution paths is always difficult. Apps are usually tested in two alternative ways: human testing vs. automated testing. Prior studies focused on the comparison between different automated tools. However, some fundamental questions are still unexplored, including (1) how automated testing behaves differently from human testing, and (2) whether automated testing can fully or partially substitute human testing.

This paper presents our empirical study to investigate the open questions. As Monkey has been considered as one of the best automated testing tools due to its usability and relatively good coverage metrics, we applied Monkey to five Android apps of different domains and collected the dynamic event traces. Meanwhile, we also recruited eight users to manually test the same apps and gathered the traces. By comparing the collected run-time information of both testing methods, we revealed that i.) on average, the two methods triggered similar numbers of unique events; ii.) Monkey triggered system events more effectively while humans triggered more UI events; iii.) Monkey could mimic human behaviors when apps have UIs full of clickable widgets to trigger logically independent events; and iv.) Monkey was insufficient to test apps that require for information comprehension and problem-solving skills. Our research will shed light on future research that combines human expertise with the agility of Monkey testing.

Sun 23 Jun
Times are displayed in time zone: Tijuana, Baja California change

16:00 - 16:45
Session 4: Benchmarking and In-progress WorksLCTES 2019 at 105A
Chair(s): Hyunok OhHanyang Univ
16:00
15m
Full-paper
BitBench: A Benchmark for Bitstream Computing
LCTES 2019
Kyle DaruwallaUniversity of Wisconsin – Madison, Heng ZhuoUniversity of Wisconsin - Madison, Carly SchulzUniversity of Wisconsin - Madison, Mikko H. Lipasti
16:15
5m
Short-paper
PANDORA: A Parallelizing Approximation-Discovery Framework (Work in progress)
LCTES 2019
Greg StittUniversity of Florida, David CampbellUniversity of Florida
16:20
5m
Short-paper
On Intermittence Bugs in the Battery-less Internet of Things (Work in progress)
LCTES 2019
Andrea MaioliPolitecnico di Milano, Italy, Luca MottolaPolitecnico di Milano, Italy and RI.Se SICS, Sweden, Muhammad Hamad AlizaiLUMS, Pakistan, Junaid Haroon SiddiquiLahore University of Management Sciences
16:25
5m
Short-paper
Raising Binaries to LLVM IR with MCTOLL (Work in progress)
LCTES 2019
16:30
5m
Short-paper
A Compiler-based Approach for GPGPU Performance Calibration using TLP Modulation (Work in progress)
LCTES 2019
Yongseung YuHanyang University, Seokwon KangHanyang University, Yongjun ParkHanyang University
16:35
5m
Short-paper
An Empirical Comparison between Monkey Testing and Human Testing (Work in progress)
LCTES 2019
Mostafa MohammedVirginia Tech, Haipeng CaiWashington State University Pullman, Na MengVirginia Tech