Test Automation in Open-Source Android Apps: A Large-Scale Empirical Study
Automated testing of mobile apps has received significant attention in the recent years from researchers and practitioners alike. In this paper, we report on the largest empirical study to date, aimed at understanding the test automation culture prevalent among mobile app developers. We systematically examined more than 3.5 million repositories on GitHub and identified more than 12, 000 non-trivial and real-world Android apps. We then analyzed these non-trivial apps to investigate (1) the trends in adoption of test automation; (2) working habits of mobile app developers in regards to automated testing; and (3) the correlation between the adoption of test automation and the popularity of projects. Among others, we found that (1) only 8% of the mobile app development projects leverage automated testing practices; (2) developers tend to follow the same test automation practices across projects; and (3) popular projects, measured in terms of the number of contributors, stars, and forks on GitHub, are more likely to adopt test automation practices. To understand the rationale behind our observations, we further conducted a survey with 148 professional and experienced developers contributing to the subject apps. Our findings shed light on the current practices and future research directions pertaining to test automation for mobile app development.
Thu 24 SepDisplayed time zone: (UTC) Coordinated Universal Time change
16:00 - 17:00 | Mobile App (2)NIER track / Tool Demonstrations / Research Papers at Kangaroo Chair(s): Eric Bodden Heinz Nixdorf Institut, Paderborn University and Fraunhofer IEM | ||
16:00 20mTalk | Seven Reasons Why: An In-Depth Study of the Limitations of Random Test Input Generation for AndroidExperience Research Papers | ||
16:20 20mTalk | Test Automation in Open-Source Android Apps: A Large-Scale Empirical Study Research Papers Jun-Wei Lin University of California, Irvine, Navid Salehnamadi University of California, Irvine, Sam Malek University of California at Irvine, USA | ||
16:40 10mTalk | A Framework for Automated Test Mocking of Mobile Apps NIER track Mattia Fazzini University of Minnesota, Alessandra Gorla IMDEA Software Institute, Alessandro Orso Georgia Tech | ||
16:50 10mTalk | AirMochi – A Tool for Remotely Controlling iOS Devices Tool Demonstrations Nikola Lukic University of Southern California, Saghar Talebipour University of Southern California, Nenad Medvidović University of Southern California, USA |