Test Migration for Efficient Large-Scale Assessment of Mobile App Coding Assignments
In recent years, there has been a growing interest in making education widely accessible using Internet technologies. Whether it is Massive Open Online Courses (MOOCs) or simply college courses offered to a large student population using an online platform, both education-focused companies and universities, often in collaboration with one another, have been investing massively in online education. The fact that hundreds, and more often thousands, of students take these online courses raises scalability challenges in assessing student assignments. In this paper, in particular, we present a technique (GUITestMigrator) that addresses the challenge of assessing mobile app coding assignments. Given a set of apps that implement the same specification, but can have completely different user interfaces, instructors normally have to manually run and check each app to make sure it behaves correctly and according to the specification. GUITestMigrator, conversely, allows for developing tests for one of these apps and automatically migrating these tests to the other apps, thus dramatically reducing the burden on the instructor. We implemented GUITestMigrator for Android apps and evaluated it on three sets of apps developed over three different semesters by students of an online graduate-level software engineering course. Our initial results show that our approach is promising and motivates further research in this direction. The paper also discusses possible applications of this approach for test evolution and test migration for real-world apps.
Tue 17 JulDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
09:00 - 10:30 | |||
09:00 20mTalk | Automatically Translating Bug Reports into Test Cases for Mobile Apps ISSTA Technical Papers Mattia Fazzini Georgia Institute of Technology, Martin Prammer Georgia Institute of Technology, Marcelo d'Amorim Federal University of Pernambuco, Alessandro Orso Georgia Tech | ||
09:20 20mTalk | CiD: Automating the Detection of API-related Compatibility Issues in Android Apps ISSTA Technical Papers Li Li Monash University, Australia, Tegawendé F. Bissyandé University of Luxembourg, Luxembourg, Haoyu Wang , Jacques Klein University of Luxembourg, SnT | ||
09:40 20mTalk | Test Migration for Efficient Large-Scale Assessment of Mobile App Coding Assignments ISSTA Technical Papers | ||
10:00 20mTalk | Analyzing the Analyzers: FlowDroid/IccTA, AmanDroid, and DroidSafe ISSTA Technical Papers | ||
10:20 10m | Q&A in groups ISSTA Technical Papers |