Blogs (61) >>
Wed 18 Jul 2018 12:00 - 12:30 at Hanoi - Real-World Benchmarking

In this talk, we describe the motivations behind the creation of AndroZoo, a collection of 5+ millions of Android Application, and provide concrete examples of the problems implied by the absence of a widely available and widely used benchmark dataset. Next, we come back on some of the engineering challenges linked with the creation of a large scale dataset (70+TB), and highlight the organisational challenges of maintaining a dataset in the long run in an academic setting. We also quickly present our approach to try to stay as clear as possible of the legal difficulties of distributing non-Free software. Finally, we discuss the adoption of AndroZoo and the fulfillment of our original goals, and we address what we believe are the main limiting factors with regards to AndroZoo’s adoption.

Wed 18 Jul

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

11:00 - 12:30
Real-World BenchmarkingBenchWork at Hanoi
11:00
10m
Opening Remarks
BenchWork
Karim Ali University of Alberta, Cristina Cifuentes Oracle Labs
11:10
30m
Real World Benchmarks for JavaScript
BenchWork
File Attached
11:40
20m
In Search of Accurate Benchmarking
BenchWork
Edd Barrett King's College London, Sarah Mount King's College London, Laurence Tratt King's College London
File Attached
12:00
30m
AndroZoo: Lessons Learnt After 2 Years of Running a Large Android App Collection
BenchWork
Kevin Allix University of Luxembourg