Write a Blog >>
ICSE 2021
Mon 17 May - Sat 5 June 2021

We report on Facebook’s deployment of MIA (Metamorphic Interaction Automaton). MIA is used to test Facebook’s Web Enabled Simulation, built on a web infrastructure of hundreds of millions of lines of code. MIA tackles the twin problems of test flakiness and the unknowable oracle problem. It uses metamorphic testing to automate continuous integration and regression test execution. MIA also plays the role of a test bot, automatically commenting on all relevant changes submitted for code review. It currently uses a suite of over 40 metamorphic test cases. Even at this extreme scale, a non–trivial metamorphic test suite subset yields outcomes within 20 minutes (sufficient for continuous integration and review processes). Furthermore, our offline mode simulation reduces test flakiness from approximately 50% (of all online tests) to 0% (offline). Metamorphic testing has been widely-studied for 22 years. This paper is the first reported deployment into an industrial continuous integration system.

Wed 26 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

18:50 - 19:50
2.5.4. Some Big Companies' Practices: Cases at Facebook, Google & IBMSEIP - Software Engineering in Practice at Blended Sessions Room 4 +12h
Chair(s): Davide FalessiCalifornia Polytechnic State University
18:50
20m
Paper
Testing Web Enabled Simulation at Scale Using Metamorphic TestingSEIP
SEIP - Software Engineering in Practice
Mark HarmanFacebook, Inc., John AhlgrenFacebook, Maria Eugenia BerezinFacebook, Elena DulskyteFacebook, Inna DvortsovaFacebook, Johann GeorgeFacebook, Natalija GucevskaFacebook, Erik Meijer, Justin Spahr-SummersFacebook, Kinga BojarczukFacebook, Silvia SaporaFacebook, Maria LomeliFacebook
Pre-print
19:10
20m
Paper
Anomaly Detection in a Large-scale Cloud PlatformSEIP
SEIP - Software Engineering in Practice
Mohammad Saiful IslamRyerson University, William PourmajidiRyerson University, Lei ZhangRyerson University, John SteinbacherIBM, Tony ErwinIBM, Andriy MiranskyyRyerson University
Pre-print
19:30
20m
Paper
Smart Build Targets Batching Service at GoogleSEIP
SEIP - Software Engineering in Practice
Kaiyuan WangGoogle, USA, Daniel RallGoogle, Greg TenerGoogle, Vijay GullapalliGoogle, Xin Huang, Ahmed GadGoogle
Pre-print

Thu 27 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

06:50 - 07:50
2.5.4. Some Big Companies' Practices: Cases at Facebook, Google & IBMSEIP - Software Engineering in Practice at Blended Sessions Room 4
06:50
20m
Paper
Testing Web Enabled Simulation at Scale Using Metamorphic TestingSEIP
SEIP - Software Engineering in Practice
Mark HarmanFacebook, Inc., John AhlgrenFacebook, Maria Eugenia BerezinFacebook, Elena DulskyteFacebook, Inna DvortsovaFacebook, Johann GeorgeFacebook, Natalija GucevskaFacebook, Erik Meijer, Justin Spahr-SummersFacebook, Kinga BojarczukFacebook, Silvia SaporaFacebook, Maria LomeliFacebook
Pre-print
07:10
20m
Paper
Anomaly Detection in a Large-scale Cloud PlatformSEIP
SEIP - Software Engineering in Practice
Mohammad Saiful IslamRyerson University, William PourmajidiRyerson University, Lei ZhangRyerson University, John SteinbacherIBM, Tony ErwinIBM, Andriy MiranskyyRyerson University
Pre-print
07:30
20m
Paper
Smart Build Targets Batching Service at GoogleSEIP
SEIP - Software Engineering in Practice
Kaiyuan WangGoogle, USA, Daniel RallGoogle, Greg TenerGoogle, Vijay GullapalliGoogle, Xin Huang, Ahmed GadGoogle
Pre-print

Information for Participants
Info for Blended Sessions Room 4: