ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal
Wed 17 Apr 2024 11:45 - 12:00 at Eugénio de Andrade - Testing 1 Chair(s): Ajitha Rajan

This paper reports the results of the deployment of Rich-State Simulated Populations at Meta for both automated and manual testing. We simulate user interactions using simulated users (aka test users) that acquire state in much the same way that real user accounts acquire state. For automated testing, we present empirical results from deployment on the Facebook, Messenger, and Instagram apps for iOS and Android Platforms. These apps consist of tens of millions of lines of code, communicating with hundreds of millions of lines of backend code, and are
used by over 2 billion people every day. Our results reveal that rich state increases average code coverage by 38%, and endpoint coverage by 61%. More importantly, it also yields an average increase of 115% in the faults found by automated testing. The rich-state test user populations are also deployed in a (continually evolving) Test Universe; a web-enabled simulation platform for privacy-safe manual testing, which has been used by over 21,000 Meta engineers since its deployment in November 2022.

Wed 17 Apr

Displayed time zone: Lisbon change

11:00 - 12:30
11:00
15m
Talk
A First Look at the Inheritance-Induced Redundant Test Execution
Research Track
Dong Jae Kim Concordia University, Jinqiu Yang Concordia University, Tse-Hsun (Peter) Chen Concordia University
11:15
15m
Talk
Hypertesting of Programs: Theoretical Foundation and Automated Test Generation
Research Track
Michele Pasqua University of Verona, Mariano Ceccato University of Verona, Paolo Tonella USI Lugano
Pre-print
11:30
15m
Talk
Gamifying a Software Testing Course with Continuous Integration
Software Engineering Education and Training
Philipp Straubinger University of Passau, Gordon Fraser University of Passau
Pre-print
11:45
15m
Talk
Enhancing Testing at Meta with Rich-State Simulated Populations
Software Engineering in Practice
Kinga Bojarczuk Meta, Mark Harman Meta Platforms, Inc. and UCL, Nadia Alshahwan Meta Platforms, Arianna Blasi Meta Platforms, Inc., Andrea Ciancone Meta, Natalija Gucevska Meta, Michal Krolikowski Meta, Rubmary Rojas Meta, Dragos Martac Meta, Simon Schellaert Meta, Kate Ustiuzhanina Meta, Inna Harper Meta, Yue Jia Meta, Will Lewis Meta
12:00
15m
Talk
The Impact Of Bug Localization Based on Crash Report Mining: A Developers' Perspective
Software Engineering in Practice
Marcos Medeiros Federal University of Rio Grande do Norte, Uirá Kulesza Federal University of Rio Grande do Norte, Roberta Coelho , Rodrigo Bonifácio Computer Science Department - University of Brasília, Christoph Treude Singapore Management University, Eiji Adachi Barbosa Federal University of Rio Grande do Norte (UFRN)
Pre-print
12:15
7m
Talk
Stress Testing Control Loops in Cyber-Physical Systems
Journal-first Papers
Claudio Mandrioli University of Luxembourg, Seung Yeob Shin University of Luxembourg, Martina Maggio Saarland University, Germany / Lund University, Sweden, Domenico Bianculli University of Luxembourg, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland
Pre-print