Measurement Challenges for Cyber-Cyber Digital Twins: Experiences from the Deployment of Facebook’s WW Simulation System
Maria Lomeli is currently a Software Engineer in the London Probability team at Facebook, working on the WW cyber-cyber digital twin. Previously, she was a senior research scientist at Babylon Health, UK, and a postdoctoral researcher in Machine Learning, at University of Cambridge. She was awarded a PhD in Statistical Machine Learning from the Gatsby Unit, University College London. Her scientific work combines aspects of Software Engineering and Machine Learning at scale, and has been published in the leading venues on both machine learning, such as ICML and NeurIPS and on Software Engineering, such as ICSE. She has given over 30 talks internationally on her scientific work.
Mark Harman is a full-time Research Scientist in the London Probability team at Facebook, working on the WW cyber-cyber digital twin. Mark is also a part-time professorship at UCL and was previously the manager of Facebook's Sapienz team team, which grew out of Majicke, a start up co-founded by Mark and acquired by Facebook in 2017. The Sapienz tech has been fully deployed as part of Facebook’s overall CI system since 2017 and the Facebook Sapienz continues to develop and extend it. Sapienz has found and helped to fix thousands of bugs before they hit production, on systems of tens of millions of lines of code, used by over 2.8 billion people world wide every day. Prior to working at Facebook, Mark was head of Software Engineering at UCL and director of its CREST centre. In his more purely scientific work, Mark co-founded the field Search Based Software Engineering (SBSE) in 2001, now the subject of active research in over 40 countries worldwide. He received the IEEE Harlan Mills Award and the ACM Outstanding Research Award in 2019 for his work and was awarded a fellowship of the Royal Academy of Engineering in 2020.
This talk concerns measurement of software systems built as cyber-cyber digital twins. A cyber-cyber digital twin is a deployed software model that executes in tandem with the system it simulates, contributing to, and drawing from, that system’s behaviour. This talk outlines Facebook’s cyber-cyber digital twin, WW, a twin of Facebook’s WWW platform, built using Web-Enabled Simulation. The talk will focus on research challenges and opportunities in the area of measurement. Measurement challenges lie at the heart of modern simulation, directly impacting how we use simulation outcomes to make automated online and semi-automated offline decisions, and how we verify and validate those outcomes. As modern simulation systems increasingly become more like cyber-cyber digital twins, thereby moving from manual to automated decision making, these measurement challenges acquire ever greater significance.
This talk reports the results of joint work by John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Sophia Drossopoulou, Elena Dulskyte, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Ralf Laemmel, Maria Lomeli, Simon Lucas, Steve Omohundro, Erik Meijer, Rubmary Rojas, Silvia Sapora, Justin Spahr-Summers, and Jie Zhang.
Shared with SSBSE
Massimiliano Di Penta is a full professor at the University of Sannio, Italy. His research interests include software maintenance and evolution, mining software repositories, empirical software engineering, search-based software engineering, and software testing. He is an author of over 260 papers that appeared in international journals, conferences, and workshops. He has received several awards for research and service, including four ACM SIGSOFT Distinguished paper awards. Most importantly, he has received several distinguished reviewer awards. He serves and has served in the organizing and program committees of more than 100 conferences, including ICSE, FSE, ASE, and ICSME. He will be program co-chair of ESEC/FSE 2021 and of ICSE 2023. He is co-editor in chief of the Journal of Software: Evolution and Processes edited by Wiley, editorial board member of ACM Transactions on Software Engineering and Methodology and Empirical Software Engineering Journal edited by Springer, and has served the editorial board of the IEEE Transactions on Software Engineering.