Write a Blog >>
ASE 2020
Mon 21 - Fri 25 September 2020 Melbourne, Australia
Tue 22 Sep 2020 08:40 - 09:00 at Kangaroo - Software Analysis (1) Chair(s): Michael Pradel

Jupyter notebooks—documents that contain live code, equations, visualizations, and narrative text—now are among the most popular means to compute, present, discuss, and disseminate scientific findings. In principle, Jupyter notebooks should easily allow to reproduce and extend scientific computations and their findings; but in practice, this is not the case. The individual code cells in Jupyter notebooks can be executed in any order, with identifier usages preceding their definitions and results preceding their computations. In a sample of 936 published notebooks that would be executable in principle, we found that 73% of them would not be reproducible with straightforward approaches, requiring humans to infer (and often guess) the order in which the authors created the cells.

In this paper, we present an approach to

  1. automatically satisfy dependencies between code cells to reconstruct possible execution orders of the cells; and
  2. instrument code cells to mitigate the impact of non-reproducible statements (i.e., random functions) in Jupyter notebooks.

Our Osiris prototype takes a notebook as input and outputs the possible execution schemes that reproduce the exact notebook results. In our sample, Osiris was able to reconstruct such schemes for 82.23% of all executable notebooks, which has more than three times better than the state-of-the-art; the resulting reordered code is valid program code and thus available for further testing and analysis.

Tue 22 Sep
Times are displayed in time zone: (UTC) Coordinated Universal Time change

08:00 - 09:00: Software Analysis (1)Research Papers at Kangaroo
Chair(s): Michael PradelUniversity of Stuttgart, Germany
08:00 - 08:20
Talk
Research Papers
Timotej KapusImperial College London, UK, Frank BusseImperial College London, Cristian CadarImperial College London, UK
Pre-print Media Attached
08:20 - 08:40
Talk
Research Papers
Sungho LeeChungnam National University, Korea, Hyogun LeeKAIST, Sukyoung RyuKAIST
08:40 - 09:00
Talk
Research Papers
Jiawei Wang, Tzu-yang KuoThe Hong Kong University of Science and Technology, Li LiMonash University, Australia, Andreas ZellerCISPA, Germany