Managing Reproducibility Debt in Scientific Software: A Practical Framework
Scientific software includes end-user applications, modelling tools, research software for publications, and production systems for real users. It plays a key role across various scientific disciplines by enabling large-scale computation, simulation, and data analysis. Unlike commercial software, scientific software is often developed in dynamic research environments with limited engineering practices, documentation, or testing. This makes it fragile and difficult to reproduce results, even when code and data are available, conditions in which Reproducibility Debt (RpD) accumulates. This paper presents the Reproducibility Debt Management Framework (RpD-MF), which is grounded in evidence from a systematic literature review, practitioner interviews, and a global survey. Central to the framework is a probabilistic cause-effect model that maps how technical, human, and organisational factors contribute to RpD. The framework is designed to help researchers and research software engineers identify, monitor, and prevent RpD, providing practical guidance to support sustainable and reproducible scientific software development.
Tue 14 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | |||
11:00 11mTalk | Building Better Research Software (Are you sure?): Why Technical Refactoring Does Not Lead To Software Quality SERS Adam Byrne University of Limerick, Daniel Kennedy University of Limerick, Mark Langtry University of Limerick, Art Oliathain University of Limerick, Dominick Stephens University of Limerick, Birgit Penzenstadler Chalmers Tekniska Högskola and Gothenburg University and Lappenranta University of Technology, Colin C. Venters European Organization for Nuclear Research (CERN) | ||
11:11 11mTalk | Metamorphic Testing of Research Software with GeoMetaMorph SERS Sebastian Müller University of Potsdam | ||
11:22 11mTalk | Testing Research Software using International Standards and Practices SERS Satoshi Masuda Tokyo City University, Jon D. Hagar Grand Software Testing, LLC, Hot Sulphur Springs, CO, Tomohiro Takeda Tokyo City University, Toshiharu Kato Surugadai University | ||
11:33 11mTalk | WiRCA: Categorizing Research Software Code Based on Its Purpose SERS Constantin Buschhaus RWTH Aachen University, Alexander Hellwig RWTH Aachen University, Bernhard Rumpe RWTH Aachen University | ||
11:44 11mTalk | Evolving Research Software: an Experience Report SERS Matias Ignacio Gonzalez Universidad de Buenos Aires, Nicolas Paez Universidad Nacional de Tres de Febrero | ||
11:55 11mTalk | Managing Reproducibility Debt in Scientific Software: A Practical Framework SERS Zara Hassan Australian National University, Christoph Treude Singapore Management University, Graham Williams Australian National University, Michael Norrish Australian National University, Alex Potanin Australian National University | ||
12:06 11mTalk | Enhancing Understandability and Transparency of Research Software: Tracing Research to Code SERS Adrian Bajraktari University of Cologne, Andreas Vogelsang paluno – The Ruhr Institute for Software Technology, University of Duisburg-Essen | ||
12:17 13mTalk | Application of Technology Readiness Level to Research Software SERS | ||