Contextual Understanding and Improvement of Metamorphic Testing in Scientific Software Development
Background: Metamorphic testing emerges as a simple and effective approach for testing scientific software; yet, its adoption in actual scientific software projects is less studied.
Aims: In order for the practitioners to better adopt metamorphic testing in their projects, we set out to first gain a deep understanding about the current qualify assurance workflow, testing practices, and tools.
Method: We propose to integrate various empirical sources, including artifact analysis, stakeholder interviews, and gap analysis from the literature.
Results: Applying our approach to the Open Water Analytics Stormwater Management Model project helped to identify four new needs requiring continued and more research: (1) systematic and explicit formulation of metamorphic relations, (2) metamorphic testing examples specific to the scientific software, (3) correlating metamorphic testing with regression testing, and (4) integrating metamorphic testing with build tools like CMake and continuous integration tools like GitHub Actions.
Conclusions: Integrating different empirical sources is promising for establishing a contextual understanding of software engineering practices, and for action research, such as workflow refinements and tool interventions, to be carried out in a principled manner.
Wed 13 OctDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:20 - 15:15 | Testing & Security 3Emerging Results and Vision papers / Journal-first Papers / Technical Papers at ESEM ROOM Chair(s): Robert Feldt Chalmers University of Technology, Sweden | ||
14:20 15mTalk | On (Mis)Perceptions of Testing Effectiveness: An Empirical Study Journal-first Papers Sira Vegas Universidad Politecnica de Madrid, Patricia Riofrio , Esperanza Marcos Universidad Rey Juan Carlos, Natalia Juristo Universidad Politecnica de Madrid | ||
14:35 15mTalk | Testing Smart Contracts: Which Technique Performs Best? Technical Papers Sefa Akca Uniersity of Edinburgh, Chao Peng University of Edinburgh, UK, Ajitha Rajan University of Edinburgh | ||
14:50 15mTalk | Automated isolation for white-box test generation Journal-first Papers Link to publication DOI | ||
15:05 10mTalk | Contextual Understanding and Improvement of Metamorphic Testing in Scientific Software Development Emerging Results and Vision papers Zedong Peng University of Cincinnati, Upulee Kanewala University of North Florida, Nan Niu University of Cincinnati |