PROFES 2023
Sun 10 - Wed 13 December 2023 Dornbirn, Austria
Wed 13 Dec 2023 11:30 - 11:40 at W211 - Software Testing and Quality Assurance Chair(s): Dietmar Pfahl

Abstract. Background: Containers are a commonly used solution for deploying software applications. Therefore, container functionality and security is a concern of practitioners and researchers. Testing is an essential aspect to ensure the quality of the container environment component and the software product, and plays a crucial role in using containers.

Objective: In light of the increasing role of software containers and the lack of research on testing them, we study container testing practices. In this paper, we investigate the current approaches for testing containers. Moreover, we aim to identify areas for improvement and emphasize the importance of testing in securing the container environment and the final software product.

Method: We conducted a survey to collect primary data from companies implementing container testing practices and the commonly used tools in container testing. There were 14 respondents from a total of ten different companies with experience using containers and varying work responsibilities.

Findings: The survey findings illustrate the significance of testing, the growing interest in and utilization of containers, and the emerging security and vulnerability concerns. The research reveals variations in testing approaches between companies and the lack of consensus on how testing should be carried out, with advancements primarily driven by industry practices rather than academic research.

Conclusion: In this study we show the importance of testing software containers. It lays out the current testing approaches, challenges, and the need for standardized container testing practices. We also provide recommendations on how to develop these practices further.

Wed 13 Dec

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

11:00 - 12:20
Software Testing and Quality AssuranceResearch Papers / Organization / Short Papers and Posters / Industry Papers at W211
Chair(s): Dietmar Pfahl University of Tartu
11:00
10m
Research paper
An Experience in the Evaluation of Fault Prediction
Research Papers
Luigi Lavazza Università degli Studi dell'Insubria, Sandro Morasca Università degli Studi dell'Insubria, Gabriele Rotoloni
11:10
10m
Industry talk
Is It the Best Solution? Testing An Optimisation Algorithm with Metamorphic Testing
Industry Papers
Alejandra Duque-Torres University of Tartu, Claus Klammer Software Competence Center Hagenberg, Stefan Fischer Software Competence Center Hagenberg, Dietmar Pfahl University of Tartu
11:20
10m
Short-paper
Impacts of Program Structures on Code Coverage of Generated Test Suites
Short Papers and Posters
Ryoga Watanabe Osaka University, Yoshiki Higo Osaka University, Shinji Kusumoto Osaka University
11:30
10m
Research paper
Anomaly Detection Through Container Testing: A Survey of Company Practices
Research Papers
Salla Timonen University of Jyväskylä, Maha Sroor University of Jyväskylä, Rahul Mohanani University of Jyväskylä, Tommi Mikkonen University of Jyvaskyla
11:40
10m
Short-paper
The Effects of Soft Assertion on Spectrum-based Fault Localization
Short Papers and Posters
Kouhei Mihara Osaka University, Shinsuke Matsumoto Osaka University, Shinji Kusumoto Osaka University
11:50
10m
Industry talk
Characterizing Requirements Smells
Industry Papers
Emanuele Gentili Mbda Italy S.p.a., Falessi Davide University of Rome Tor Vergata
12:00
10m
Research paper
Do Exceptional Behavior Tests Matter on Spectrum-based Fault Localization?
Research Papers
Haruka Yoshioka Osaka University, Yoshiki Higo Osaka University, Shinsuke Matsumoto Osaka University, Shinji Kusumoto Osaka University, Shinji Itoh Hitachi, Ltd., Research &Development Group, Phan Thi Thanh Huyen Hitachi, Ltd., Research &Development Group
12:10
10m
Research paper
On Deprecated API Usages: an Exploratory Study of Top-starred Projects on GitHub
Research Papers
Pietro Cassieri University of Salerno, Simone Romano University of Salerno, Giuseppe Scanniello University of Salerno