Anomaly Detection Through Container Testing: A Survey of Company Practices
Abstract. Background: Containers are a commonly used solution for deploying software applications. Therefore, container functionality and security is a concern of practitioners and researchers. Testing is an essential aspect to ensure the quality of the container environment component and the software product, and plays a crucial role in using containers.
Objective: In light of the increasing role of software containers and the lack of research on testing them, we study container testing practices. In this paper, we investigate the current approaches for testing containers. Moreover, we aim to identify areas for improvement and emphasize the importance of testing in securing the container environment and the final software product.
Method: We conducted a survey to collect primary data from companies implementing container testing practices and the commonly used tools in container testing. There were 14 respondents from a total of ten different companies with experience using containers and varying work responsibilities.
Findings: The survey findings illustrate the significance of testing, the growing interest in and utilization of containers, and the emerging security and vulnerability concerns. The research reveals variations in testing approaches between companies and the lack of consensus on how testing should be carried out, with advancements primarily driven by industry practices rather than academic research.
Conclusion: In this study we show the importance of testing software containers. It lays out the current testing approaches, challenges, and the need for standardized container testing practices. We also provide recommendations on how to develop these practices further.
Wed 13 DecDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:00 - 12:20 | Software Testing and Quality AssuranceResearch Papers / Organization / Short Papers and Posters / Industry Papers at W211 Chair(s): Dietmar Pfahl University of Tartu | ||
11:00 10mResearch paper | An Experience in the Evaluation of Fault Prediction Research Papers Luigi Lavazza Università degli Studi dell'Insubria, Sandro Morasca Università degli Studi dell'Insubria, Gabriele Rotoloni | ||
11:10 10mIndustry talk | Is It the Best Solution? Testing An Optimisation Algorithm with Metamorphic Testing Industry Papers Alejandra Duque-Torres University of Tartu, Claus Klammer Software Competence Center Hagenberg, Stefan Fischer Software Competence Center Hagenberg, Dietmar Pfahl University of Tartu | ||
11:20 10mShort-paper | Impacts of Program Structures on Code Coverage of Generated Test Suites Short Papers and Posters | ||
11:30 10mResearch paper | Anomaly Detection Through Container Testing: A Survey of Company Practices Research Papers Salla Timonen University of Jyväskylä, Maha Sroor University of Jyväskylä, Rahul Mohanani University of Jyväskylä, Tommi Mikkonen University of Jyvaskyla | ||
11:40 10mShort-paper | The Effects of Soft Assertion on Spectrum-based Fault Localization Short Papers and Posters Kouhei Mihara Osaka University, Shinsuke Matsumoto Osaka University, Shinji Kusumoto Osaka University | ||
11:50 10mIndustry talk | Characterizing Requirements Smells Industry Papers | ||
12:00 10mResearch paper | Do Exceptional Behavior Tests Matter on Spectrum-based Fault Localization? Research Papers Haruka Yoshioka Osaka University, Yoshiki Higo Osaka University, Shinsuke Matsumoto Osaka University, Shinji Kusumoto Osaka University, Shinji Itoh Hitachi, Ltd., Research &Development Group, Phan Thi Thanh Huyen Hitachi, Ltd., Research &Development Group | ||
12:10 10mResearch paper | On Deprecated API Usages: an Exploratory Study of Top-starred Projects on GitHub Research Papers Pietro Cassieri University of Salerno, Simone Romano University of Salerno, Giuseppe Scanniello University of Salerno |