Automating Combinatorial Test Coverage for Cloud Virtualization
Google Compute Engine runs millions of VMs with highly varied configurations. The size of the configuration input space makes it difficult to identify and test all parameter interactions and make traditional test approaches insufficient. Random testing is unable to detect bugs in the long tail of the input space, exhaustively testing each release against all VM configurations in prod is not computationally feasible, a static input matrix would quickly become out of date as new features are released. This talk presents our system for detecting untested parameter interactions before releasing new software to production by validating test results against a domain model. We use boolean rules to define the high-level compatibility requirements of each feature and automatically map them to physical configuration values. These rules are also used to generate new tests that provide comprehensive t-way test coverage over our configuration input space. By automatically generating these tests, we can keep our coverage up-to-date as product features change and also remove the need for engineers to manually write interaction tests.
Thu 20 AprDisplayed time zone: Dublin change
14:00 - 15:30 | |||
14:00 30mTalk | Cloud-native Continuous Integration system for large enterprise software projects CCIW | ||
14:30 30mTalk | Predicting Compiler Resource Utilization CCIW Marc Türke SAP SE, Bartosz Bogacz SAP SE, Eric Heim SAP SE, Torsten Mandel SAP SE, Stephan Kraft SAP SE | ||
15:00 30mTalk | Automating Combinatorial Test Coverage for Cloud Virtualization CCIW File Attached |