Write a Blog >>
ICSE 2020
Mon 5 - Sun 11 October 2020 Yongsan-gu, Seoul, South Korea
Mon 5 Oct 2020 11:50 - 12:10 at TBD3 - Continuous Integration

With the growing use of DevOps tools and frameworks, there is an increased need for tools and techniques that support \emph{more than code}. The current state-of-the-art in static developer assistance for tools like Docker is limited to shallow syntactic validation. We identify three core challenges in the realm of learning from, understanding, and supporting developers writing DevOps artifacts: (i) nested languages in DevOps artifacts, (ii) rule mining, and (iii) the lack of semantic rule-based analysis. To address these challenges we introduce a toolset, binnacle, that enabled us to ingest 900,000 GitHub repositories.

Focusing on Docker, we extracted approximately 219,000 Dockerfiles, and also identified a Gold Set of Dockerfiles written by Docker experts. We addressed challenge (i) by reducing the number of effectively uninterpretable nodes in our ASTs by over 80% via a technique we call \emph{phased parsing}. To address challenge (ii), we introduced a novel rule-mining technique capable of recovering two-thirds of the rules in a benchmark we curated. Through this automated mining, we were able to recover 16 new rules that were not found during manual rule collection. To address challenge (iii), we manually collected a set of rules for Dockerfiles from commits to the files in the Gold Set. These rules encapsulate best practices, avoid docker build failures, and improve image size and build latency. We created an analyzer that used these rules, and found that, on average, Dockerfiles on GitHub violated the rules \emph{six times more frequently} than the Dockerfiles in our Gold Set. We also found that industrial Dockerfiles fared no better than those sourced from GitHub.

The learned rules and analyzer in binnacle can be used to aid developers in the IDE when creating Dockerfiles, and in a post-hoc fashion to identify issues in, and to improve, existing Dockerfiles.

Mon 5 Oct

10:50 - 12:30: Paper Presentations - Continuous Integration at TBD3
icse-2020-papers10:50 - 11:10
Antonia BertolinoCNR-ISTI, Antonio GuerrieroUniversità di Napoli Federico II, Breno MirandaFederal University of Pernambuco, Roberto PietrantuonoUniversità di Napoli Federico II, Stefano RussoUniversità di Napoli Federico II
icse-2020-papers11:10 - 11:30
Xianhao JinVirginia Tech, USA, Francisco ServantVirginia Tech
icse-2020-papers11:30 - 11:50
Thodoris SotiropoulosAthens University of Economics and Business, Dimitris MitropoulosAthens University of Economics and Business, Diomidis SpinellisAthens University of Economics and Business
icse-2020-papers11:50 - 12:10
Jordan HenkelUniversity of Wisconsin–Madison, Christian BirdMicrosoft Research, Shuvendu K. LahiriMicrosoft Research, Thomas RepsUniversity of Wisconsin - Madison and GrammaTech, Inc.
icse-2020-Journal-First12:10 - 12:30
Taher Ahmed GhalebQueen's University, Daniel Alencar Da CostaUniversity of Otago, Ying ZouQueen's University, Kingston, Ontario
Link to publication DOI Pre-print