Source code documentation is an important artifact for efficient software development. Code documentation could greatly benefit from automation since manual documentation is often labouring, resource and time-intensive. In this paper, we employed Codex for automatic code documentation creation. Codex is a GPT-3 based model pre-trained on both natural and programming languages. We find that Codex outperforms existing techniques even with basic settings like one-shot learning (i.e., providing only one example for training). Codex achieves an overall BLEU score of 20.6 for six different programming languages (11.2% improvement over earlier state-of-the-art techniques). Thus, Codex shows promise and warrants in-depth future studies for automatic code documentation generation to support diverse development tasks.
Tue 11 OctDisplayed time zone: Eastern Time (US & Canada) change
14:00 - 15:30 | Technical Session 6 - Source Code ManipulationNIER Track / Research Papers / Late Breaking Results at Banquet A Chair(s): Collin McMillan University of Notre Dame | ||
14:00 10mVision and Emerging Results | Automatic Code Documentation Generation Using GPT-3 NIER Track | ||
14:10 20mResearch paper | Automated Feedback Generation for Competition-Level Code Research Papers Jialu Zhang Yale University, De Li The MathWorks, Inc., John C. Kolesar Yale University, Hanyuan Shi N/A, Ruzica Piskac Yale University | ||
14:30 10mPaper | Generalizability of Code Clone Detection on CodeBERT Late Breaking Results Tim Sonnekalb German Aerospace Center (DLR), Bernd Gruner German Aerospace Center (DLR), Clemens-Alexander Brust German Aerospace Center (DLR), Patrick Mäder Technische Universität Ilmenau DOI Pre-print | ||
14:40 10mVision and Emerging Results | Next Syntactic-Unit Code Completion and Applications NIER Track Hoan Anh Nguyen Amazon, Aashish Yadavally University of Texas at Dallas, Tien N. Nguyen University of Texas at Dallas | ||
14:50 20mResearch paper | CrystalBLEU: Precisely and Efficiently Measuring the Similarity of CodeVirtualACM SIGSOFT Distinguished Paper Award Research Papers | ||
15:10 20mResearch paper | Low-Resources Project-Specific Code SummarizationVirtual Research Papers Rui Xie Peking University, Tianxiang Hu Peking University, Wei Ye Peking University, Shikun Zhang Peking University |