Write a Blog >>
ICSE 2021
Mon 17 May - Sat 5 June 2021
Wed 26 May 2021 19:30 - 19:50 at Blended Sessions Room 3 - 2.5.3. Code Completion Chair(s): Marsha Chechik
Thu 27 May 2021 07:30 - 07:50 at Blended Sessions Room 3 - 2.5.3. Code Completion

Code completion is a popular software development tool integrated into all major IDEs. Many neural language models have achieved promising results in completion suggestion prediction on synthetic benchmarks. However, a recent study When Code Completion Fails: a Case Study on Real-World Completions demonstrates that these results may not translate to improvements in real-world performance. To combat this effect, we train models on real-world code completion examples and find that these models outperform models trained on committed source code and working version snapshots by 12.8% and 13.8% accuracy respectively. We observe this improvement across modeling technologies and show through A/B testing that it corresponds to a 6.2% increase in programmers’ actual autocompletion usage. Furthermore, our study characterizes a large corpus of logged autocompletion usages to investigate why training on real-world examples leads to stronger models.

Conference Day
Wed 26 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

18:50 - 19:50
2.5.3. Code CompletionSEIP - Software Engineering in Practice / Technical Track at Blended Sessions Room 3 +12h
Chair(s): Marsha ChechikUniversity of Toronto
18:50
20m
Paper
Siri, Write the Next MethodTechnical Track
Technical Track
Fengcai WenSoftware Institute, USI Università della Svizzera italiana, Emad AghajaniSoftware Institute, USI Università della Svizzera italiana, Csaba NagySoftware Institute, USI Università della Svizzera italiana, Michele LanzaSoftware Institute, USI Università della Svizzera italiana, Gabriele BavotaSoftware Institute, USI Università della Svizzera italiana
Pre-print Media Attached
19:10
20m
Paper
Code Prediction by Feeding Trees to TransformersTechnical Track
Technical Track
Seohyun KimFacebook, Jinman ZhaoUniversity of Wisconsin-Madison, USA, Yuchi TianColumbia University, Satish ChandraFacebook, USA
Pre-print
19:30
20m
Paper
Learning Autocompletion from Real-World DatasetsSEIP
SEIP - Software Engineering in Practice
Gareth AyeFacebook, Inc., Seohyun KimFacebook, Hongyu LiFacebook, Inc.
Pre-print

Conference Day
Thu 27 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

06:50 - 07:50
06:50
20m
Paper
Siri, Write the Next MethodTechnical Track
Technical Track
Fengcai WenSoftware Institute, USI Università della Svizzera italiana, Emad AghajaniSoftware Institute, USI Università della Svizzera italiana, Csaba NagySoftware Institute, USI Università della Svizzera italiana, Michele LanzaSoftware Institute, USI Università della Svizzera italiana, Gabriele BavotaSoftware Institute, USI Università della Svizzera italiana
Pre-print Media Attached
07:10
20m
Paper
Code Prediction by Feeding Trees to TransformersTechnical Track
Technical Track
Seohyun KimFacebook, Jinman ZhaoUniversity of Wisconsin-Madison, USA, Yuchi TianColumbia University, Satish ChandraFacebook, USA
Pre-print
07:30
20m
Paper
Learning Autocompletion from Real-World DatasetsSEIP
SEIP - Software Engineering in Practice
Gareth AyeFacebook, Inc., Seohyun KimFacebook, Hongyu LiFacebook, Inc.
Pre-print