ASE 2023
Mon 11 - Fri 15 September 2023 Kirchberg, Luxembourg
Wed 13 Sep 2023 13:30 - 13:42 at Room E - Code Change Analysis Chair(s): Vladimir Kovalenko

Adversarial examples are important to test and enhance the robustness of deep code models. As source code is discrete and has to strictly stick to complex grammar and semantics constraints, the adversarial example generation techniques in other domains are hardly applicable. Moreover, the adversarial example generation techniques specific to deep code models still suffer from unsatisfactory effectiveness due to the enormous ingredient search space. In this work, we propose a novel adversarial example generation technique (i.e., CODA) for testing deep code models. Its key idea is to use code differences between the target input (i.e., a given code snippet as the model input) and reference inputs (i.e., the inputs that have small code differences but different prediction results with the target input) to guide the generation of adversarial examples. It considers both structure differences and identifier differences to preserve the original semantics. Hence, the ingredient search space can be largely reduced as the one constituted by the two kinds of code differences, and thus the testing process can be improved by designing and guiding corresponding equivalent structure transformations and identifier renaming transformations. Our experiments on 15 deep code models demonstrate the effectiveness and efficiency of CODA, the naturalness of its generated examples, and its capability of enhancing model robustness after adversarial fine-tuning. For example, CODA reveals 88.05% and 72.51% more faults in models than the state-of-the-art techniques (i.e., CARROT and ALERT) on average, respectively.

Wed 13 Sep

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

13:30 - 15:00
Code Change AnalysisResearch Papers / Journal-first Papers at Room E
Chair(s): Vladimir Kovalenko JetBrains Research
13:30
12m
Talk
Code Difference Guided Adversarial Example Generation for Deep Code Models
Research Papers
Zhao Tian Tianjin University, Junjie Chen Tianjin University, Zhi Jin Peking University
Pre-print File Attached
13:42
12m
Talk
DiffSearch: A Scalable and Precise Search Engine for Code Changes
Journal-first Papers
Luca Di Grazia University of Stuttgart, Paul Bredl University of Stuttgart, Michael Pradel University of Stuttgart
Link to publication DOI Pre-print File Attached
13:54
12m
Talk
ZC3 Zero-Shot Cross-Language Code Clone Detection
Research Papers
Jia Li , Chongyang Tao Peking University, Zhi Jin Peking University, Fang Liu Beihang University, Jia Li Peking University, Ge Li Peking University
Pre-print File Attached
14:06
12m
Talk
Persisting and Reusing Results of Static Program Analyses on a Large Scale
Research Papers
Johannes Düsing TU Dortmund University, Ben Hermann TU Dortmund, Ben Hermann TU Dortmund
Pre-print
14:18
12m
Talk
Optimizing Continuous Development By Detecting and Preventing Unnecessary Content Generation
Research Papers
Talank Baral George Mason University, Shanto Rahman The University of Texas at Austin, Bala Naren Chanumolu George Mason University, Basak Balci Ozyegin University, Tuna Tuncer Ozyegin University, August Shi The University of Texas at Austin, Wing Lam George Mason University
Pre-print Media Attached
14:30
12m
Talk
iASTMapper: An Iterative Similarity-Based Abstract Syntax Tree Mapping AlgorithmRecorded talk
Research Papers
Neng Zhang School of Software Engineering, Sun Yat-sen University, ChenQinde School of Software Engineering, Sun Yat-sen University, Zibin Zheng Sun Yat-sen University, Ying Zou Queen's University, Kingston, Ontario
Pre-print Media Attached