Emerging Compiler Testing Based on Test Case Reuse
With the rapid development of computer technology, emerging programming languages and compilers are constantly being introduced. However, these new compilers often have defects due to their short development time, insufficient testing, and the challenges they face, which affect their reliability and adoption. Traditional testing methods are limited in addressing the challenges of testing these new compilers. This paper proposes a new method for testing emerging compilers based on test case reuse, utilizing large language models to convert test cases from one programming language to another. Using C++ and Carbon language as examples, historical test cases from C++ are converted to Carbon language versions to expand the test case library for the Carbon compiler. This method involves training a large language model to transform C++ historical vulnerability codes into codes suitable for the Carbon compiler, followed by verification to ensure their effectiveness. By converting and reusing test cases and implanting feature conversions to generate mutations, we improve 13.9% test coverage for Carbon compiler and discover 8 bugs.
Fri 20 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
16:00 - 17:30 | Session3: Software Testing and Quality AssuranceResearch Track / Tool Demonstration Track / New Idea Track at Cosmos 3A Chair(s): Yanjie Zhao Huazhong University of Science and Technology | ||
16:00 15mTalk | SRLRF: Fine-Grained Root Cause Analysis and Prediction for Compiler Optimization Defects Research Track Han Luo Nanjing University of Aeronautics and Astronautics, Yixuan Tang Nanjing University of Aeronautics and Astronautics, Jingxuan Zhang Nanjing University of Aeronautics and Astronautics, Xuanyan Zhu Nanjing University of Aeronautics and Astronautics, Jiayi Li Nanjing University of Aeronautics and Astronautics, Weiqin Zou Nanjing University of Aeronautics and Astronautics, Jiaqi Liu National Key Laborarory on Test Physics & Numerical Mathematics | ||
16:15 15mTalk | Revisit the Intuition of Mutation-Based Fault Localization in Real-world Programs Research Track Chenliang Xing Wuhan University, Gong Chen Wuhan University, Qi Xin Wuhan University, Xiaoyuan Xie Wuhan University Media Attached | ||
16:30 15mTalk | Emerging Compiler Testing Based on Test Case Reuse Research Track Kelin Zhu School of Intelligent Software and Engineering, Nanjing University, Suzhou 215163, China, Yu Wang Nanjing University, Linzhang Wang State Key Laboratory for Novel Software Technology (Nanjing University, Nanjing 210023, China, Xuandong Li Nanjing University | ||
16:45 10mTalk | UITrans: Seamless UI Translation from Android to HarmonyOSBest Tool Demo Award Tool Demonstration Track Lina Gong Nanjing University of Aeronautics and Astronautic, Chen Wang Nanjing University of Aeronautics and Astronautics, Di Cui Xidian University, Yujun Huang Nanjing University of Aeronautics and Astronautics, Mingqiang Wei Nanjing University of Aeronautics and Astronautics | ||
17:05 10mTalk | XR4PD: Augmented Reality for Visualising Problem Diagrams in Requirements Analysis New Idea Track Yang Hua Guangxi Normal University, Hongbin Xiao Guangxi Key Lab of Multi-Source Information Mining and Securit(Guangxi Normal University), Wenhao Wang Guangxi Normal University, Zhi Li Guangxi Normal University | ||
17:15 15mTalk | Cluster-Based Multi-Objective Metamorphic Test Case Pair Selection for Deep Neural Networks Research Track Jingling Wang Nanjing University, Shuwei Qiu Nanjing University, Peng Wang Nanjing University, Jiyuan Song Nanjing University, Huayao Wu Nanjing University, Xintao Niu Nanjing University, Changhai Nie Nanjing University Pre-print Media Attached |
Cosmos 3A is the first room in the Cosmos 3 wing.
When facing the main Cosmos Hall, access to the Cosmos 3 wing is on the left, close to the stairs. The area is accessed through a large door with the number “3”, which will stay open during the event.