ICSME 2025
Sun 7 - Fri 12 September 2025 Auckland, New Zealand
Thu 11 Sep 2025 10:45 - 11:00 at Case Room 3 260-055 - Session 7 - Testing 2 Chair(s): Jiajun Jiang

MLIR, a modular compiler framework, evolves quickly, with regular updates expanding its dialects and operations across LLVM versions and downstream projects. This fast development reduces the effectiveness of traditional fuzzing tools, which test only a small portion of dialects, require extensive manual work (e.g., nearly ten thousand lines of C++ code), and do not match the update speed of MLIR. To address these challenges, we propose Nüwa, the first LLM-based approach for MLIR fuzzing. Nüwa employs a two-phase strategy: first generating valid operations by encoding constraints into LLMs prompts, then synthesizing multi-operation test cases by learning inter-operation dependencies. To enhance operation coverage, it incorporates high-coverage cases from MLIR’s test suite and uses LLM-driven mutations to boost diversity. A self-improvement mechanism enhances the prompts using feedback from high-quality test cases, improving the LLMs’ understanding of MLIR’s complex semantics. Nüwa demonstrates that the generation and mutation process can be fully automated via the intrinsic capabilities of LLMs (including in-context learning), while being applicable to MLIR’s fast evolution. The experimental study shows that Nüwa outperforms the state-of-the-art tools MLIRSmith and MLIRod, detecting 2.9x more unique bugs and achieving 1.6x greater code coverage. To date, Nüwa has identified 55 bugs in the MLIR framework, with 18 confirmed or fixed.

Thu 11 Sep

Displayed time zone: Auckland, Wellington change

10:30 - 12:00
10:30
15m
OptionFuzz: Fuzzing SMT Solvers with Optimized Option Exploration via Large Language Models
Research Papers Track
Yuhao Peng (Institute of Software, Chinese Academy of Sciences; University of Chinese Academy of Sciences), Jingzheng Wu Institute of Software, The Chinese Academy of Sciences, Xiang Ling Institute of Software, Chinese Academy of Sciences, Zhiyuan Li , Tianyue Luo (Institute of Software Chinese Academy of Sciences), Yanjun Wu Institute of Software, Chinese Academy of Sciences
10:45
15m
Nüwa: Enhancing MLIR Fuzzing with LLM-Driven Generation and Adaptive Mutation
Research Papers Track
Bocan Cao Northwest University, Weiyuan Tong Northwest University, Zhanyong Tang Northwest University, Zixu Wang Northwest University, Hao Huang Northwest University, Yuheng Yan Northwest University
11:00
10m
MediumDarwin: LittleDarwin Grows with Performance and Research-oriented Extensions
Tool Demonstration Track
Sajjad Hesamipour Khelejan School of Computer Science and Statistics, Trinity College Dublin & Research Ireland Lero, Thomas Laurent School of Computer Science and Statistics, Trinity College Dublin & Research Ireland Lero, Anthony Ventresque School of Computer Science and Statistics, Trinity College Dublin & Research Ireland Lero
11:10
10m
Rethinking Cognitive Complexity for Unit Tests: Toward a Readability-Aware Metric Grounded in Developer Perception
NIER Track
Wendkuuni Arzouma Marc Christian OUEDRAOGO University of Luxembourg, Yinghua Li University of Luxembourg, Xueqi Dang University of Luxembourg, SnT, Xin Zhou Singapore Management University, Singapore, Anil Koyuncu Bilkent University, Jacques Klein University of Luxembourg, David Lo Singapore Management University, Tegawendé F. Bissyandé University of Luxembourg
11:20
15m
Targeted Test Selection Approach in Continuous IntegrationOnline
Industry Track
Pavel Plyusnin T-Technologies, Aleksey Antonov T-Technologies, Vasilii Ermakov T-Technologies, Aleksandr Khaybriev T-Technologies, Margarita Kikot T-Technologies, Nikolay Bushkov T-Technologies, Stanislav Moiseev T-Technologies
DOI Pre-print
11:35
15m
An Empirical Investigation into the Capabilities of Anomaly Detection Approaches for Test Smell Detection
Journal First Track
Valeria Pontillo Gran Sasso Science Institute, Luana Martins University of Salerno, Ivan Machado Federal University of Bahia - UFBA, Fabio Palomba University of Salerno, Filomena Ferrucci Università di Salerno
DOI Pre-print
11:50
10m
Research paper
Assessing Reliability of Statistical Maximum Coverage Estimators in FuzzingOnline
Registered Reports
Danushka Liyanage University of Sydney, Australia, Nelum Attanayake University of Sydney, Australia, Zijian Luo University of Sydney, Australia, Rahul Gopinath University of Sydney
DOI Pre-print Media Attached