DRWASI: LLM-assisted Differential Testing for WebAssembly System Interface Implementations
WebAssembly (Wasm) is an emerging binary format that serves as a compilation target for over 40 programming languages. Wasm runtimes provide execution environments that enhance portability by abstracting away operating systems and hardware details. A key component in these runtimes is the WebAssembly System Interface (WASI), which manages interactions with operating systems, like file operations. Considering the critical role of Wasm runtimes, the community has aimed to detect their implementation bugs. However, no work has focused on WASI-specific bugs that can affect the original functionalities of running Wasm binaries and cause unexpected results. To fill the void, we present DRWASI, the first general-purpose differential testing framework for WASI implementations. Our approach uses a large language model to generate seeds and applies variant and environment mutation strategies to expand and enrich the test case corpus. We then perform differential testing across major Wasm runtimes. By leveraging dynamic and static information collected during and after the execution, DRWASI can identify bugs. Our evaluation shows that DRWASI uncovered 33 unique bugs, with all confirmed and 7 fixed by developers. This research represents a pioneering step in exploring a promising yet under-explored area of the Wasm ecosystem, providing valuable insights for stakeholders.
Mon 23 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
16:00 - 18:00 | Testing 2Journal First / Research Papers at Cosmos 3A Chair(s): Miryung Kim UCLA and Amazon Web Services | ||
16:00 20mTalk | Search-based DNN Testing and Retraining with GAN-enhanced Simulations Journal First Mohammed Attaoui University of Luxembourg, Fabrizio Pastore University of Luxembourg, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland | ||
16:20 20mTalk | TEASMA: A Practical Methodology for Test Adequacy Assessment of Deep Neural Networks Journal First Amin Abbasishahkoo The School of EECS, University of Ottawa, Mahboubeh Dadkhah University of Ottawa, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland, Dayi Lin Centre for Software Excellence, Huawei Canada | ||
16:40 20mTalk | VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulation Research Papers Zhijie Wang University of Alberta, Zhehua Zhou University of Alberta, Canada, Jiayang Song , Yuheng Huang The University of Tokyo, Zhan Shu University of Alberta, Lei Ma The University of Tokyo & University of Alberta DOI Pre-print | ||
17:00 20mTalk | DRWASI: LLM-assisted Differential Testing for WebAssembly System Interface Implementations Journal First Yixuan Zhang Peking University, Ningyu He Hong Kong Polytechnic University, Jianting Gao Huazhong University of Science and Technology, Shangtong Cao Beijing University of Posts and Telecommunications, Kaibo Liu Peking University, Haoyu Wang Huazhong University of Science and Technology, Yun Ma Peking University, Gang Huang Peking University, Xuanzhe Liu Peking University | ||
17:20 20mTalk | MR-Scout: Automated Synthesis of Metamorphic Relations from Existing Test Cases Journal First Congying Xu The Hong Kong University of Science and Technology, China, Valerio Terragni University of Auckland, Hengcheng Zhu The Hong Kong University of Science and Technology, Jiarong Wu , Shing-Chi Cheung Hong Kong University of Science and Technology | ||
17:40 20mTalk | UnitCon: Synthesizing Targeted Unit Tests for Java Runtime Exceptions Research Papers Sujin Jang KAIST, Yeonhee Ryou KAIST, Heewon Lee KAIST, Korea, South (The Republic of), Kihong Heo KAIST DOI | ||
Cosmos 3A is the first room in the Cosmos 3 wing.
When facing the main Cosmos Hall, access to the Cosmos 3 wing is on the left, close to the stairs. The area is accessed through a large door with the number “3”, which will stay open during the event.