Automated Assertion Generation via Information Retrieval and Its Integration with Deep Learning
Thu 12 May 2022 04:05 - 04:10 at ICSE room 3-even hours - Testing and Analysis Chair(s): Jie Zhang
Unit testing can be used to validate the correctness of basic units of the software under test. To reduce developers’ efforts of conducting unit testing, the research community has contributed with tools that automatically generate unit test cases, including test inputs and test oracles, e.g., assertions. Recently, an approach named ATLAS based on deep learning (DL) was proposed to generate assertions for a unit test based on other already written unit tests, yet with still low effectiveness. To improve the effectiveness, in this work, we make the first attempt to leverage Information Retrieval (IR) in assertion generation and propose an IR-based approach including the technique of \IRtech{} and the technique of \Adapttech{}. We also propose an integration approach for integrating our IR-based approach and a DL-based approach such as ATLAS to further improve the effectiveness. Our evaluation results show that our proposed IR-based approach outperforms ATLAS (the state-of-the-art DL-based approach), and integrating our \IRapproach{} approach and the DL-based approach can help achieve the highest accuracy. Our results convey an important message that an \IRapproach{} approach can be competitive and worthwhile to pursue for software engineering tasks such as assertion generation, and should be seriously considered by the research community given that in recent years deep learning solutions have been over-popularly adopted by the research community for software engineering tasks.
Wed 11 MayDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:00 | Autonomic Systems and Self-AdaptationSEIS - Software Engineering in Society / Technical Track at ICSE room 4-odd hours Chair(s): Henry Muccini University of L'Aquila, Italy | ||
11:00 5mTalk | Software Engineers’ Response to Public Crisis: Lessons Learnt from Spontaneously Building an Informative COVID-19 Dashboard SEIS - Software Engineering in Society Han Wang Monash University, Chao Wu Monash University, Chunyang Chen Monash University, Burak Turhan University of Oulu, Shiping Chen Data61 at CSIRO, Australia / UNSW, Australia, Jon Whittle CSIRO's Data61 and Monash University Pre-print Media Attached | ||
11:05 5mTalk | DRESS-ML: A Domain-specific Language for Modelling Exceptional Scenarios and Self-adaptive Behaviours for Drone-based Applications SEIS - Software Engineering in Society Lucas Vieira State University of Ceará, José Davi da Silva Pereira State University of Ceara, Brazil, Natália Aragão State University of Ceara, Brazil, Matheus Chagas State University of Ceará, Paulo Maia State University of Ceará Pre-print Media Attached | ||
11:10 5mTalk | Lowering Barriers to Application Development With Cloud-Native Domain-Specific Functions SEIS - Software Engineering in Society José Miguel Pérez-Álvarez NAVER LABS Europe, Adrian Mos NAVER LABS Europe, Benjamin V. Hanrahan Pennsylvania State University, Iyadunni J. Adenuga Pennsylvania State University Pre-print Media Attached | ||
11:15 5mTalk | Automated Assertion Generation via Information Retrieval and Its Integration with Deep Learning Technical Track Hao Yu Peking University, Yiling Lou Purdue University, Ke Sun , Dezhi Ran Peking University, Tao Xie Peking University, Dan Hao Peking University, Ying Li School of Software and Microelectronics, Peking University, Beijing, China, Ge Li Peking University, Qianxiang Wang Huawei Technologies Co. Ltd DOI Pre-print Media Attached |
Thu 12 MayDisplayed time zone: Eastern Time (US & Canada) change
04:00 - 05:00 | |||
04:00 5mTalk | Static Stack-Preserving Intra-Procedural Slicing of WebAssembly BinariesBest Artifact Award Technical Track Quentin Stiévenart Vrije Universiteit Brussel, David Binkley Loyola University Maryland, Coen De Roover Vrije Universiteit Brussel DOI Pre-print Media Attached | ||
04:05 5mTalk | Automated Assertion Generation via Information Retrieval and Its Integration with Deep Learning Technical Track Hao Yu Peking University, Yiling Lou Purdue University, Ke Sun , Dezhi Ran Peking University, Tao Xie Peking University, Dan Hao Peking University, Ying Li School of Software and Microelectronics, Peking University, Beijing, China, Ge Li Peking University, Qianxiang Wang Huawei Technologies Co. Ltd DOI Pre-print Media Attached | ||
04:10 5mTalk | Combinatorial Testing of RESTful APIs Technical Track Huayao Wu Nanjing University, Lixin Xu Nanjing University, Xintao Niu Nanjing University, Changhai Nie Nanjing University Pre-print Media Attached | ||
04:15 5mTalk | History-Driven Test Program Synthesis for JVM Testing Technical Track Yingquan Zhao Tianjin University, Zan Wang Tianjin University, China, Junjie Chen Tianjin University, Mengdi Liu College of Intelligence and Computing, Tianjin University, Mingyuan Wu Southern University of Science and Technology, Yuqun Zhang Southern University of Science and Technology, Lingming Zhang University of Illinois at Urbana-Champaign Pre-print Media Attached | ||
04:20 5mTalk | On the Reliability of Coverage-Based Fuzzer Benchmarking Technical Track Marcel Böhme MPI-SP, Germany and Monash University, Australia, Laszlo Szekeres Google, Jonathan Metzman Google DOI Pre-print Media Attached |