BeDivFuzz: Integrating Behavioral Diversity into Generator-based Fuzzing
Thu 12 May 2022 03:25 - 03:30 at ICSE room 5-odd hours - Software Testing 4 Chair(s): Aldeida Aleti
Thu 26 May 2022 11:25 - 11:30 at Room 301+302 - Papers 15: Software Testing 2 Chair(s): Rohan Padhye
A popular metric to evaluate the performance of fuzzers is branch coverage. However, we argue that focusing solely on covering many different branches (i.e., the richness) is not sufficient, since the majority of the covered branches may have been exercised only once, which does not inspire a high confidence in the reliability of the covered code. Instead, the distribution of the executed branches (i.e., the evenness) should be considered as well. That is, behavioral diversity is only given if the generated inputs not only trigger many different branches, but also trigger them evenly often with diverse inputs. We introduce BeDivFuzz, a feedback-driven fuzzing technique for generator-based fuzzers. BeDivFuzz distinguishes between structure-preserving and structure-changing mutations in the space of syntactically valid inputs, and biases its mutation strategy towards behavioral diversity based on the received program feedback. We have evaluated BeDivFuzz on Ant, Maven, Closure, Rhino, and Nashorn. The results show that BeDivFuzz achieves better behavioral diversity compared to the state of the art, measured by established biodiversity metrics from the field of ecology.
Wed 11 MayDisplayed time zone: Eastern Time (US & Canada) change
12:00 - 13:00 | Software Testing 12Technical Track / Journal-First Papers / SEIP - Software Engineering in Practice at ICSE room 4-even hours Chair(s): Frank Tip Northeastern University | ||
12:00 5mTalk | Mutation Analysis for Cyber-Physical Systems: Scalable Solutions and Results in the Space Domain Journal-First Papers Oscar Cornejo SnT Centre, University of Luxembourg, Fabrizio Pastore University of Luxembourg, Lionel Briand University of Luxembourg; University of Ottawa Link to publication DOI Pre-print Media Attached | ||
12:05 5mTalk | Using Natural Language Processing Techniques to Improve Manual Test Case Descriptions SEIP - Software Engineering in Practice Markos Viggiato University of Alberta, Dale Paas Prodigy Education, Chris Buzon Prodigy Education, Cor-Paul Bezemer University of Alberta Pre-print Media Attached | ||
12:10 5mTalk | Repairing Order-Dependent Flaky Tests via Test Generation Technical Track Chengpeng Li University of Texas at Austin, Chenguang Zhu University of Texas at Austin, Wenxi Wang University of Texas at Austin, August Shi University of Texas at Austin Link to publication DOI Media Attached | ||
12:15 5mTalk | One Fuzzing Strategy to Rule Them All Technical Track Mingyuan Wu Southern University of Science and Technology, Ling Jiang Southern University of Science and Technology, Jiahong Xiang Southern University of Science and Technology, Yanwei Huang Zhejiang University, Heming Cui University of Hong Kong, Lingming Zhang University of Illinois at Urbana-Champaign, Yuqun Zhang Southern University of Science and Technology Pre-print Media Attached | ||
12:20 5mTalk | BeDivFuzz: Integrating Behavioral Diversity into Generator-based Fuzzing Technical Track Pre-print Media Attached | ||
12:25 5mTalk | Preempting Flaky Tests via Non-Idempotent-Outcome Tests Technical Track Anjiang Wei Stanford University, Pu Yi Peking University, Zhengxi Li University of Illinois Urbana-Champaign, Tao Xie Peking University, Darko Marinov University of Illinois at Urbana-Champaign, Wing Lam University of Illinois at Urbana-Champaign Pre-print Media Attached |
Thu 12 MayDisplayed time zone: Eastern Time (US & Canada) change
03:00 - 04:00 | Software Testing 4Technical Track / Journal-First Papers / SEIP - Software Engineering in Practice at ICSE room 5-odd hours Chair(s): Aldeida Aleti Monash University | ||
03:00 5mTalk | Mutation Analysis for Cyber-Physical Systems: Scalable Solutions and Results in the Space Domain Journal-First Papers Oscar Cornejo SnT Centre, University of Luxembourg, Fabrizio Pastore University of Luxembourg, Lionel Briand University of Luxembourg; University of Ottawa Link to publication DOI Pre-print Media Attached | ||
03:05 5mTalk | Automated Visual Testing for Mobile Apps in an Industrial Setting SEIP - Software Engineering in Practice Dezhi Ran Peking University, Zongyang Li Peking University, Chenxu Liu Peking University, Wenyu Wang University of Illinois Urbana-Champaign, Weizhi Meng Alibaba Group, Xionglin Wu Alibaba Group, Hui Jin Alibaba Group, Jing Cui Alibaba Group, Xing Tang Alibaba Group, Tao Xie Peking University DOI Pre-print | ||
03:10 5mTalk | FADATest: Fast and Adaptive Performance Regression Testing of Dynamic Binary Translation Systems Technical Track Jin Wu Harbin Institute of Technology, Jian Dong Harbin Institute Of Technology, Ruili Fang University of Georgia, Wen Zhang University of Georgia, Wenwen Wang University of Georgia, Decheng Zuo Harbin Institute of Technology Pre-print Media Attached | ||
03:15 5mTalk | Repairing Order-Dependent Flaky Tests via Test Generation Technical Track Chengpeng Li University of Texas at Austin, Chenguang Zhu University of Texas at Austin, Wenxi Wang University of Texas at Austin, August Shi University of Texas at Austin Link to publication DOI Media Attached | ||
03:20 5mTalk | Controlled Concurrency Testing via Periodical Scheduling Technical Track Cheng Wen Xidian University, Mengda He SCEDT, Teesside University, Bohao Wu CSSE, Shenzhen University, Zhiwu Xu Shenzhen University, Shengchao Qin Huawei Hong Kong Research Centre, China DOI Pre-print Media Attached | ||
03:25 5mTalk | BeDivFuzz: Integrating Behavioral Diversity into Generator-based Fuzzing Technical Track Pre-print Media Attached |
Thu 26 MayDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:30 | Papers 15: Software Testing 2Technical Track / SEIP - Software Engineering in Practice at Room 301+302 Chair(s): Rohan Padhye Carnegie Mellon University | ||
11:00 5mTalk | CONFETTI: Amplifying Concolic Guidance for Fuzzers Technical Track James Kukucka George Mason University, Luís Pina University of Illinois at Chicago, Paul Ammann George Mason University, USA, Jonathan Bell Northeastern University Pre-print Media Attached | ||
11:05 5mTalk | Surveying the Developer Experience of Flaky Tests SEIP - Software Engineering in Practice Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, USA, Phil McMinn University of Sheffield Pre-print Media Attached | ||
11:10 5mTalk | Natural Attack for Pre-trained Models of Code Technical Track Zhou Yang Singapore Management University, Jieke Shi Singapore Management University, Junda He Singapore Management University, David Lo Singapore Management University DOI Pre-print Media Attached | ||
11:15 5mTalk | FADATest: Fast and Adaptive Performance Regression Testing of Dynamic Binary Translation Systems Technical Track Jin Wu Harbin Institute of Technology, Jian Dong Harbin Institute Of Technology, Ruili Fang University of Georgia, Wen Zhang University of Georgia, Wenwen Wang University of Georgia, Decheng Zuo Harbin Institute of Technology Pre-print Media Attached | ||
11:20 5mTalk | Repairing Order-Dependent Flaky Tests via Test Generation Technical Track Chengpeng Li University of Texas at Austin, Chenguang Zhu University of Texas at Austin, Wenxi Wang University of Texas at Austin, August Shi University of Texas at Austin Link to publication DOI Media Attached | ||
11:25 5mTalk | BeDivFuzz: Integrating Behavioral Diversity into Generator-based Fuzzing Technical Track Pre-print Media Attached | ||
11:30 5mTalk | Nessie: Automatically Testing JavaScript APIs with Asynchronous Callbacks Technical Track Ellen Arteca Northeastern University, Sebastian Harner University of Stuttgart, Michael Pradel University of Stuttgart, Frank Tip Northeastern University Pre-print Media Attached | ||
11:35 5mTalk | EAGLE: Creating Equivalent Graphs to Test Deep Learning Libraries Technical Track Jiannan Wang Purdue University, Thibaud Lutellier University of Waterloo, Shangshu Qian Purdue University, Hung Viet Pham University of Waterloo, Lin Tan Purdue University Pre-print Media Attached |