Predicting Defective Visual Code Changes in a Multi-Language AAA Video Game Project
Video game development increasingly relies on using visual programming languages as the primary way to build video game features. The aim of using visual programming is to move game logic into the hands of game designers, who may not be as well versed in textual coding. In this paper, we empirically observe that there are more defect-inducing commits containing visual code than textual code in a AAA video game project codebase. This indicates that the existing textual code Just-in-Time (JIT) defect prediction models under evaluation by Electronic Arts (EA) may be ineffective as they do not account for changes in visual code. Thus, we focus our research on constructing visual code defect prediction models that encompass visual code metrics and evaluate the models against defect prediction models that use language agnostic features, and textual code metrics. We test our models using features extracted from the historical codebase of a AAA video game project, as well as the historical codebases of 70 open source projects that use textual and visual code. We find that defect prediction models have better performance overall in terms of the area under the ROC curve (AUC), and Mathews Correlation Coefficient (MCC) when incorporating visual code features for projects that contain more commits with visual code than textual code.
Thu 5 OctDisplayed time zone: Bogota, Lima, Quito, Rio Branco change
15:30 - 17:00 | Software FaultsIndustry Track / Research Track / Journal First Track at Session 1 Room - RGD 004 Chair(s): Masud Rahman Dalhousie University, Ashkan Sami Edinburgh Napier University | ||
15:30 16mTalk | An Empirical Study on Fault Diagnosisa in Robotic Systems Research Track Xuezhi Song Fudan University, Yi Li , Zhen Dong Fudan University, China, Shuning Liu Fudan University, Junming Cao Fudan University, Xin Peng Fudan University | ||
15:46 16mTalk | Predicting Defective Visual Code Changes in a Multi-Language AAA Video Game Project Industry Track Pre-print | ||
16:02 16mTalk | An annotation-based approach for finding bugs in neural network programs Journal First Track Mohammad Rezaalipour Software Institute @ USI, Carlo A. Furia Università della Svizzera italiana (USI) | ||
16:18 11mTalk | Evaluation of Cross-Lingual Bug Localization: Two Industrial Cases Industry Track Shinpei Hayashi Tokyo Institute of Technology, Takashi Kobayashi Tokyo Institute of Technology, Tadahisa Kato Hitachi, Ltd. DOI Pre-print | ||
16:29 16mTalk | An Empirical Study on Bugs Inside PyTorch: A Replication Study Research Track Sharon Chee Yin Ho Concordia University, Vahid Majdinasab Polytechnique Montréal, Mohayeminul Islam University of Alberta, Diego Costa Concordia University, Canada, Emad Shihab Concordia Univeristy, Foutse Khomh Polytechnique Montréal, Sarah Nadi University of Alberta, Muhammad Raza Queen's University | ||
16:45 15mLive Q&A | 1:1 Q&A Research Track |