ICSME 2023
Sun 1 - Fri 6 October 2023 Bogotá, Colombia
Thu 5 Oct 2023 15:46 - 16:02 at Session 1 Room - RGD 004 - Software Faults Chair(s): Masud Rahman, Ashkan Sami

Video game development increasingly relies on using visual programming languages as the primary way to build video game features. The aim of using visual programming is to move game logic into the hands of game designers, who may not be as well versed in textual coding. In this paper, we empirically observe that there are more defect-inducing commits containing visual code than textual code in a AAA video game project codebase. This indicates that the existing textual code Just-in-Time (JIT) defect prediction models under evaluation by Electronic Arts (EA) may be ineffective as they do not account for changes in visual code. Thus, we focus our research on constructing visual code defect prediction models that encompass visual code metrics and evaluate the models against defect prediction models that use language agnostic features, and textual code metrics. We test our models using features extracted from the historical codebase of a AAA video game project, as well as the historical codebases of 70 open source projects that use textual and visual code. We find that defect prediction models have better performance overall in terms of the area under the ROC curve (AUC), and Mathews Correlation Coefficient (MCC) when incorporating visual code features for projects that contain more commits with visual code than textual code.

Thu 5 Oct

Displayed time zone: Bogota, Lima, Quito, Rio Branco change

15:30 - 17:00
Software FaultsIndustry Track / Research Track / Journal First Track at Session 1 Room - RGD 004
Chair(s): Masud Rahman Dalhousie University, Ashkan Sami Edinburgh Napier University
15:30
16m
Talk
An Empirical Study on Fault Diagnosisa in Robotic Systems
Research Track
Xuezhi Song Fudan University, Yi Li , Zhen Dong Fudan University, China, Shuning Liu Fudan University, Junming Cao Fudan University, Xin Peng Fudan University
15:46
16m
Talk
Predicting Defective Visual Code Changes in a Multi-Language AAA Video Game Project
Industry Track
Kalvin Eng Electronic Arts, Abram Hindle University of Alberta, Alexander Senchenko Electronic Arts
Pre-print
16:02
16m
Talk
An annotation-based approach for finding bugs in neural network programs
Journal First Track
Mohammad Rezaalipour Software Institute @ USI, Carlo A. Furia Università della Svizzera italiana (USI)
16:18
11m
Talk
Evaluation of Cross-Lingual Bug Localization: Two Industrial Cases
Industry Track
Shinpei Hayashi Tokyo Institute of Technology, Takashi Kobayashi Tokyo Institute of Technology, Tadahisa Kato Hitachi, Ltd.
DOI Pre-print
16:29
16m
Talk
An Empirical Study on Bugs Inside PyTorch: A Replication Study
Research Track
Sharon Chee Yin Ho Concordia University, Vahid Majdinasab Polytechnique Montréal, Mohayeminul Islam University of Alberta, Diego Costa Concordia University, Canada, Emad Shihab Concordia Univeristy, Foutse Khomh Polytechnique Montréal, Sarah Nadi University of Alberta, Muhammad Raza Queen's University
16:45
15m
Live Q&A
1:1 Q&A
Research Track