VRTestSniffer: Test Smell Detector for Virtual Reality (VR) Software Projects
This program is tentative and subject to change.
Abstract—Virtual Reality (VR) is an emerging technology increasingly adopted in sectors such as gaming, education, border security, and industrial training. However, testing VR applications presents unique challenges due to factors like active user interaction, hardware dependencies, and immersive environments. Recent studies suggest that developers often write fewer test cases for VR applications, and these limited test cases frequently exhibit test smells. Current research on VR test smell detection can only identify a small subset of test smells and often lacks the necessary context for comprehensive detection. This highlights a critical gap in current testing practices for VR applications and underscores the need for approaches tailored to detecting and addressing quality issues in VR test cases. To address this research gap, we developed VRTestSniffer, a static analysis-based tool that extends test smell detection capabilities specifically for Unity-based VR applications. VRTestSniffer can detect 17 test smell categories, building upon those identified by the state-of-the-art tool tsDetect, and achieves an F1-score of 95.61%. It leverages abstract syntax trees (ASTs), control flow graphs (CFGs), and data flow graphs (DFGs) to enhance detection accuracy by capturing both control and data dependencies specific to VR testing patterns. In parallel, we conducted an empirical analysis of real-world VR projects to examine the prevalence and characteristics of these test smells. Our findings reveal that a few smelly test categories are linked to poorly structured or overly complex functional code. We believe that VRTestSniffer, along with the empirical insights derived from this study, can help VR developers write more effective, reliable, and maintainable test cases. To support further research and replication, our tool, dataset, and analysis results are publicly available at [1].
This program is tentative and subject to change.
Mon 17 NovDisplayed time zone: Seoul change
11:00 - 12:30 | |||
11:00 10mTalk | ADPerf: Investigating and Testing Performance in Autonomous Driving Systems Research Papers Tri Minh-Triet Pham Concordia University, Diego Elias Costa Concordia University, Canada, Weiyi Shang University of Waterloo, Jinqiu Yang Concordia University | ||
11:10 10mTalk | VRTestSniffer: Test Smell Detector for Virtual Reality (VR) Software Projects Research Papers Faraz Gurramkonda University of Michigan-Dearborn, Avishak Chakroborty University of Michigan-Dearborn, Bruce Maxim University of Michigan - Dearborn, Mohamed Wiem Mkaouer University of Michigan - Flint, Foyzul Hassan University of Michigan at Dearborn | ||
11:20 10mTalk | A Multi-Modality Evaluation of the Reality Gap in Autonomous Driving Systems Research Papers Stefano Carlo Lambertenghi Technische Universität München, fortiss GmbH, Mirena Flores Valdez Technical University of Munich, Andrea Stocco Technical University of Munich, fortiss Pre-print | ||
11:30 10mTalk | On the Robustness Evaluation of 3D Obstacle Detection Against Specifications in Autonomous Driving Research Papers Tri Minh-Triet Pham Concordia University, Bo Yang Concordia University, Jinqiu Yang Concordia University | ||
11:40 10mTalk | TARGET: Traffic Rule-Based Test Generation for Autonomous Driving via Validated LLM-Guided Knowledge Extraction Journal-First Track Yao Deng Macquarie University, Zhi Tu Purdue University, Jiaohong Yao Macquarie University, Mengshi Zhang TensorBlock, Tianyi Zhang Purdue University, Xi Zheng Macquarie University | ||
11:50 10mTalk | IMUFUZZER: Resilience-based Discovery of Signal Injection Attacks on Robotic Aerial Vehicles Research Papers Sudharssan Mohan University of Texas at Dallas, Kyeongseok Yang Korea University, Zelun Kong The University of Texas at Dallas, Yonghwi Kwon University of Maryland, Junghwan Rhee University of Central Oklahoma, Tyler Summers University of Texas at Dallas, Hongjun Choi DGIST, Heejo Lee Korea University, Chung Hwan Kim University of Texas at Dallas | ||
12:00 10mTalk | Argus: Resilience-Oriented Safety Assurance Framework for End-to-End ADSs Research Papers Dingji Wang Fudan University, You Lu Fudan University, Bihuan Chen Fudan University, Shuo Hao Fudan University, Haowen Jiang Fudan University, China, Yifan Tian Fudan University, Xin Peng Fudan University | ||
12:10 10mResearch paper | VRExplorer: A Model-based Approach for Automated Virtual Reality Scene Testing Research Papers Zhu Zhengyang Sun Yat-sen University, Hong-Ning Dai Hong Kong Baptist University, Hanyang Guo School of Software Engineering, Sun Yat-sen University, Zeqin Liao Sun Yat-sen University, Zibin Zheng Sun Yat-sen University Pre-print | ||
12:20 10mTalk | When Autonomous Vehicle Meets V2X Cooperative Perception: How Far Are We? Research Papers An Guo Nanjing University, Shuoxiao Zhang Nanjing University, Enyi Tang Nanjing University, Xinyu Gao , Haomin Pang Guangzhou University, Haoxiang Tian Nanyang Technological University, Singapore, Yanzhou Mu , Wu Wen Guangzhou University, Chunrong Fang Nanjing University, Zhenyu Chen Nanjing University Pre-print | ||