A Test Automation Framework for User Interaction in Extended Reality Applications
This program is tentative and subject to change.
Extended Reality (XR) technologies deliver immersive user experiences across diverse application domains but pose unique testing challenges due to their spatial interaction paradigms. Existing approaches test XR applications through scene navigation and interaction triggering, yet they fail to synthesise realistic spatial input via specialised XR devices. These devices include 6 degrees of freedom controller gestures and are essential for modern XR experiences. To address this gap, we present IntenXion, a test automation framework for validating user interactions in Unity XR applications. We develop a taxonomy of XR user interactions to inform the design of IntenXion, ensuring it supports a diverse range of XR interaction types. We conduct a case study to demonstrate IntenXion’s capability, using eight representative interaction object types selected from industrial XR interaction design guidelines. IntenXion provides support for developing intuitive interaction test scripts, including both action sequences and assertions for expected behaviours. Our results demonstrate that IntenXion can cover the intended functionalities of all eight object types.
This program is tentative and subject to change.
Thu 20 NovDisplayed time zone: Seoul change
16:00 - 18:00  | VARSE - Second SessionVARSE at Grand Hall 6 Chair(s): Shuqing Li The Chinese University of Hong Kong  | ||
16:00 24mResearch paper  | A Test Automation Framework for User Interaction in Extended Reality Applications VARSE  Pre-print | ||
16:24 24mResearch paper  | ARTRIP: Automatic AR Testing with Randomized Interaction Patterns VARSE Maria Rivera University of Texas at San Antonio, Lisette Isais University of Texas at San Antonio, Xiaoyin Wang University of Texas at San Antonio  | ||
16:48 24mResearch paper  | NavAI: A Generalizable LLM Framework for Navigation Tasks in Virtual Reality Environments VARSE  | ||
17:12 24mResearch paper  | A Conformance Checking System for Interaction Testing in Virtual Reality VARSE Vijay Aravynthan Software Engineering Research Center International Institute of Information Technology, Raghu Reddy IIIT Hyderabad  | ||
17:36 24mResearch paper  | Toward Static Analysis of Immersive Attacks VARSE Kadiray Karakaya Heinz Nixdorf Institute at Paderborn University, Jonas Klauke Heinz Nixdorf Institut, Paderborn University, Enes Yigitbas Paderborn University  | ||