FSE 2026
Sun 5 - Thu 9 July 2026 Montreal, Canada
Tue 7 Jul 2026 11:00 - 11:20 at MB 3.210 - Testing 1 Chair(s): Mike Papadakis

The rapid proliferation and increasing complexity of software demand robust quality assurance, with graphical user interface (GUI) testing playing a pivotal role. Crowdsourced testing has proven effective in this context by leveraging the diversity of human testers to achieve rich, scenario-based coverage across varied devices, user behaviors, and usage environments. In parallel, automated testing, particularly with the advent of large language models (LLMs), offers significant advantages in controllability, reproducibility, and efficiency, enabling scalable and systematic exploration. However, automated approaches often lack the behavioral diversity characteristic of human testers, limiting their capability to fully simulate real-world testing dynamics. To address this gap, we present PersonaTester, a novel personified-LLM-based framework designed to automate crowdsourced GUI testing. By injecting representative personas, defined along three orthogonal dimensions: testing mindset, exploration strategy, and interaction habit, into LLM-based agents, PersonaTester enables the simulation of diverse human-like testing behaviors in a controllable and repeatable manner. Experimental results demonstrate that PersonaTester faithfully reproduces the behavioral patterns of real crowdworkers, exhibiting strong intra-persona consistency and clear inter-persona variability (117.86% – 126.23% improvement over the baseline). Moreover, persona-guided testing agents consistently generate more effective test events and trigger more crashes (100+) and functional bugs (11) than the baseline without persona, thus substantially advancing the realism and effectiveness of automated crowdsourced GUI testing.

Tue 7 Jul

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Testing 1Research Papers / Ideas, Visions and Reflections at MB 3.210
Chair(s): Mike Papadakis University of Luxembourg
11:00
20m
Talk
Towards Automated Crowdsourced Testing via Personified-LLM
Research Papers
Shengcheng Yu Technical University of Munich, Yuchen Ling Nanjing University, Chunrong Fang Nanjing University, Zhenyu Chen Nanjing University, Chunyang Chen TU Munich
Pre-print
11:20
20m
Talk
Clotho: Measuring Task-Specific Pre-Generation Test Adequacy for LLM Inputs
Research Papers
Juyeon Yoon Korea Advanced Institute of Science and Technology, Somin Kim Korea Advanced Institute of Science and Technology, Robert Feldt Chalmers | University of Gothenburg, Shin Yoo KAIST
Pre-print
11:40
20m
Talk
Automated Knowledge-Aware Test Reuse
Research Papers
Ziyuan Zhang Zhejiang University, Yi Gao Zhejiang University, Xing Hu Zhejiang University, Xin Xia Zhejiang University, Shanping Li The State Key Laboratory of Blockchain and Data Security, Zhejiang University
12:00
20m
Talk
Generalizing Test Cases for Comprehensive Test Scenario Coverage
Research Papers
Binhang Qi National University of Singapore, Yun Lin Shanghai Jiao Tong University, Xinyi Weng Shanghai Jiao Tong University, Chenyan Liu Shanghai Jiao Tong University; National University of Singapore, Hailong Sun Beihang University, Gordon Fraser University of Passau, Jin Song Dong National University of Singapore
12:20
10m
Talk
The Impact of Documentation on Test Engagement in Pull Requests in OSS
Ideas, Visions and Reflections
Teal Amore Eastern Michigan University, Nathan Berman Eastern Michigan University, Siyuan Jiang Eastern Michigan University