End-Users vs Software Practitioners: Recruitment Challenges and Strategies in Software Engineering Research
This paper shares insights from our first-hand experience with key recruitment challenges encountered in software engineering research, focusing on two distinct participant groups: end-users and software practitioners. By conducting a reflective analysis, we emphasise the particular challenges we faced when engaging these groups during empirical study recruitment phases. Significant challenges we faced in recruiting end-users include ensuring authenticity, maintaining engagement, achieving demographic diversity, and addressing privacy concerns. Conversely, we faced different challenges when recruiting software practitioners, including sourcing the right expertise, utilising online recruiting platforms, navigating time constraints, aligning incentives, obtaining a representative sample, and coordinating with remote and distributed teams. By detailing the strategies we employed to address these challenges, this paper contributes practical knowledge to enhance the efficacy and inclusiveness of research practices, ultimately fostering more robust software engineering research outcomes.
Mon 2 SepDisplayed time zone: London change
11:00 - 12:30 | |||
11:00 5mTalk | Diversity in End-User Programming Research and a Critique of "Representativeness" Workshops and Tutorials Advait Sarkar Microsoft Research and University of Cambridge Pre-print | ||
11:05 5mTalk | End-Users vs Software Practitioners: Recruitment Challenges and Strategies in Software Engineering Research Workshops and Tutorials Wei Wang Monash University, Dulaji Hidellaarachchi Monash University, John Grundy Monash University, Hourieh Khalajzadeh Deakin University, Australia, Anuradha Madugalla Deakin University, School of IT, Australia, Humphrey Obie Monash University Pre-print | ||
11:10 5mTalk | Evaluating LLM-Generated Topics from Survey Responses: Identifying Challenges in Recruiting Participants through Crowdsourcing Workshops and Tutorials Reham Al Tamime Qatar Computing Research Institute, Joni Salminen School of Marketing and Communication, University of Vaasa, Soon-Gyo Jung Qatar Computing Research Institute, Bernard Jansen Qatar Computing Research Institute, Hamad Bin Khalifa University Pre-print | ||
11:15 5mTalk | The struggle is real! The agony of recruiting participants for empirical software engineering studies Workshops and Tutorials Kashumi Madampe Monash University, Australia, John Grundy Monash University, Rashina Hoda Monash University, Humphrey Obie Monash University Pre-print | ||
11:20 70mMeeting | Papers Discussion 1 Workshops and Tutorials |