Diversity in End-User Programming Research and a Critique of "Representativeness"
We reflect on our experiences in improving the diversity of participants in our research, focusing on geographic diversity and countering WEIRDness. Our reflections are grounded in four studies conducted over two years, with more than 100 total participant engagements across more than 100 hours of user studies. Our samples included participants from the UK and the USA, but also from the Republic of Ireland, the Netherlands, Kenya, Nigeria, Ghana, Armenia, Israel, and Japan. We reflect on some of the challenges we encountered and what we have learnt about the benefits of geographic diversity. Finally, we discuss the scientific ideal of “representativeness” and consider whether it is possible, or appropriate, in small sample studies (n~20). We propose that representativeness is antagonised by the ideal of diversity. We seek alternative ways of understanding and articulating the epistemic value of diversity in Human-Computer Interaction (HCI) research.
Mon 2 SepDisplayed time zone: London change
11:00 - 12:30 | |||
11:00 5mTalk | Diversity in End-User Programming Research and a Critique of "Representativeness" Workshops and Tutorials Advait Sarkar Microsoft Research and University of Cambridge Pre-print | ||
11:05 5mTalk | End-Users vs Software Practitioners: Recruitment Challenges and Strategies in Software Engineering Research Workshops and Tutorials Wei Wang Monash University, Dulaji Hidellaarachchi Monash University, John Grundy Monash University, Hourieh Khalajzadeh Deakin University, Australia, Anuradha Madugalla Deakin University, School of IT, Australia, Humphrey Obie Monash University Pre-print | ||
11:10 5mTalk | Evaluating LLM-Generated Topics from Survey Responses: Identifying Challenges in Recruiting Participants through Crowdsourcing Workshops and Tutorials Reham Al Tamime Qatar Computing Research Institute, Joni Salminen School of Marketing and Communication, University of Vaasa, Soon-Gyo Jung Qatar Computing Research Institute, Bernard Jansen Qatar Computing Research Institute, Hamad Bin Khalifa University Pre-print | ||
11:15 5mTalk | The struggle is real! The agony of recruiting participants for empirical software engineering studies Workshops and Tutorials Kashumi Madampe Monash University, Australia, John Grundy Monash University, Rashina Hoda Monash University, Humphrey Obie Monash University Pre-print | ||
11:20 70mMeeting | Papers Discussion 1 Workshops and Tutorials | ||
