A key goal of software engineering research is to improve the environments, tools, languages, and techniques programmers use to efficiently create quality software. Successfully designing these tools and demonstrating their effectiveness involves engaging with tool users—software engineers. Researchers often want to conduct user studies of software engineers to collect direct evidence. However, running user studies can be difficult, and researchers may lack solution strategies to overcome the barriers, so they may avoid user studies. To understand the challenges researchers face when conducting programmer user studies, we interviewed 26 researchers. Based on the analysis of interview data, we contribute (i) a taxonomy of 18 barriers researchers encounter; (ii) 23 solution strategies some researchers use to address 8 of the 18 barriers in their own studies; and (iii) 4 design ideas, which we adapted from the behavioral science community, that may lower 8 additional barriers. To validate the design ideas, we held an in-person all-day focus group with 16 researchers.
Fri 19 AprDisplayed time zone: Lisbon change
14:00 - 15:30 | Human and Social 7Journal-first Papers / Software Engineering in Practice / Research Track at Luis de Freitas Branco Chair(s): Igor Steinmacher Northern Arizona University | ||
14:00 15mTalk | “I tend to view ads almost like a pestilence”: On the Accessibility Implications of Mobile Ads for Blind Users Research Track Ziyao He University of California, Irvine, Syed Fatiul Huq University of California, Irvine, Sam Malek University of California at Irvine | ||
14:15 15mTalk | Constructive Code Review: Managing the Impact of Interpersonal Conflicts in Practice Software Engineering in Practice Pavlina Wurzel Goncalves University of Zurich, Joao S. V. Goncalves University of Zurich, Alberto Bacchelli University of Zurich | ||
14:30 15mTalk | Motivating Open Source Collaborations Through Social Network Evaluation: A Gamification Practice from Alibaba Software Engineering in Practice Shengyu Zhao Tongji University, Xiaoya Xia East China Normal University, Brian Fitzgerald Lero - The Irish Software Research Centre and University of Limerick, Xiaozhou Li University of Oulu, Valentina Lenarduzzi University of Oulu, Davide Taibi University of Oulu and Tampere University , Rong Wang Alibaba Group, will wang , Chunqi Tian Yongji University | ||
14:45 15mTalk | Objectives and Key Results in Software Teams: Challenges, Opportunities and Impact on Development Software Engineering in Practice Jenna L. Butler Microsoft Research, Thomas Zimmermann Microsoft Research, Christian Bird Microsoft Research | ||
15:00 7mTalk | Dealing with Data Challenges when Delivering Data-Intensive Software Solutions Journal-first Papers Ulrike Maria Graetsch , Hourieh Khalajzadeh Deakin University, Australia, Rashina Hoda Monash University, Mojtaba Shahin RMIT University, John Grundy Monash University Link to publication DOI Pre-print | ||
15:07 7mTalk | What’s (Not) Working in Programmer User Studies? Journal-first Papers Matthew C. Davis Carnegie Mellon University, Emad Aghayi , Thomas LaToza George Mason University, Xiaoyin Wang University of Texas at San Antonio, Brad A. Myers Carnegie Mellon University, Joshua Sunshine Carnegie Mellon University Link to publication DOI | ||
15:14 7mTalk | Confirmation Bias and Time Pressure: A Family of Experiments in Software Testing Journal-first Papers Iflaah Salman Lappeenranta-Lahti University of Technology (LUT), Burak Turhan University of Oulu, Robert Ramač Faculty of Technical Sciences, University of Novi Sad, Vladimir Mandić Faculty of Technical Sciences, University of Novi Sad |