MSR 2023
Dates to be announced Melbourne, Australia
co-located with ICSE 2023
Mon 15 May 2023 11:00 - 11:12 at Meeting Room 109 - Development Tools & Practices I Chair(s): Olga Baysal

The pull-based development paradigm is widely adopted by modern open-source software (OSS) projects, enabling a pull request (PR) to pass through multiple validation stages, from PR assignment and continuous integration testing to the actual code review, before eventually being merged into the project or rejected. Due to the distributed collaboration characteristics of open-source projects, PRs often get delayed across the PR stages, including for the first response, slowing down software development.

In this paper, we conduct an exploratory study on the time-to-first-response. By analyzing 111,094 closed pull requests from ten popular OSS projects on GitHub, we find that bots are frequently used to generate the first response in a PR. The timing of those bot-generated first responses is significantly different from the human one. We further conduct an empirical study to understand the characteristics of the bot- and human-generated first responses, including their relationship with the lifetime of a PR. The results of our study indicate that the presence of a bot is an important factor explaining the time-to-first-response in the pull-based development paradigm and, thus, has to be separately analyzed from human responses. Moreover, we also find that projects with a low PR success rate, heavy existing developer team workload, and newly created projects have a higher correlation with a longer waiting time for the first human response to a pull request. These findings are important for newcomers to understand the delays they experience for their pull requests.

Mon 15 May

Displayed time zone: Hobart change

11:00 - 11:45
Development Tools & Practices IRegistered Reports / Industry Track / Technical Papers at Meeting Room 109
Chair(s): Olga Baysal Carleton University
11:00
12m
Talk
Understanding the Time to First Response In GitHub Pull Requests
Technical Papers
Kazi Amit Hasan Queen's University, Canada, Marcos Macedo Queen's University at Kingston / Universidad de Montevideo, Yuan Tian Queens University, Kingston, Canada, Bram Adams Queen's University, Kingston, Ontario, Ding Steven, H., H. Queen’s University at Kingston
Pre-print
11:12
12m
Talk
Dealing with Popularity Bias in Recommender Systems for Third-party Libraries: How far Are We?
Technical Papers
Phuong T. Nguyen University of L’Aquila, Riccardo Rubei University of L'Aquila, Juri Di Rocco University of L'Aquila, Claudio Di Sipio University of L'Aquila, Davide Di Ruscio University of L'Aquila, Massimiliano Di Penta University of Sannio, Italy
Pre-print
11:24
6m
Talk
Smart Contract Upgradeability on the Ethereum Blockchain Platform: An Exploratory Study
Registered Reports
Ilham Qasse Reykjavik University, Mohammad Hamdaqa Polytechnique Montréal, Björn Þór Jónsson Reykjavik University
11:30
6m
Talk
An Exploratory Study of Ad Hoc Parsers in Python
Registered Reports
Pre-print
11:36
6m
Talk
Improving Agile Planning for Reliable Software Delivery
Industry Track
Jirat Pasuksmit Atlassian, Fan Jiang Atlassian, Kemp Thornton Atlassian, Arik Friedman Atlassian, Natalija Fuksmane Atlassian, Isabelle Kohout Atlassian, Julian Connor Atlassian
Pre-print