SANER 2025
Tue 4 - Fri 7 March 2025 Montréal, Québec, Canada
Fri 7 Mar 2025 16:00 - 16:15 at M-2101 - SE Education and People Chair(s): Maria Teresa Baldassarre, Jeremy Bradbury

Current hiring practices use technical & soft skills proxy keyword based resume matching via Automated Resume Parsers (ARPs). However, this process fails to extract the actual abilities of candidates, such as the quality of their written code, raising concerns regarding the effectiveness of current approaches. Thus, novel evi- dences accurately depicting candidates’ skills are necessary to in-form hiring decisions. We posit GitHub-supported resume matching as a solution, mining data from candidates’ open source projects to provide evidence for their technical skills. We conducted a preliminary survey (n = 48) to gain insights from candidates and recruiters on proxies from GitHub projects indicative of technical abilities. We found both groups preferred metrics regarding code quality and used technologies, and there was overwhelming willingness to incorporate this analysis in resume matching tasks. Based on these insights, we designed ‘GitMeter’ – a tool to capture technical abilities (i.e., code quality) and soft skills of candidates by mining public GitHub repositories. GitMeter uses a novel heuristic-based approach to find the most accurate code quality approximation for candidate-written code (core code), minimizing the time and computational overhead. Finally, we evaluate effectiveness and potential impact of ‘GitMeter‘ through a user study (n = 20) with developers and recruiters. Our findings provide implications for future tools and methods aiming to promote evidence-based hiring in software engineering (SE) contexts.

Fri 7 Mar

Displayed time zone: Eastern Time (US & Canada) change

15:30 - 17:00
SE Education and PeopleReproducibility Studies and Negative Results (RENE) Track / Registered Report Track / Research Papers at M-2101
Chair(s): Maria Teresa Baldassarre Department of Computer Science, University of Bari , Jeremy Bradbury Ontario Tech University
15:30
15m
Talk
Hidden Figures in Software Engineering: A Replication Study Exploring Undergraduate Software Students’ Awareness of Distinguished Scientists from Underrepresented Groups
Reproducibility Studies and Negative Results (RENE) Track
Ronnie de Souza Santos University of Calgary, Italo Santos Northern Arizona University, Robson T. de Souza Santos UFPE, Cleyton Vanut Cordeiro de Magalhães UFPE
15:45
15m
Talk
On the Impact of 3D Visualization of Repository Metrics in Software Engineering Education
Registered Report Track
Dario Di Dario University of Salerno, Stefano Lambiase University of Salerno, Fabio Palomba University of Salerno, Carmine Gravino University of Salerno
Pre-print
16:00
15m
Talk
Improving Evidence-Based Tech Hiring with GitHub-Supported Resume Matching
Research Papers
Swanand Vaishampayan Virginia Tech, Muhammad Ali Gulzar Virginia Tech, Chris Brown Virginia Tech
16:15
15m
Talk
Towards Decoding Developer Cognition in the Age of AI Assistants
Registered Report Track
Ebtesam Al Haque George Mason University, Chris Brown Virginia Tech, Thomas LaToza George Mason University, Brittany Johnson George Mason University