ESEM - Emerging Results and Vision Track ESEIW 2025
Thu 2 OctDisplayed time zone: Hawaii change
08:30 - 10:00 | ESEM OpeningESEM - Student Volunteers / IASESE - Advanced School / ESEM - Industry, Government, and Community Track / ESEM - Research Projects Track / ESEM - Journal First Track / ESEM - Emerging Results and Vision Track / ESEM - Registered Reports Track / ESEM - Technical Track / IDoESE - Doctoral Symposium / ISERN - Annual Meeting / at Queen Liliuokalani Chair(s): Valentina Lenarduzzi University of Oulu, Daniel Port University of Hawai‘i at Mānoa, Fabio Q. B. da Silva Federal University of Pernambuco | ||
08:30 45mTalk | Opening Ceremony | ||
09:15 45mKeynote | From Formal Methods to Vibe Programming | ||
10:10 - 11:10 | Teamwork, Hybrid Work, and Team ChallengesESEM - Technical Track / ESEM - Industry, Government, and Community Track / ESEM - Journal First Track / at Kaiulani I Chair(s): Fabio Santos Northern Arizona University | ||
10:10 15mTalk | Beyond the Job Posting: What Hiring Managers Really Seek in Entry-Level CS Candidates ESEM - Industry, Government, and Community Track Spencer Balouga Loufek Hewlett-Packard Enterprise, Fabio Marcos De Abreu Santos Colorado State University, USA, Bianca Trinkenreich Colorado State University | ||
10:25 15mTalk | Software solutions for newcomers’ onboarding in software projects: A systematic literature review ESEM - Journal First Track Italo Santos University of Hawai‘i at Mānoa, Katia Romero Felizardo Federal University of Technology - Paraná (UTFPR), Igor Steinmacher RESHAPE LAB, Northern Arizona University, USA, Marco Gerosa Northern Arizona University | ||
10:40 15mTalk | Exploring Engagement in Hybrid Meetings ESEM - Technical Track Daniela Grassi University of Bari, Fabio Calefato University of Bari, Darja Šmite Blekinge Institute of Technology, Nicole Novielli University of Bari, Filippo Lanubile University of Bari Pre-print | ||
10:55 15mTalk | One Size Does Not Fit All: How To Organize Hybrid Work In Agile Software Development? ESEM - Technical Track Fateme Broomandi LUT University, Emily Laue Christensen LUT University, Maria Paasivaara LUT University, Finland & Aalto University, Finland | ||
10:10 - 11:10 | Evidence and Research Quality in Software EngineeringESEM - Technical Track / ESEM - Emerging Results and Vision Track / ESEM - Journal First Track / at Kaiulani II Chair(s): Mika Mäntylä University of Helsinki and University of Oulu | ||
10:10 15mTalk | Cognitive Biases in Software Engineering: Debiasing through Reconception ESEM - Emerging Results and Vision Track | ||
10:25 15mTalk | Exploring the Evidence-Based Beliefs of LLM-Based Programming Assistants ESEM - Emerging Results and Vision Track | ||
10:40 15mTalk | Research artifacts for human-oriented experiments in software engineering: An ACM badges-driven structure proposal ESEM - Journal First Track Cathy Guevara-Vega Universidad Técnica del Norte, Beatriz Bernárdez University of Seville, Margarita Cruz Risco University of Seville, Amador Durán University of Seville, Antonio Ruiz-Cortés University of Seville, Martín Solari Universidad ORT Uruguay | ||
10:55 15mTalk | Aggregating empirical evidence from data strategies studies: a case on model quantization ESEM - Technical Track Santiago del Rey Universitat Politècnica De Catalunya - Barcelona Tech, Paulo Sérgio Medeiros Federal University of the State of Rio de Janeiro (UNIRIO), Guilherme Horta Travassos Federal University of Rio de Janeiro, Xavier Franch Universitat Politècnica de Catalunya, Silverio Martínez-Fernández UPC-BarcelonaTech Pre-print | ||
11:30 - 12:40 | Generative AI in Software EngineeringESEM - Industry, Government, and Community Track / ESEM - Technical Track / ESEM - Registered Reports Track / at Kaiulani II Chair(s): Amiangshu Bosu Wayne State University | ||
11:30 17mTalk | Succes and Failure Factors of Generative AI in a Chat Application of Dutch Railways ESEM - Industry, Government, and Community Track Elise Peusen Utrecht University of Applied Sciences, Leo van der Meulen NS, Hennie Huijgens Utrecht University of Applied Sciences, Lucque Schmeitz Utrecht University of Applied Sciences | ||
11:47 17mTalk | Evaluating Generative AI Tools for Personalised Offline Recommendations: A Comparative Study ESEM - Registered Reports Track Rafael Salinas Universidad de Cuenca, Otto Parra Universidad de Cuenca, Condori-Fernandez Nelly Universidad de Santiago de Compostela, Maria Fernanda Granda Juca Universidad de Cuenca | ||
12:05 17mTalk | Using Biometrics to Understand AI-Assisted Coding Performance and its Perception: a Registered Report ESEM - Registered Reports Track Nadja Brix Koch IT University of Copenhagen, Theis Helth Stensgaard IT University of Copenhagen, Paolo Tell IT University of Copenhagen, Denmark, Paolo Burelli IT University of Copenhagen, Guillaume Andrea Desaphy University of Bari, Alberto Antonio Romano University of Bari, Nicole Novielli University of Bari, Fabio Calefato University of Bari Pre-print | ||
12:22 17mTalk | Developer Prompts in Practice: An Empirical Study of Bias, Security, and Optimization ESEM - Technical Track Dhia Elhaq Rzig University of Michigan - Dearborn, Dhruba Jyoti Paul University of Wisconsin-Madison, Kaiser Pister Univeristy of Wisconsin-Madison, Jordan Henkel Sema4.ai, Foyzul Hassan University of Michigan at Dearborn | ||
13:50 - 14:50 | Program Comprehension and Review 1ESEM - Industry, Government, and Community Track / ESEM - Emerging Results and Vision Track / ESEM - Technical Track / at Kaiulani II Chair(s): Nicole Novielli University of Bari | ||
13:50 15mTalk | When Retriever Meets Generator: A Joint Model for Code Comment Generation ESEM - Emerging Results and Vision Track Tien L. T. Pham Hanoi University of Science and Technology, Anh M. T. Bui Hanoi University of Science and Technology, Huy N. D. Pham AI Young Talent Academy (AI4Life), Hanoi University of Science and Technology, Alessio Bucaioni Malardalen University, Phuong T. Nguyen University of L’Aquila Pre-print | ||
14:05 15mTalk | From Assessment to Enhancement of Pull Requests at Scale: Aligning Code Reviews with Developer Competencies Using Large Language Models ESEM - Industry, Government, and Community Track Luca Mariotto Hasso-Plattner Institute, Christian Medeiros Adriano Hasso Plattner Institute, University of Potsdam, René Eichhorn Mercedes-Benz Tech Innovation, Daniel Burgstahler Mercedes-Benz Tech Innovation, Holger Giese Hasso Plattner Institute, University of Potsdam | ||
14:20 15mTalk | Rethinking Code Review Workflows with LLM Assistance: An Empirical Study ESEM - Industry, Government, and Community Track Fannar Steinn Aðalsteinsson WirelessCar Sweden AB & Chalmers University of Technology, Björn Borgar Magnússon WirelessCar Sweden AB, Mislav Milicevic WirelessCar Sweden AB, Adam Nirving Davidsson WirelessCar Sweden AB, Chih-Hong Cheng Carl von Ossietzky Universität Oldenburg & Chalmers University of Technology | ||
14:35 15mTalk | Interrogative Comments Posed by Review Comment Generators: An Empirical Study of Gerrit ESEM - Technical Track Farshad Kazemi University of Waterloo, Maxime Lamothe Polytechnique Montreal, Shane McIntosh University of Waterloo Pre-print | ||
14:50 - 15:30 | Software BugsESEM - Technical Track / at Kaiulani II Chair(s): Shane McIntosh University of Waterloo | ||
14:50 13mTalk | Exploring the Jupyter Ecosystem: An Empirical Study of Bugs and Vulnerabilities ESEM - Technical Track Wenyuan Jiang ETH Zürich, Diany Pressato Concordia University, Harsh Darji University of Alberta, Thibaud Lutellier University of Alberta Pre-print | ||
15:03 13mTalk | Go-Oracle: Automated Test Oracle for Go Concurrency Bugs ESEM - Technical Track Foivos Tsimpourlas University of Edinburgh, Chao Peng ByteDance, Carlos Rosuero University of Edinburgh, Ping Yang Bytedance Network Technology, Ajitha Rajan The University of Edinburgh | ||
15:16 13mTalk | What About Our Bug? A Study on the Responsiveness of NPM Package Maintainers ESEM - Technical Track Mohammadreza Saeidi University of British Columbia, Raula Gaikovina Kula The University of Osaka, Gema Rodriguez-Perez The University of British Columbia, Ethan Thoma UBC, Computer Science | ||
16:00 - 17:30 | |||
16:00 90mMeeting | TownHall Meeting | ||
Fri 3 OctDisplayed time zone: Hawaii change
08:30 - 09:30 | |||
08:30 60mKeynote | Industry can get any empirical research it wants Tim Menzies North Carolina State University Link to publication Pre-print | ||
11:20 - 12:50 | Systematic Reviews and Evidence-Based SEESEM - Technical Track / ESEM - Registered Reports Track / ESEM - Emerging Results and Vision Track / at Kaiulani I Chair(s): Nauman Bin Ali Blekinge Institute of Technology | ||
11:20 18mTalk | A Preliminary Assessment of SLR’s Reliance on Preprints, in the area of LLMs4SE ESEM - Emerging Results and Vision Track Sarah Buckley University of Limerick, Abdul Razzaq Computer Science and Information Systems, University of Limerick, Michael English Computer Science and Information Systems, University of Limerick | ||
11:38 18mTalk | Investigating the Use of LLMs for Evidence Briefings Generation in Software Engineering ESEM - Registered Reports Track Mauro Marcelino Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Marcos Alves FITec Technological Innovations, Bianca Trinkenreich Colorado State University, Bruno Cartaxo IFPE, Sérgio Soares Universidade Federal de Pernambuco, Simone Barbosa PUC-Rio, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio) | ||
11:56 18mTalk | Another Systematic Review? A Critical Analysis of Systematic Literature Reviews on Agile Effort and Cost Estimation ESEM - Technical Track | ||
12:14 18mTalk | Assessing diversity in creating seed set for snowballing search for systematic literature review in software engineering ESEM - Technical Track Katia Romero Felizardo Federal University of Technology - Paraná (UTFPR), Francisco Carlos M. Souza Universidade Tecnológica Federal do Paraná (UTFPR), Alinne C. Corrêa Souza Universidade Tecnológica Federal do Paraná (UTFPR), Igor Steinmacher RESHAPE LAB, Northern Arizona University, USA, Marco Gerosa Northern Arizona University | ||
12:32 18mTalk | SESR-Eval: Dataset to Evaluate LLMs in the Screening Process of Systematic Reviews ESEM - Technical Track Aleksi Huotala University of Helsinki, Miikka Kuutila Dalhousie University, Mika Mäntylä University of Helsinki and University of Oulu Pre-print | ||
11:20 - 12:50 | Architectures, Infrastructure, and Tools for Modern DevelopmentESEM - Technical Track / ESEM - Industry, Government, and Community Track / at Kaiulani II Chair(s): Davide Taibi University of Oulu | ||
11:20 22mTalk | Empirical Insights into Microservice Language Heterogeneity in Practice ESEM - Industry, Government, and Community Track | ||
11:42 22mTalk | A Defect Taxonomy for Infrastructure as Code Scripts: A Replication Study ESEM - Technical Track Wendell Oliveira Federal University of Campina Grande, Brazil, Filipe Paiva Federal University of Campina Grande, Thiago Emmanuel Pereira Federal University of Campina Grande, João Brunet Federal University of Campina Grande Pre-print | ||
12:05 22mTalk | Understanding Everything as Code: A Taxonomy and Conceptual Model ESEM - Technical Track Pre-print | ||
12:27 22mTalk | We Know What You're Looking For: Recommendation for Large-Scale Open Source Software ESEM - Technical Track Xing Cui Institute of Software, Chinese Academy of Sciences, Jingzheng Wu Institute of Software, The Chinese Academy of Sciences, Xiang Ling Institute of Software, Chinese Academy of Sciences, Tianyue Luo Institute of Software, Chinese Academy of Sciences | ||
14:00 - 15:20 | LLMs for Code Generation, Translation, and MaintainabilityESEM - Technical Track / ESEM - Emerging Results and Vision Track / at Kaiulani I Chair(s): Ivan Machado Federal University of Bahia - UFBA | ||
14:00 20mTalk | A Fully Automated Agent for End-to-End Code Translation and Validation ESEM - Emerging Results and Vision Track Eray Erer Boğaziçi University, Ayşe Başar Toronto Metropolitan University, Toronto, Canada, Aysun Bozanta Bogazici University, Turgay Aytac Comunale Capital | ||
14:20 20mTalk | Contextual Code Retrieval for Commit Message Generation: A Preliminary Study ESEM - Emerging Results and Vision Track Bo Xiong Wuhan University, Linghao Zhang Wuhan University, Chong Wang Wuhan University, Peng Liang Wuhan University, China Pre-print | ||
14:40 20mTalk | How Small is Enough? Empirical Evidence of Quantized Small Language Models for Automated Program Repair ESEM - Emerging Results and Vision Track Kazuki Kusama , Honglin Shu Kyushu University, Masanari Kondo Kyushu University, Yasutaka Kamei Kyushu University | ||
15:00 20mTalk | Is LLM-Generated Code More Maintainable & Reliable than Human-Written Code? ESEM - Technical Track Alfred Santa Molison Toronto Metropolitan University, Fabio Marcos De Abreu Santos Colorado State University, USA, Marcia Moraes Colorado State University, Glaucia Melo Toronto Metropolitan University, Wesley Assunção North Carolina State University | ||
14:00 - 15:20 | Software TestingESEM - Emerging Results and Vision Track / ESEM - Journal First Track / ESEM - Technical Track / at Kaiulani II Chair(s): Márcio Ribeiro Federal University of Alagoas, Brazil | ||
14:00 16mTalk | An Empirical Investigation into Maintenance of Load Testing Scripts ESEM - Emerging Results and Vision Track Ibuki Nakamura Nara Institute of Science and Technology, Kosei Horikawa Nara Institute of Science and Technology, Brittany Reid Nara Institute of Science and Technology, Yutaro Kashiwa Nara Institute of Science and Technology, Hajimu Iida Nara Institute of Science and Technology | ||
14:16 16mTalk | A Vision for Debiasing Confirmation Bias in Software Testing via LLM ESEM - Emerging Results and Vision Track Iflaah Salman Lappeenranta-Lahti University of Technology (LUT), Muhammad Waseem Faculty of Information Technology and Communication Sciences, Tampere University, 33014 Tampere, Finland, Vladimir Mandić Faculty of Technical Sciences, University of Novi Sad, Rasanjana Dhanushkha De Alwis Lappeenranta-Lahti University of Technology LUT | ||
14:32 16mTalk | Comparing effectiveness and efficiency of interactive application security testing (IAST) and runtime application self-protection (RASP) tools in a large java-based system ESEM - Journal First Track Aishwwarya Seth Microsoft, Saikath Bhattacharya Illinois State University, Sarah Elder UNC-Wilmington, Nusrat Zahan North Carolina State University, Laurie Williams North Carolina State University | ||
14:48 16mTalk | Is Diversity a Meaningful Metric in Fairness Testing? ESEM - Technical Track | ||
15:04 16mTalk | Where Tests Fall Short: Empirically Analyzing Oracle Gaps in Covered Code ESEM - Technical Track Megan Maton University of Sheffield, Gregory Kapfhammer Allegheny College, Phil McMinn University of Sheffield | ||
15:40 - 17:00 | Program Comprehension and Review 2ESEM - Emerging Results and Vision Track / at Kaiulani II Chair(s): Chris Brown Virginia Tech | ||
15:40 26mTalk | Dealing with SonarQube Cloud: Initial Results from a Mining Software Repository Study ESEM - Emerging Results and Vision Track Sabato Nocera University of Salerno, Davide Fucci Blekinge Institute of Technology, Giuseppe Scanniello University of Salerno | ||
16:06 26mTalk | Exploring Large Language Models for Analyzing and Improving Method Names in Scientific Code ESEM - Emerging Results and Vision Track Gunnar Larsen University of Hawaii at Manoa, Carol Wong University of Hawaii at Manoa, Anthony Peruma University of Hawai‘i at Mānoa Pre-print | ||
16:33 26mTalk | Identifier Name Similarities: An Exploratory Study ESEM - Emerging Results and Vision Track Carol Wong University of Hawaii at Manoa, Mai Abe University of Hawai‘i at Mānoa, Silvia De Benedictis University of Hawai‘i at Mānoa, Marissa Halim University of Hawai‘i at Mānoa, Anthony Peruma University of Hawai‘i at Mānoa | ||
17:00 - 17:30 | Closing at Queen Liliuokalani Chair(s): Valentina Lenarduzzi University of Oulu, Daniel Port University of Hawai‘i at Mānoa, Fabio Q. B. da Silva Federal University of Pernambuco | ||
17:00 30mTalk | Closing Ceremony | ||
Accepted Papers
Call for Papers
The International Symposium on Empirical Software Engineering and Measurement (ESEM) Emerging Results, Vision and Reflection papers track features submissions that describe current work in progress from research or practice. Papers should clearly state the longer-term objectives and outline a plan for working towards those objectives.
Emerging Results communicate initial research results of new ideas to obtain feedback from the empirical software engineering community. Vision papers must describe long-term challenges and opportunities in empirical software engineering research and practice that are outside of current mainstream topics. Reflection papers discuss the current impact and implications of studies published in a partnered journal (TSE, IST, EMSE, JSS, TOSEM) from between 3 and 10 years ago (i.e., 2015-2022).
General Scope of Submissions
Submissions should not be under consideration for publication or presentation elsewhere. In addition to the specific scope of this track, submissions may address any aspect of software engineering but must tackle the problem from an empirical perspective and using a rigorous empirical method, including:
-
Empirical studies using qualitative, quantitative, and mixed methods
-
Cross- and multi-disciplinary methods and studies
-
Formal experiments and quasi-experiments
-
Case studies, action research, ethnography, and field studies
-
Survey research
-
Simulation studies
-
Artifact studies
-
Data mining using statistical and machine learning approaches
-
Secondary and tertiary studies including
-
Systematic literature reviews, systematic mapping study, and rapid reviews that include a strong synthesis part
-
Meta-analyses, qualitative, quantitative or structured syntheses of studies
-
-
Replication of empirical studies and families of studies
Topics commonly addressed using an empirical approach include, but are not limited to:
-
Evaluation and comparison of software models, tools, techniques, and practices
-
Modeling, measuring, and assessing product or process quality and productivity
-
Continuous software engineering
-
Software verification and validation, including analysis and testing
-
Software engineering for AI/ML systems
-
AI/ML for software engineering
-
Applications of software engineering to different types of systems and domains (e.g., IoT, Industry 4.0, Context-awareness systems, Cyber-physical systems)
-
Human factors, skills and competences, teamwork, and behavioral aspects of software engineering
We welcome submissions on these research meta-topics:
-
Development, evaluation, and comparison of empirical approaches and methods
-
Infrastructure for conducting empirical studies
-
Techniques and tools for supporting empirical studies
-
Empirically-based decision making
Due to the nature of the track, we encourage the submission of papers that: (a) demonstrate multi-disciplinary work, (b)transfer and apply empirical methods from other disciplines, (c) replication studies, and (d) studies with negative findings.
Important Dates
(All dates are end of the day, anywhere on earth)
- Abstract: May 16, 2025
- Submission: May 23, 2025
- Notification: July 04, 2025
- Camera-ready: July 25, 2025
How to Submit
Submissions to this track are limited to 6 pages (plus one page with references) and must be submitted through EasyChair by selecting the track “Emerging Results, Vision and Reflection Papers”. All submissions must be written in English and must be submitted in PDF format.
Please note:
-
Make sure the paper follows the standard IEEE Proceedings template (see https://www.ieee.org/conferences/publishing/templates.html).
-
Make sure your paper follows the double-blind instructions and does not reveal the authors’ identities.
-
The submission must also comply with the IEEE ethics guidelines IEEE ethics guidelines. In particular, it must not have been published elsewhere and must not be under review elsewhere while under review for ESEM.
The ESEM 2025 Emerging Results, Vision and Reflection Papers track will employ a double-blind review process. Thus, submissions may not reveal their authors’ identities. The authors must make an acceptable effort to honor the double-blind review process. In particular, the authors’ names must be omitted from the submission and references to their prior work should be in the third person. More details on author ethics and peer review can be found at https://conferences.ieeeauthorcenter.ieee.org/.
All submissions will be peer-reviewed by at least three experts from the international program committee of the track. Any papers that are outside the scope of the symposium, exceed the maximum number of pages for the respective category, or do not follow the formatting guidelines will be desk rejected without review. The PC members’ bidding information may be used to assess what is considered out of scope.
Finally, please note that each accepted contribution must have a minimum of one author registered by the deadline for the camera-ready submission for their respective paper type. Also, each paper must be presented by one of the authors. Failure to meet these criteria will result in the paper’s removal from the proceedings.
Open Science Policy
Openness in science is key to fostering progress via transparency, reproducibility, and replicability. While all submissions will undergo the same review process independent of whether or not they disclose their tools, data, and code, we expect authors to include a data availability statement in their submissions that either provides links to the open data/replication package or that explains why data cannot be disclosed (e.g., due to the sensitivity of the data or due to existing non-disclosure agreements). We recommend adding the data availability statement in the submission at the end of the introduction section explaining whether and where the data and related material is available and under which conditions the data/material can be accessed. For submissions based on open data sources, the publication of any cleaned or filtered data is mandatory.
To submit your tools, data, and code while still following the double-blind process, please refer to these guidelines.
Authors are requested to share their tools, data, and code in the form of a replication package, and provide explanations on how to use and navigate it.
-
Qualitative studies should provide explanations about the study protocol, coding and transcription schemas, and further relevant information.
-
Quantitative studies should include information about the source code and its main dependencies (including their version), description of input/output relevant to every step of data cleaning and labeling, feature engineering, model training, and evaluation.
We recommend providing these explanations in the method section of the paper, while further explanations and concrete instructions on how to navigate and use the replication package can be detailed in a README file.
We recommend to:
-
Share pre-prints in a non-commercial repository (e.g., arXiv) using an appropriate license (e.g., arXiv default non-exclusive license, Creative Commons CC-BY). When sharing pre-prints, authors must avoid specifying that the manuscript was submitted to ESEM 2025. We recommend against anonymizing them (i.e., by changing authors, title, abstract). The review committee members are instructed NOT to try to find out the identity of authors.
-
Share replication packages in an archival repository (e.g., Zenodo) using an appropriate license (e.g., based on Creative Commons).
For further information, please refer to “Open Science in Software Engineering” book chapter and feel free to approach the Open Science chairs (Eman Abdullah AlOmar and Martin Solari )
Track Co-Chairs
Elisa Yumi Nakagawa, University of São Paulo, Brazil
Apostolos Ampatzoglou, University of Macedonia, Greece