ESEM Emerging Results, Vision and Reflection Papers TrackESEIW 2024
Call for Papers
The International Symposium on Empirical Software Engineering and Measurement (ESEM) Emerging Results, Vision and Reflection papers track features submissions that describe current work in progress from research or practice. Papers should clearly state the longer-term objectives and outline a plan for working towards those objectives.
Emerging Results communicate initial research results of new ideas to obtain feedback from the empirical software engineering community. Vision papers must describe long-term challenges and opportunities in empirical software engineering research and practice that are outside of current mainstream topics. Reflection papers discuss the current impact and implications of studies published in a partnered journal (TSE, IST, EMSE, JSS, TOSEM) from between 3 and 10 years ago (i.e., 2014-2021).
General Scope of Submissions
Submissions should not be under consideration for publication or presentation elsewhere. In addition to the specific scope of this track, submissions may address any aspect of software engineering but must tackle the problem from an empirical perspective and using a rigorous empirical method, including:
-
Empirical studies using qualitative, quantitative, and mixed methods
-
Cross- and multi-disciplinary methods and studies
-
Formal experiments and quasi-experiments
-
Case studies, action research, ethnography and field studies
-
Survey research
-
Simulation studies
-
Artifact studies
-
Data mining using statistical and machine learning approaches
-
Secondary and tertiary studies including
-
Systematic literature reviews and rapid reviews, that include a strong synthesis part
-
Meta-analyses, and qualitative, quantitative or structured syntheses of studies
-
-
Replication of empirical studies and families of studies
Topics commonly addressed using an empirical approach include, but are not limited to:
-
Evaluation and comparison of software models, tools, techniques, and practices
-
Modeling, measuring, and assessing product or process quality and productivity
-
Continuous software engineering
-
Software verification and validation, including analysis and testing
-
Engineering of software systems which include machine learning components and data dependencies
-
Applications of software engineering to different types of systems and domains (e.g. IoT, Industry 4.0, Context-awareness systems, Cyber-physical systems)
-
Human factors, teamwork, and behavioral aspects of software engineering
We welcome submissions on these research meta-topics:
-
Development, evaluation, and comparison of empirical approaches and methods
-
Infrastructure for conducting empirical studies
-
Techniques and tools for supporting empirical studies
-
Empirically-based decision making
We also welcome submissions that:
-
demonstrate multi-disciplinary work,
-
transfer and apply empirical methods from other disciplines,
-
replication studies, and
-
studies with negative findings.
Important Dates
(All dates are end of the day, anywhere on earth)
Abstract: May 30, 2024
Submission: June 7, 2024
Notification: July 17, 2024 July 22, 2024
Camera-ready: September 6, 2024
How to Submit
Submissions to this track are limited to 6 pages plus one page with references and must be submitted through EasyChair by selecting the track “Emerging Results, Vision and Reflection Papers”. All submissions must be written in English and must be submitted via EasyChair in PDF format.
Please note:
-
Make sure the paper follows the standard ACM Proceedings template (see https://www.acm.org/publications/proceedings-template).
-
Make sure your paper follows the double-blind instructions and does not reveal the authors’ identities.
-
The submission must also comply with the IEEE ethics guidelines IEEE ethics guidelines. In particular, it must not have been published elsewhere and must not be under review elsewhere while under review for ESEM.
The ESEM 2024 Emerging Results, Vision and Reflection Papers track will employ a double-blind review process. Thus, submissions may not reveal their authors’ identities. The authors must make an acceptable effort to honor the double-blind review process. In particular, the authors’ names must be omitted from the submission and references to their prior work should be in the third person. More details on author ethics and peer review can be found at https://conferences.ieeeauthorcenter.ieee.org/.
All submissions will be peer-reviewed by at least three experts from the international program committee of the track and will receive an additional meta-review. Any papers that are outside the scope of the symposium, exceed the maximum number of pages for the respective category, or do not follow the formatting guidelines will be desk rejected without review. The PC members’ bidding information may be used to assess what is considered out of scope.
Finally, please note that each accepted contribution must have a minimum of one author registered by the deadline for the camera-ready submission for their respective paper type. Also, each paper must be presented by one of the authors. Failure to meet these criteria will result in the paper’s removal from the proceedings.
Open Science Policy
Openness in science is key to fostering progress via transparency, reproducibility, and replicability. While all submissions will undergo the same review process independent of whether or not they disclose their tools, data, and code, we expect authors to include a data availability statement in their submissions that either provides links to the open data/replication package or that explains why data cannot be disclosed (e.g., due to the sensitivity of the data or due to existing non-disclosure agreements). We recommend adding the data availability statement in the submission at the end of the introduction section explaining whether and where the data and related material is available and under which conditions the data/material can be accessed. For submissions based on open data sources, the publication of any cleaned or filtered data is mandatory.
To submit your tools, data, and code while still following the double-blind process, please refer to these guidelines.
Authors are requested to share their tools, data, and code in the form of a replication package, and provide explanations on how to use and navigate it.
-
Qualitative studies should provide explanations about the study protocol, coding and transcription schemas, and further relevant information.
-
Quantitative studies should include information about the source code and its main dependencies (incl. version), description of input/output relevant to every step of data cleaning and labeling, feature engineering, model training, and evaluation.
We recommend providing these explanations in the method section of the paper, while further explanations and concrete instructions on how to navigate and use the replication package can be detailed in a README file.
We recommend to:
-
Share pre-prints in a non-commercial repository (e.g., arXiv) using an appropriate license (e.g., arXiv default non-exclusive license, Creative Commons CC-BY). When sharing pre-prints, authors must avoid specifying that the manuscript was submitted to ESEM 2024. We recommend against anonymizing them (i.e., by changing authors, title, abstract). The review committee members are instructed NOT to try to find out the identity of authors.
-
Share replication packages in an archival repository (e.g., Zenodo) using an appropriate license (e.g., based on Creative Commons).
For further information, please refer to “Open Science in Software Engineering” book chapter and feel free to approach the Open Science chairs (Davide Fucci <davide.fucci@bth.se> and Martin Solari <martin.solari@ort.edu.uy>)
Track Co-Chairs
Marcela Genero, University of Castilla-La Mancha, Spain
Lucas Layman, University of North Carolina Wilmington, United States
Thu 24 OctDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:35 | Open source software and repository miningESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Multimedia (B3 Building - Hall) Chair(s): Davide Taibi University of Oulu | ||
12:20 15mVision and Emerging Results | Automatic Categorization of GitHub Actions with Transformers and Few-shot Learning ESEM Emerging Results, Vision and Reflection Papers Track Phuong T. Nguyen University of L’Aquila, Juri Di Rocco University of L'Aquila, Claudio Di Sipio University of L'Aquila, Mudita Shakya University of L'Aquila, Davide Di Ruscio University of L'Aquila, Massimiliano Di Penta University of Sannio, Italy Pre-print |
11:00 - 12:30 | Software testingESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track / ESEM IGC at Sala de graus (C4 Building) Chair(s): Marco Torchiano Politecnico di Torino | ||
12:15 15mVision and Emerging Results | Do Developers Use Static Application Security Testing (SAST) Tools Straight Out of the Box? A large-scale Empirical Study ESEM Emerging Results, Vision and Reflection Papers Track Gareth Bennett Lancaster University, Tracy Hall Lancaster University, Steve Counsell Brunel University London, Emily Winter Lancaster University, Thomas Shippey LogicMonitor |
11:00 - 12:30 | Empirical research methodsESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Telensenyament (B3 Building - 1st Floor) Chair(s): Stefan Wagner Technical University of Munich | ||
12:00 15mVision and Emerging Results | Data extraction for systematic mapping study using a large language model - a proof-of-concept study in software engineering ESEM Emerging Results, Vision and Reflection Papers Track Katia Romero Felizardo UTFPR-CP, Igor Steinmacher Northern Arizona University, Marcia Sampaio Lima Universidade do Estado do Amazonas - UEA, Anderson Deizepe UTFPR-CP, Tayana Conte Universidade Federal do Amazonas, Monalessa P. Barcellos Federal University of Espírito Santo | ||
12:15 15mVision and Emerging Results | Crossover Designs in Software Engineering Experiments: Review of the State of Analysis ESEM Emerging Results, Vision and Reflection Papers Track Julian Frattini Blekinge Institute of Technology, Davide Fucci Blekinge Institute of Technology, Sira Vegas Universidad Politecnica de Madrid Link to publication DOI Pre-print Media Attached |
14:00 - 15:30 | Empirical research methods and applicationsESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Telensenyament (B3 Building - 1st Floor) Chair(s): Valentina Lenarduzzi University of Oulu | ||
15:00 15mVision and Emerging Results | On the Creation of Representative Samples of Software Repositories ESEM Emerging Results, Vision and Reflection Papers Track June Gorostidi IN3 - UOC, Adem Ait University of Luxembourg, Jordi Cabot Luxembourg Institute of Science and Technology, Javier Luis Cánovas Izquierdo IN3 - UOC Pre-print | ||
15:15 15mVision and Emerging Results | Can ChatGPT emulate humans in software engineering surveys? ESEM Emerging Results, Vision and Reflection Papers Track Igor Steinmacher Northern Arizona University, Jacob Mcauley Penney NAU, Katia Romero Felizardo UTFPR-CP, Alessandro Garcia Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Marco Gerosa Northern Arizona University |
16:00 - 17:30 | Software measurement and estimationsESEM Technical Papers / ESEM IGC / ESEM Journal-First Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Multimedia (B3 Building - Hall) Chair(s): Beatriz Bernárdez Universidad de Sevilla | ||
16:40 15mVision and Emerging Results | Towards Automated Continuous Security Compliance ESEM Emerging Results, Vision and Reflection Papers Track Florian Angermeir fortiss, Jannik Fischbach Netlight GmbH / fortiss GmbH, Fabiola Moyon Siemens AG, Munich, Germany, Daniel Mendez Blekinge Institute of Technology and fortiss Pre-print |
16:00 - 17:30 | Software vulnerabilities and defectsESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track / ESEM Journal-First Papers at Sala de graus (C4 Building) Chair(s): Daniela Cruzes Norwegian University of Science and Technology | ||
17:00 15mVision and Emerging Results | DetectBERT: Towards Full App-Level Representation Learning to Detect Android Malware ESEM Emerging Results, Vision and Reflection Papers Track Tiezhu Sun University of Luxembourg, Nadia Daoudi Luxembourg Institute of Science and Technology, Kisub Kim Singapore Management University, Singapore, Kevin Allix Independent Researcher, Tegawendé F. Bissyandé University of Luxembourg, Jacques Klein University of Luxembourg |
16:00 - 17:30 | Machine learning for software engineeringESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track / ESEM Journal-First Papers at Telensenyament (B3 Building - 1st Floor) Chair(s): Luigi Quaranta University of Bari, Italy | ||
17:00 15mVision and Emerging Results | PromptLink: Multi-template prompt learning with adversarial training for issue-commit link recovery ESEM Emerging Results, Vision and Reflection Papers Track Yang Deng The School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China, Bangchao Wang Wuhan Textile University, Zhiyuan Zou The School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China, Luyao Ye The School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China |
Fri 25 OctDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | Human aspects and stakeholdersESEM Emerging Results, Vision and Reflection Papers Track / ESEM Technical Papers / ESEM Journal-First Papers at Multimedia (B3 Building - Hall) Chair(s): Ronnie de Souza Santos University of Calgary | ||
12:00 15mVision and Emerging Results | Effective Inclusion of People with Disabilities in Software Development Teams ESEM Emerging Results, Vision and Reflection Papers Track Thayssa Rocha Zup Innovation & UFPA, Cleidson de Souza Federal University of Pará Belém, Luciano Teran Universidade Federal do Pará, Marcelle Mota Universidade Federal do Pará |
11:00 - 12:30 | Large language models in software engineering IESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Telensenyament (B3 Building - 1st Floor) Chair(s): Phuong T. Nguyen University of L’Aquila | ||
12:00 15mVision and Emerging Results | Automatic Library Migration Using Large Language Models: First Results ESEM Emerging Results, Vision and Reflection Papers Track Aylton Almeida UFMG, Laerte Xavier PUC Minas, Marco Tulio Valente Federal University of Minas Gerais, Brazil | ||
12:15 15mVision and Emerging Results | Evaluating Large Language Models in Exercises of UML Class Diagram Modeling ESEM Emerging Results, Vision and Reflection Papers Track Daniele De Bari Politecnico di Torino, Giacomo Garaccione Politecnico di Torino, Riccardo Coppola Politecnico di Torino, Marco Torchiano Politecnico di Torino, Luca Ardito Politecnico di Torino |
14:00 - 15:30 | Empirical studies in various domainsESEM IGC / ESEM Journal-First Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Multimedia (B3 Building - Hall) Chair(s): Carolyn Seaman University of Maryland Baltimore County | ||
15:00 15mVision and Emerging Results | Code Clone Configuration as a Multi-Objective Search Problem ESEM Emerging Results, Vision and Reflection Papers Track Denis Sousa State University of Ceará, Matheus Paixao State University of Ceará, Chaiyong Ragkhitwetsagul Mahidol University, Italo Uchoa State University of Ceará |
14:00 - 15:30 | Large language models in software engineering IIESEM Emerging Results, Vision and Reflection Papers Track / ESEM IGC at Telensenyament (B3 Building - 1st Floor) Chair(s): Claudio Di Sipio University of l'Aquila | ||
14:00 15mVision and Emerging Results | Debugging with Open-Source Large Language Models: An Evaluation ESEM Emerging Results, Vision and Reflection Papers Track Yacine Majdoub IResCoMath Lab, University of Gabes, Eya Ben Charrada IResCoMath Lab, University of Gabes Link to publication DOI Pre-print | ||
14:15 15mVision and Emerging Results | Multi-language Software Development in the LLM Era: Insights from Practitioners’ Conversations with ChatGPT ESEM Emerging Results, Vision and Reflection Papers Track Lucas Almeida Aguiar State University of Ceará, Matheus Paixao State University of Ceará, Rafael Carmo Federal University of Ceará, Edson Soares Instituto Atlantico & State University of Ceara (UECE), Antonio Leal State University of Ceará, Matheus Freitas State University of Ceará, Eliakim Gama State University of Ceará | ||
14:30 15mVision and Emerging Results | Exploring LLM-Driven Explanations for Quantum Algorithms ESEM Emerging Results, Vision and Reflection Papers Track Giordano d'Aloisio University of L'Aquila, Sophie Fortz King's College London, Carol Hanna University College London, Daniel Fortunato INESC-ID, University of Porto, Avner Bensoussan King's College London, Eñaut Mendiluze Usandizaga Simula Research Laboratory, Norway, Federica Sarro University College London Pre-print | ||
15:00 15mVision and Emerging Results | Detecting Code Smells using ChatGPT: Initial Insights ESEM Emerging Results, Vision and Reflection Papers Track Luciana L. Silva Federal University of Minas Gerais, Janio R. Silva IFMG, João Eduardo Montandon Universidade Federal de Minas Gerais (UFMG), Marcus Andrade IFMG, Marco Tulio Valente Federal University of Minas Gerais, Brazil |
16:00 - 17:00 | Empirical studies for programming languages challengesESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Telensenyament (B3 Building - 1st Floor) Chair(s): Julian Frattini Blekinge Institute of Technology | ||
16:40 15mVision and Emerging Results | Rusty Linux: Advances in Rust for Linux Kernel Development ESEM Emerging Results, Vision and Reflection Papers Track |