ESEM Industry, Government, and CommunityESEIW 2024
ESEM Industry, Government and Community Track (IGC) 2024
The ESEM IGC track is one of the major forums for practitioners and researchers to share their experiences and disseminate results concerning the experience of applying or evaluating software engineering technologies (process, methods, techniques and tools) in real-world settings. It provides an opportunity for practitioners and researchers to exchange new ideas and develop new collaborations. Submissions to this track must include at least one non-academic author who has made a material contribution to the work. Submissions to this track will be peer-reviewed mainly for relevance, substance, and interest to the conference rather than for “academic” rigor. We encourage submissions written by practitioners for practitioners.
Some areas of interest include, but are not limited to:
-
Case studies of development practice
-
Use of advanced tools or methods, including data-driven and AI-enabled solutions
-
Product development interactions with stakeholders
-
Adoption of DevOps, DataOps and MLOps
-
Management of technical debt and refactoring
-
-
Assessment and/or self-improvement of processes, tools, or practices
-
North-star metrics, OKRs and Measures Used in Practice
-
In-depth case study reports
-
Cross-organizational and software ecosystem collaboration
-
comparison between various LLMs, Gen AI platforms, applicability to industrial settings
-
-
Industry/academia collaboration
-
Knowledge exchange between industry and academia, including lessons learned
-
Problem identification identifying open research challenges
-
-
Compliance and Regulations
-
System and software safety compliance practices, including automotive and healthcare industries
-
Cybersecurity practices
-
GDPR, CCPA, and other Privacy Regulations
-
-
Community Participation
-
Community Service Projects and Outreach
-
Participation in open source communities
-
Participation in standards bodies and RFCs
-
-
Workforce assessment and advancement
-
Education to workforce pipeline (needs, outcomes, preparation)
-
Onboarding, Training, and Technical workforce development
-
-
Ethics
-
Diversity, Equity, Inclusion, and Belonging
-
Opportunities for collaborations
-
Health and Wellbeing - for example of aging populations across the world
We seek the following types of submissions:
Experience Reports
This type of submission is only open to industry, government, or community practitioners. Submissions should describe experiences that may help understanding situations in which practices or technologies are applied and their impact. Experience reports on implementing practices or technologies suggested or driven from research are especially encouraged. Experience reports should include information on the setting, provide motivation, explain the events leading to the outcomes including the challenges faced, summarize the outcomes, and conclude with lessons learned, take-away messages, and advice based on the described experience. An extensive description of related work or background material is not required. However, references to relevant research is appreciated. Accepted submissions will be invited to present their report at the conference and a summary will be included in the conference proceedings.
Experience Reports submissions should provide a 2-4 page summary of the experience.
Empirical Studies
Submissions should describe empirical studies conducted in industry, government, or community settings (e.g., action research, case studies). We encourage the submission of novel studies, replication studies, and studies with negative results (i.e., studies that did not deliver the expected results). Submissions should describe related work, provide details on the approach and methodology employed, and discuss implications of the results.
For Empirical Studies, we accept both full papers (6-10 pages) and short papers (4-6 pages).
IGC Challenge Workshop Session
This type of submission is only open to practitioners. IGC challenge submissions outline a new research challenge, arising from software practice and experience. The submission should clearly articulate the problem and motivate it in terms of its potential for industrial impact and/or its practical importance. The aim is to provide a well-defined industrially relevant problem for the research community to tackle. Submissions should include a brief background and describe a problem or area that is in need of empirical study, and a list of questions/challenges to be discussed. Accepted submissions will be given an opportunity to conduct a workshop session at the conference to discuss the problem and solicit potential collaborations. Submissions are limited to 2-pages and must use the following outline:
-
Background
Brief background of the organization and context. -
Problem(s)
Description of problem or areas in need of empirical study. -
Discussion Points
Bullet point list of questions, challenges, and requests. Put these in order of priority as there will be limited time in the workshop and not all discussion points will be addressed. The objective here is to stimulate interest and possible collaborations.
Submission Details
All submissions must be written in English and must be submitted via EasyChair in the PDF format, and they must be formatted according to the ACM proceedings template, which can be found at ACM Proceedings Template (https://www.acm.org/publications/proceedings-template) or in Overleaf at (https://www.overleaf.com/gallery/tagged/acm).
Page limits include figures, tables, appendices. One additional page may be used for references.
Submissions must include an additional section, a Lay Abstract: a 250-word summary of the paper written in plain English, intended to be read not by researchers, but by practicing software engineers or community members, who may have very little understanding of software engineering research or academic jargon. This will help make our work more accessible to the public, an important constituency and focus of our research. The Lay Abstract should come after the Abstract but before the paper’s Introduction section.
It is not required to publicly reveal data or data sources. However, submissions should provide a statement indicating the provenance of the data and its appropriate use in the study/report.
Submissions must be submitted via EasyChair by selecting the “IGC Track”.
Submission Link: https://easychair.org/my/conference?conf=esem24
Important Dates
(All dates are end of the day, anywhere on earth)
Submission: August 1 2024
Notification: August 26 2024
Camera-ready: September 6 2024
Program Co-Chairs
Smita Ghaisas, TCS Research, India
Jan Bosch, Chalmers University of Technology, Sweden
Thu 24 OctDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:35 | Open source software and repository miningESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Multimedia (B3 Building - Hall) Chair(s): Davide Taibi University of Oulu | ||
11:00 20mFull-paper | Sustaining Maintenance Labor for Healthy Open Source Software Projects through Human Infrastructure: A Maintainer Perspective ESEM Technical Papers Johan Linåker RISE Research Institutes of Sweden, Georg Link Bitergia, Kevin Lumbard Creighton University | ||
11:20 20mFull-paper | Documenting Ethical Considerations in Open Source AI Models ESEM Technical Papers Haoyu Gao The University of Melbourne, Mansooreh Zahedi The Univeristy of Melbourne, Christoph Treude Singapore Management University, Sarita Rosenstock the University of Melbourne, Marc Cheong the University of Melbourne Pre-print | ||
11:40 20mFull-paper | An Exploratory Mixed-methods Study on General Data Protection Regulation (GDPR) Compliance in Open-Source Software ESEM Technical Papers Lucas Franke Virginia Tech, Huayu Liang Virginia Tech, Sahar Farzanehpour Virginia Tech, Aaron Brantly Virginia Tech, James C. Davis Purdue University, Chris Brown Virginia Tech Pre-print | ||
12:00 20mFull-paper | An Empirical Study of API Misuses of Data-Centric Libraries ESEM Technical Papers Akalanka Galappaththi University of Alberta, Sarah Nadi New York University Abu Dhabi, University of Alberta, Christoph Treude Singapore Management University Pre-print | ||
12:20 15mVision and Emerging Results | Automatic Categorization of GitHub Actions with Transformers and Few-shot Learning ESEM Emerging Results, Vision and Reflection Papers Track Phuong T. Nguyen University of L’Aquila, Juri Di Rocco University of L'Aquila, Claudio Di Sipio University of L'Aquila, Mudita Shakya University of L'Aquila, Davide Di Ruscio University of L'Aquila, Massimiliano Di Penta University of Sannio, Italy Pre-print |
14:00 - 15:30 | Repository miningESEM Journal-First Papers / ESEM IGC / ESEM Technical Papers at Multimedia (B3 Building - Hall) Chair(s): Apostolos Ampatzoglou University of Macedonia | ||
14:00 20mFull-paper | Decoding Android Permissions: A Study of Developer Challenges and Solutions on Stack Overflow ESEM Technical Papers Sahrima Jannat Oishwee University of Saskatchewan, Zadia Codabux University of Saskatchewan, Natalia Stakhanova University of Saskatchewan | ||
14:20 20mFull-paper | Negative Results of Image Processing for Identifying Duplicate Questions on Stack Overflow ESEM Technical Papers | ||
14:40 20mFull-paper | Understanding Fairness in Software Engineering: Insights from Stack Exchange Sites ESEM Technical Papers Emeralda Sesari University of Groningen, Federica Sarro University College London, Ayushi Rastogi University of Groningen, The Netherlands DOI Pre-print | ||
15:00 15mIndustry talk | Reducing Events to Augment Log-based Anomaly Detection Models: An Empirical Study ESEM IGC Lingzhe Zhang Peking University, China, Tong Jia Institute for Artificial Intelligence, Peking University, Beijing, China, Kangjin Wang Alibaba Group, Mengxi Jia Peking University, Yong Yang , Ying Li School of Software and Microelectronics, Peking University, Beijing, China | ||
15:15 15mJournal Early-Feedback | The upper bound of information diffusion in code review ESEM Journal-First Papers Michael Dorner Blekinge Institute of Technology, Daniel Mendez Blekinge Institute of Technology and fortiss, Krzysztof Wnuk , Ehsan Zabardast Blekinge Institute of Technology, Jacek Czerwonka Developer Services, Microsoft Link to publication DOI Pre-print |
14:00 - 15:30 | Empirical research methods and applicationsESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Telensenyament (B3 Building - 1st Floor) Chair(s): Valentina Lenarduzzi University of Oulu | ||
14:00 20mFull-paper | Game Software Engineering: A Controlled Experiment Comparing Automated Content Generation Techniques ESEM Technical Papers Mar Zamorano López University College London, África Domingo Universidad San Jorge, Carlos Cetina Universitat Politècnica de València, Spain, Federica Sarro University College London | ||
14:20 20mFull-paper | Evaluating Software Modelling Recommendations: Towards Systematic Guidelines for Modelling ESEM Technical Papers | ||
14:40 20mFull-paper | What do we know about Hugging Face? A systematic literature review and quantitative validation of qualitative claims ESEM Technical Papers Jason Jones Purdue University, Wenxin Jiang Purdue University, Nicholas Synovic Loyola University Chicago, George K. Thiruvathukal Loyola University Chicago and Argonne National Laboratory, James C. Davis Purdue University DOI Pre-print | ||
15:00 15mVision and Emerging Results | On the Creation of Representative Samples of Software Repositories ESEM Emerging Results, Vision and Reflection Papers Track June Gorostidi IN3 - UOC, Adem Ait University of Luxembourg, Jordi Cabot Luxembourg Institute of Science and Technology, Javier Luis Cánovas Izquierdo IN3 - UOC Pre-print | ||
15:15 15mVision and Emerging Results | Can ChatGPT emulate humans in software engineering surveys? ESEM Emerging Results, Vision and Reflection Papers Track Igor Steinmacher Northern Arizona University, Jacob Mcauley Penney NAU, Katia Romero Felizardo UTFPR-CP, Alessandro Garcia Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Marco Gerosa Northern Arizona University |
16:00 - 17:30 | Software measurement and estimationsESEM Technical Papers / ESEM IGC / ESEM Journal-First Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Multimedia (B3 Building - Hall) Chair(s): Beatriz Bernárdez Universidad de Sevilla | ||
16:00 20mFull-paper | Enhancing Change Impact Prediction by Integrating Evolutionary Coupling with Software Change Relationships ESEM Technical Papers Daihong Zhou School of Computer Science and Information Engineering, Shanghai Institute of Technology, Jiyue Zhang School of Computer Science, Fudan University, Ping Yu Fudan University, China, Wunan Guo School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology | ||
16:20 20mFull-paper | M-score: An Empirically Derived Software Modularity Metric ESEM Technical Papers Ernst Pisch Drexel University, Yuanfang Cai Drexel University, Rick Kazman , Jason Lefever Drexel University, Hongzhou Fang Drexel University | ||
16:40 15mVision and Emerging Results | Towards Automated Continuous Security Compliance ESEM Emerging Results, Vision and Reflection Papers Track Florian Angermeir fortiss, Jannik Fischbach Netlight GmbH / fortiss GmbH, Fabiola Moyon Siemens AG, Munich, Germany, Daniel Mendez Blekinge Institute of Technology and fortiss Pre-print | ||
17:00 15mJournal Early-Feedback | Much more than a prediction: Expert-based software effort estimation as a behavioral act ESEM Journal-First Papers Patrícia G. F. Matsubara Federal University of Mato Grosso do Sul (UFMS), Igor Steinmacher Northern Arizona University, Bruno Gadelha UFAM, Tayana Conte Universidade Federal do Amazonas DOI | ||
17:15 15mIndustry talk | On the Accuracy of Effort Estimations based on COSMIC Functional Size Measurement: A Case Study ESEM IGC Ersin Ersoy Paycell, Selami Bagriyanik Singularity Software Technologies; Istanbul Topkapi University, Hasan Sozer Ozyegin University |
16:00 - 17:30 | Software vulnerabilities and defectsESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track / ESEM Journal-First Papers at Sala de graus (C4 Building) Chair(s): Daniela Cruzes Norwegian University of Science and Technology | ||
16:00 20mFull-paper | Automated Code-centric Software Vulnerability Assessment: How Far Are We? An Empirical Study in C/C++ ESEM Technical Papers Anh Nguyen The , Triet Le The University of Adelaide, Muhammad Ali Babar School of Computer Science, The University of Adelaide DOI Pre-print | ||
16:20 20mFull-paper | Empirical Evaluation of Frequency Based Statistical Models for Estimating Killable Mutants ESEM Technical Papers Konstantin Kuznetsov Saarland University, CISPA, Alessio Gambi Austrian Institute of Technology (AIT), Saikrishna Dhiddi Passau University, Julia Hess Saarland University, Rahul Gopinath University of Sydney | ||
16:40 20mFull-paper | Reevaluating the Defect Proneness of Atoms of Confusion in Java Systems ESEM Technical Papers Guoshuai Shi University of Waterloo, Farshad Kazemi University of Waterloo, Michael W. Godfrey University of Waterloo, Canada, Shane McIntosh University of Waterloo Pre-print | ||
17:00 15mVision and Emerging Results | DetectBERT: Towards Full App-Level Representation Learning to Detect Android Malware ESEM Emerging Results, Vision and Reflection Papers Track Tiezhu Sun University of Luxembourg, Nadia Daoudi Luxembourg Institute of Science and Technology, Kisub Kim Singapore Management University, Singapore, Kevin Allix Independent Researcher, Tegawendé F. Bissyandé University of Luxembourg, Jacques Klein University of Luxembourg | ||
17:15 15mJournal Early-Feedback | Identifying concerns when specifying machine learning-enabled systems: A perspective-based approach ESEM Journal-First Papers Hugo Villamizar fortiss GmbH, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Helio Côrtes Vieira Lopes PUC-Rio, Daniel Mendez Blekinge Institute of Technology and fortiss DOI |
16:00 - 17:30 | Machine learning for software engineeringESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track / ESEM Journal-First Papers at Telensenyament (B3 Building - 1st Floor) Chair(s): Luigi Quaranta University of Bari, Italy | ||
16:00 20mFull-paper | A Transformer-based Approach for Augmenting Software Engineering Chatbots Datasets ESEM Technical Papers Ahmad Abdellatif University of Calgary, Khaled Badran Concordia University, Canada, Diego Costa Concordia University, Canada, Emad Shihab Concordia University | ||
16:20 20mFull-paper | Unsupervised and Supervised Co-learning for Comment-based Codebase Refining and its Application in Code Search ESEM Technical Papers Gang Hu School of Information Science & Engineering, Yunnan University, Xiaoqin Zeng School of Information Science & Engineering, Yunnan University, Wanlong Yu , Min Peng , YUAN Mengting School of Computer Science, Wuhan University, Wuhan, China, Liang Duan | ||
16:40 20mFull-paper | Good things come in three: Generating SO Post Titles with Pre-Trained Models, Self Improvement and Post Ranking ESEM Technical Papers Duc Anh Le Hanoi University of Science and Technology, Anh M. T. Bui Hanoi University of Science and Technology, Phuong T. Nguyen University of L’Aquila, Davide Di Ruscio University of L'Aquila Pre-print | ||
17:00 15mVision and Emerging Results | PromptLink: Multi-template prompt learning with adversarial training for issue-commit link recovery ESEM Emerging Results, Vision and Reflection Papers Track Yang Deng The School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China, Bangchao Wang Wuhan Textile University, Zhiyuan Zou The School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China, Luyao Ye The School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China | ||
17:15 15mJournal Early-Feedback | GPTSniffer: A CodeBERT-based classifier to detect source code written by ChatGPT ESEM Journal-First Papers Phuong T. Nguyen University of L’Aquila, Juri Di Rocco University of L'Aquila, Claudio Di Sipio University of l'Aquila, Riccardo Rubei University of L'Aquila, Davide Di Ruscio University of L'Aquila, Massimiliano Di Penta University of Sannio, Italy Link to publication DOI Pre-print |
Fri 25 OctDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | Large language models in software engineering IESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Telensenyament (B3 Building - 1st Floor) Chair(s): Phuong T. Nguyen University of L’Aquila | ||
11:00 20mFull-paper | Optimizing the Utilization of Large Language Models via Schedule Optimization: An Exploratory Study ESEM Technical Papers Yueyue Liu The University of Newcastle, Hongyu Zhang Chongqing University, Zhiqiang Li Shaanxi Normal University, Yuantian Miao The University of Newcastle | ||
11:20 20mFull-paper | A Comparative Study on Large Language Models for Log Parsing ESEM Technical Papers Merve Astekin Simula Research Laboratory, Max Hort Simula Research Laboratory, Leon Moonen Simula Research Laboratory and BI Norwegian Business School | ||
11:40 20mFull-paper | Are Large Language Models a Threat to Programming Platforms? An Exploratory Study ESEM Technical Papers Md Mustakim Billah University of Saskatchewan, Palash Ranjan Roy University of Saskatchewan, Zadia Codabux University of Saskatchewan, Banani Roy University of Saskatchewan Pre-print | ||
12:00 15mVision and Emerging Results | Automatic Library Migration Using Large Language Models: First Results ESEM Emerging Results, Vision and Reflection Papers Track Aylton Almeida UFMG, Laerte Xavier PUC Minas, Marco Tulio Valente Federal University of Minas Gerais, Brazil | ||
12:15 15mVision and Emerging Results | Evaluating Large Language Models in Exercises of UML Class Diagram Modeling ESEM Emerging Results, Vision and Reflection Papers Track Daniele De Bari Politecnico di Torino, Giacomo Garaccione Politecnico di Torino, Riccardo Coppola Politecnico di Torino, Marco Torchiano Politecnico di Torino, Luca Ardito Politecnico di Torino |
14:00 - 15:30 | Large language models in software engineering IIESEM Emerging Results, Vision and Reflection Papers Track / ESEM IGC at Telensenyament (B3 Building - 1st Floor) Chair(s): Claudio Di Sipio University of l'Aquila | ||
14:00 15mVision and Emerging Results | Debugging with Open-Source Large Language Models: An Evaluation ESEM Emerging Results, Vision and Reflection Papers Track Yacine Majdoub IResCoMath Lab, University of Gabes, Eya Ben Charrada IResCoMath Lab, University of Gabes Link to publication DOI Pre-print | ||
14:15 15mVision and Emerging Results | Multi-language Software Development in the LLM Era: Insights from Practitioners’ Conversations with ChatGPT ESEM Emerging Results, Vision and Reflection Papers Track Lucas Almeida Aguiar State University of Ceará, Matheus Paixao State University of Ceará, Rafael Carmo Federal University of Ceará, Edson Soares Instituto Atlantico & State University of Ceara (UECE), Antonio Leal State University of Ceará, Matheus Freitas State University of Ceará, Eliakim Gama State University of Ceará | ||
14:30 15mVision and Emerging Results | Exploring LLM-Driven Explanations for Quantum Algorithms ESEM Emerging Results, Vision and Reflection Papers Track Giordano d'Aloisio University of L'Aquila, Sophie Fortz King's College London, Carol Hanna University College London, Daniel Fortunato INESC-ID, University of Porto, Avner Bensoussan King's College London, Eñaut Mendiluze Usandizaga Simula Research Laboratory, Norway, Federica Sarro University College London Pre-print | ||
14:45 15mIndustry talk | Beyond Words: On Large Language Models Actionability in Mission-Critical Risk Analysis ESEM IGC Matteo Esposito University of Oulu, Francesco Palagiano Multitel di Lerede Alessandro & C. s.a.s., Valentina Lenarduzzi University of Oulu, Davide Taibi University of Oulu Pre-print | ||
15:00 15mVision and Emerging Results | Detecting Code Smells using ChatGPT: Initial Insights ESEM Emerging Results, Vision and Reflection Papers Track Luciana L. Silva Federal University of Minas Gerais, Janio R. Silva IFMG, João Eduardo Montandon Universidade Federal de Minas Gerais (UFMG), Marcus Andrade IFMG, Marco Tulio Valente Federal University of Minas Gerais, Brazil | ||
15:15 15mIndustry talk | ChatGPT’s Potential in Cryptography Misuse Detection: A Comparative Analysis with Static Analysis Tools ESEM IGC |
16:00 - 17:10 | Relationships and theory buildingESEM Journal-First Papers / ESEM Technical Papers at Multimedia (B3 Building - Hall) Chair(s): Rogardt Heldal Western Norway University of Applied Science | ||
16:00 20mFull-paper | Gamification of a BPMN Modeling Course: an Analysis of Effectiveness and Student Perception ESEM Technical Papers Giacomo Garaccione Politecnico di Torino, Riccardo Coppola Politecnico di Torino, Luca Ardito Politecnico di Torino, Marco Torchiano Politecnico di Torino | ||
16:20 20mFull-paper | Data Analysis Tools Affect Outcomes of Eye-Tracking Studies ESEM Technical Papers Timon Dörzapf Saarland University, Saarland Informatics Campus, Norman Peitek Saarland University, Marvin Wyrich Saarland University, Sven Apel Saarland University | ||
16:40 15mJournal Early-Feedback | A Theory of Factors Affecting Continuous Experimentation (FACE) ESEM Journal-First Papers DOI | ||
16:55 15mJournal Early-Feedback | It’s about time: How to study intertemporal choice in systems design ESEM Journal-First Papers Fabian Fagerholm Aalto University, Andres De los Ríos , Carol Cárdenas-Castro S4N, Jenny Gil S4N, Alexander Chatzigeorgiou University of Macedonia, Apostolos Ampatzoglou University of Macedonia, Christoph Becker University of Toronto DOI |
16:00 - 17:00 | Empirical studies for programming languages challengesESEM Technical Papers / ESEM Emerging Results, Vision and Reflection Papers Track at Telensenyament (B3 Building - 1st Floor) Chair(s): Julian Frattini Blekinge Institute of Technology | ||
16:00 20mFull-paper | Cross-Language Dependencies: An Empirical Study of Kotlin-Java ESEM Technical Papers Qiong Feng Nanjing University of Science and Technology, Huan Ji Huawei Nanjing Research Center, Xiaotian Ma Nanjing University of Science and Technology, Peng Liang Wuhan University, China Pre-print Media Attached | ||
16:20 20mFull-paper | Broken Agreement: The Evolution of Solidity Error Handling ESEM Technical Papers Charalambos Ioannis Mitropoulos Technical University of Crete, Maria Kechagia University College London, Chrysostomos Maschas GRNET, Sotirios Ioannidis Technical University of Crete, Federica Sarro University College London, Dimitris Mitropoulos University of Athens | ||
16:40 15mVision and Emerging Results | Rusty Linux: Advances in Rust for Linux Kernel Development ESEM Emerging Results, Vision and Reflection Papers Track |