ESEM Industry, Government, and CommunityESEIW 2023
Important Dates
Submission: Tuesday, May 23, 2023
Notification: Friday, June 23, 2023
Camera ready: Friday, July 7, 2023
Co-Chairs
Andrew Begel Carnegie Mellon University
Dan Port University of Hawaii, Manoa
The ESEM IGC track is one of the major forums for practitioners and researchers to share their experiences and disseminate results concerning the experience of applying or evaluating software engineering technologies (process, methods, techniques and tools) in real settings. It provides an opportunity for practitioners and researchers to exchange new ideas and develop new collaborations. Submissions to this track must include at least one non-academic author who has made a material contribution to the work. Submissions to this track will be peer-reviewed mainly for relevance, substance, and interest to the conference rather than for “academic” rigor. We encourage submissions written by practitioners for practitioners.
Some areas of interest include, but are not limited to:
- Case studies of development practice
- Use of advanced tools or methods (e.g., AI)
- Product development interactions with non-Engineers
- Issues with Maintenance, DevOps, CI
- Management of large-scale services and frameworks
- War stories
- Assessment and/or self-improvement of processes, tools, or practices
- Metrics and Measures Used in Practice
- Progress towards internal goals or metrics
- Reports on Best Practices
- Empirical Assessment of Technical Management
- Translation of research into practice and vice versa
- Adaptation and use of research tools (no matter how old) in practice
- Lessons learned applying academic research to practice (what worked, what didn’t work)
- Explaining current problems that need to be addressed by research
- Compliance and Regulations
- GDPR, CCPA, and other Privacy Regulations
- Community Participation
- Community Service Projects and Outreach
- Participation in open source communities
- Participation in standards bodies and RFCs
- Workforce assessment and advancement
- Education to workforce pipeline (needs, outcomes, preparation)
- Onboarding, Training, and Technical workforce development
- Ethics
- Diversity, Equity, Inclusion, and Belonging
- Opportunities for collaborations
We seek the following types of submissions:
Experience Reports
This type of submission is only open to industry, government, or community practitioners. Submissions should describe experiences that may help understanding situations in which practices or technologies are applied and their impact. Experience reports on implementing practices or technologies suggested or driven from research are especially encouraged. Experience reports should include information on the setting, provide motivation, explain the events leading to the outcomes including the challenges faced, summarize the outcomes, and conclude with lessons learned, take-away messages, and advice based on the described experience. An extensive description of related work or background material is not required. However, references to relevant research is appreciated. Accepted submissions will be invited to present their report at the conference and a summary will be included in the conference proceedings.
Experience Reports submissions should provide a 2-4 page summary of the experience.
Empirical Studies
Submissions should describe empirical studies conducted in industry, government, or community settings (e.g., action research, case studies). We encourage the submission of novel studies, replication studies, and studies with negative results (i.e., studies that did not deliver the expected results). Submissions should describe related work, provide details on the approach and methodology employed, and discuss implications of the results.
For Empirical Studies, we accept both full papers (6-10 pages) and short papers (4-6 pages).
IGC Challenge Workshop Session
This type of submission is only open to practitioners. IGC challenge submissions outline a new research challenge, arising from software practice and experience. The submission should clearly articulate the problem and motivate it in terms of its potential for industrial impact and/or its practical importance. The aim is to provide a well-defined industrially relevant problem for the research community to tackle. Submissions should include a brief background and describe a problem or area that is in need of empirical study, and a list of questions/challenges to be discussed. Accepted submissions will be given an opportunity to conduct a workshop session at the conference to discuss the problem and solicit potential collaborations. Submissions are limited to 2-pages and must use the following outline:
-
Background
Brief background of the organization and context -
Problem(s)
Description of problem or areas in need of empirical study -
Discussion Points
Bullet point list of questions, challenges, and requests. Put these in order of priority as there will be limited time in the workshop and not all discussion points will be addressed. The objective here is to stimulate interest and possible collaborations.
Submission Details
Page limits include figures, tables, appendices. One additional page may be used for references.
Submissions must include an additional section, a Lay Abstract: a 250-word summary of the paper written in plain English, intended to be read not by researchers, but by practicing software engineers or community members, who may have very little understanding of software engineering research or academic jargon. This will help make our work more accessible to the public, an important constituency and focus of our research. The Lay Abstract should come after the Abstract but before the paper’s Introduction section.
It is not required to publicly reveal data or data sources. However, submissions should provide a statement indicating the provenance of the data and its appropriate use in the study/report.
Submissions must be submitted via EasyChair by selecting the “IGC Track”. Details on how to submit and format your paper can be found at submission link.
Thu 26 OctDisplayed time zone: Central Time (US & Canada) change
13:30 - 15:05 | 2A - Software and system testingESEM Journal-First Papers / ESEM Technical Papers / Emerging Results, Vision and Reflection Papers Track / ESEM IGC at Rhythms 2 Chair(s): Davide Fucci Blekinge Institute of Technology | ||
13:30 20mFull-paper | Manual Tests Do Smell! Cataloging and Identifying Natural Language Test Smells ESEM Technical Papers Elvys Soares Federal University of Pernambuco / Federal Institute of Alagoas, Manoel Aranda III , Naelson Oliveira , Márcio Ribeiro Federal University of Alagoas, Brazil, Rohit Gheyi Federal University of Campina Grande, Emerson Paulo Soares de Souza , Ivan Machado Federal University of Bahia, Andre Santos , Baldoino Fonseca , Rodrigo Bonifácio Computer Science Department - University of Brasília Pre-print Media Attached | ||
13:50 20mFull-paper | An Empirical Study of Regression Testing for Android Apps in Continuous Integration Environment ESEM Technical Papers Dingbang Wang , Yu Zhao University of Central Missouri, Lu Xiao Stevens Institute of Technology, Tingting Yu University of Connecticut | ||
14:10 10mJournal Early-Feedback | Scripted and Scriptless GUI Testing for Web Applications: An Industrial Case ESEM Journal-First Papers Axel Bons , Beatriz Marín Universitat Politècnica de València, Pekka Aho Nordic Semiconductor, Tanja E. J. Vos | ||
14:20 15mVision and Emerging Results | Identifying Flakiness in Quantum Programs Emerging Results, Vision and Reflection Papers Track Lei Zhang , Mahsa Radnejad University of Maryland Baltimore County, Andriy Miranskyy Toronto Metropolitan University (formerly Ryerson University) | ||
14:35 15mIndustry talk | The Vocabulary of Flaky Tests in the Context of SAP HANA ESEM IGC | ||
14:50 15mIndustry talk | Comparing Mobile Testing Tools Using Documentary Analysis ESEM IGC |
Fri 27 OctDisplayed time zone: Central Time (US & Canada) change
08:30 - 10:15 | 4 - Advancement of empirical research methodsESEM Journal-First Papers / ESEM Technical Papers at Rhythms 3 Chair(s): Maleknaz Nayebi York University, Per Runeson Lund University | ||
08:30 10mJournal Early-Feedback | Applying Inter-Rater Reliability and Agreement in Collaborative Grounded Theory Studies in Software Engineering ESEM Journal-First Papers Jessica Díaz Universidad Politécnica de Madrid, Jorge Perez , Carolina Gallardo Perez , Ãngel Gonzalez-Prieto | ||
08:40 10mJournal Early-Feedback | Comparing ϕ and the F-measure as Performance Metrics for Software-related Classifications ESEM Journal-First Papers Luigi Lavazza Università degli Studi dell'Insubria, Sandro Morasca Università degli Studi dell'Insubria | ||
08:50 10mJournal Early-Feedback | Double-Counting in Software Engineering Tertiary Studies - An Overlooked Threat to Validity ESEM Journal-First Papers Jürgen Börstler Blekinge Institute of Technology, Nauman Bin Ali Blekinge Institute of Technology, Kai Petersen University of Applied Sciences Flensburg, Germany / Blekinge Institute of Technology, Sweden | ||
09:00 10mJournal Early-Feedback | Ground Truth Deficiencies in Software Engineering: When Codifying the Past can be Counterproductive ESEM Journal-First Papers Eray Tüzün Bilkent University, Hakan Erdogmus Carnegie Mellon University, Maria Teresa Baldassarre Department of Computer Science, University of Bari , Michael Felderer German Aerospace Center (DLR) & University of Cologne, Robert Feldt Chalmers University of Technology, Sweden, Burak Turhan University of Oulu | ||
09:10 10mJournal Early-Feedback | Use and Misuse of the Term Experiment in Mining Software Repositories Research ESEM Journal-First Papers Claudia Ayala Universitat Politècnica de Catalunya, Spain, Burak Turhan University of Oulu, Xavier Franch Universitat Politècnica de Catalunya, Natalia Juristo Universidad Politecnica de Madrid | ||
09:20 55mPanel | Panel Discussion on Advancement of Empirical Research Methods ESEM Technical Papers |
13:30 - 15:00 | 6A - Requirements engineering and tool selectionESEM Technical Papers / ESEM Journal-First Papers at Rhythms 2 Chair(s): Ronnie de Souza Santos University of Calgary | ||
13:30 20mFull-paper | Divide and Conquer the EmpiRE: A Community-Maintainable Knowledge Graph of Empirical Research in Requirements Engineering ESEM Technical Papers Oliver Karras TIB - Leibniz Information Centre for Science and Technology, Felix Wernlein , Jil Klünder Leibniz Universität Hannover, Sören Auer TIB - Leibniz Information Centre for Science and Technology Pre-print Media Attached | ||
13:50 20mFull-paper | What are Pros and Cons? Stance Detection and Summarization on Feature Request ESEM Technical Papers Yawen Wang Institute of Software, Chinese Academy of Sciences, Junjie Wang Institute of Software, Chinese Academy of Sciences, Hongyu Zhang Chongqing University, Kairui Wang , Qing Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences Media Attached | ||
14:10 10mJournal Early-Feedback | An Initial Theory to Understand and Manage Requirements Engineering Debt in Practice ESEM Journal-First Papers Julian Frattini Blekinge Institute of Technology, Davide Fucci Blekinge Institute of Technology, Daniel Mendez Blekinge Institute of Technology, Rodrigo Spinola Virginia Commonwealth University, Vladimir Mandić Faculty of Technical Sciences, University of Novi Sad, Nebojša Taušan INFORA Research Group doo, Muhammad Ovais Ahmad Karlstad University, Javier Gonzalez-Huerta Blekinge Institute of Technology | ||
14:20 20mFull-paper | A Comparative Study of Software Secrets Reporting by Secret Detection Tools ESEM Technical Papers Setu Kumar Basak North Carolina State University, Jamison Cox , Bradley Reaves North Carolina State University, Laurie Williams North Carolina State University Pre-print | ||
14:40 20mFull-paper | How R Developers explain their Package Choice: A Survey ESEM Technical Papers Addi Malviya-Thakur Oak Ridge National Laboratory, USA/ University of Tennessee, Knoxville, Audris Mockus The University of Tennessee, Russell Zaretzki , Bogdan Bichescu , Randy Bradley |
13:30 - 15:00 | 6B - Code quality and beyondESEM Journal-First Papers / ESEM Technical Papers at Rhythms 3 Chair(s): Valentina Lenarduzzi University of Oulu | ||
13:30 20mFull-paper | Replicability Study: Corpora For Understanding Simulink Models & Projects ESEM Technical Papers Sohil Lal Shrestha The University of Texas at Arlington, Shafiul Azam Chowdhury University of Texas at Arlington, Christoph Csallner University of Texas at Arlington Link to publication Pre-print Media Attached File Attached | ||
13:50 10mJournal Early-Feedback | A Decade of Code Comment Quality Assessment: A Systematic Literature Review ESEM Journal-First Papers Pooja Rani University of Zurich, Arianna Blasi Meta Platforms, Inc., Nataliia Stulova University of Bern, Switzerland, Sebastiano Panichella Zurich University of Applied Sciences, Alessandra Gorla IMDEA Software Institute, Oscar Nierstrasz University of Bern, Switzerland DOI Pre-print | ||
14:00 10mJournal Early-Feedback | Just-in-time Code Duplicates Extraction ESEM Journal-First Papers Eman Abdullah AlOmar Stevens Institute of Technology, Anton Ivanov HSE University, Zarina Kurbatova JetBrains Research, Yaroslav Golubev JetBrains Research, Mohamed Wiem Mkaouer Rochester Institute of Technology, Ali Ouni ETS Montreal, University of Quebec, Timofey Bryksin JetBrains Research, Le Nguyen Rochester Institute of Technology, Amit Kini Rochester Institute of Technology, Aditya Thakur Rochester Institute of Technology | ||
14:10 20mFull-paper | Beyond the Code: Investigating the Effects of Pull Request Conversations on Design Decay ESEM Technical Papers Caio Barbosa Pontifical Catholic University of Rio de Janeiro, Anderson Uchôa Federal University of Ceará, Daniel Coutinho PUC-Rio, Wesley Assunção North Carolina State University, Anderson Oliveira PUC-Rio, Alessandro Garcia PUC-Rio, Baldoino Fonseca , Matheus Feitosa de Oliveira Rabelo , José Eric Mesquita Coelho , Eryka Carvalho da Silva , Paulo Henrique Santos Marques | ||
14:30 10mJournal Early-Feedback | A Mixed-Method Approach to Recommend Corrections and Correct REST Antipatterns ESEM Journal-First Papers Fatima Sabir Punjab University College of Information Technology , University of the Punjab, Yann-Gaël Guéhéneuc Concordia University and Polytechnique Montréal, Francis Palma , Naouel Moha École de Technologie Supérieure (ETS), Ghulam Rasool , Hassan Akhtar | ||
14:40 10mJournal Early-Feedback | Tag that Issue: Applying API-domain Labels in Issue Tracking Systems ESEM Journal-First Papers Fabio Marcos De Abreu Santos Northern Arizona University, USA, Joseph Vargovich Northern Arizona University, Bianca Trinkenreich Oregon State University, USA, Italo Santos Northern Arizona University, Jacob Penney Northern Arizona University, Ricardo Britto Ericsson / Blekinge Institute of Technology, João Felipe Pimentel , Igor Wiese Federal University of Technology, Igor Steinmacher Northern Arizona University, Anita Sarma Oregon State University, Marco Gerosa Northern Arizona University | ||
14:50 10mJournal Early-Feedback | Do Names Echo Semantics? A large-scale Study of Identifiers used in C++'s Named Casts ESEM Journal-First Papers Constantin Cezar Petrescu University of Surrey, Sam Smith , Rafail Giavrimis Turing Intelligence Technology, Santanu Dash University of Surrey, UK Authorizer link |