ESEM 2023 - Technical Papers Track - Call for Papers

The International Symposium on Empirical Software Engineering and Measurement (ESEM) technical papers track features submissions that describe original, unpublished work in software engineering and software measurement, with a strong empirical foundation. Papers in this track should communicate fully developed research and related results. Strong emphasis should be given to the methodological aspects of the research and the assessment of the validity of the contributions.


Please note:


General Scope of Submissions

Submissions should not be under consideration for publication or presentation elsewhere. In addition to the specific scope of this track, submissions may address any aspect of software engineering but must tackle the problem from an empirical perspective and using a rigorous empirical method, including:

  • Empirical studies using qualitative, quantitative, and mixed methods
  • Cross- and multi-disciplinary methods and studies
  • Formal experiments and quasi-experiments
  • Case studies, action research, ethnography and field studies
  • Survey research
  • Simulation studies
  • Artifact studies
  • Data mining using statistical and machine learning approaches
  • Secondary and tertiary studies including
    • Systematic literature reviews and rapid reviews, that include a strong synthesis part
    • Meta-analyses, and qualitative, quantitative or structured syntheses of studies
  • Replication of empirical studies and families of studies

Papers should be positioned in terms of research methodology and contribution in relation to established frameworks, e.g. https://link.springer.com/article/10.1007/s10664-020-09858-z, https://dl.acm.org/doi/10.1145/3241743 or https://github.com/acmsigsoft/EmpiricalStandards.


Topics commonly addressed using an empirical approach include, but are not limited to:

  • Evaluation and comparison of software models, tools, techniques, and practices
  • Modeling, measuring, and assessing product or process quality and productivity
  • Continuous software engineering
  • Software verification and validation, including analysis and testing
  • Engineering of software systems which include machine learning components and data dependencies
  • Applications of software engineering to different types of systems and domains (e.g. IoT, Industry 4.0, Context-awareness systems, Cyber-physical systems)
  • Human factors, teamwork, and behavioral aspects of software engineering


We welcome submissions on these research meta-topics:

  • Development, evaluation, and comparison of empirical approaches and methods
  • Infrastructure for conducting empirical studies
  • Techniques and tools for supporting empirical studies
  • Empirically-based decision making


We also welcome submissions that:

  • demonstrate multi-disciplinary work,
  • transfer and apply empirical methods from other disciplines,
  • replication studies, and
  • studies with negative findings.


Important Dates

(All dates are end of the day, anywhere on earth)
Abstract 24 April 2023
Submission 2 May 2023
Notification 16 June 2023
Camera-ready 7 July 2023

Submission Link: https://easychair.org/my/conference?conf=esem2023


How to Submit

Submissions to this track are limited to 10 pages excluding references and 12 pages with references and must be submitted through EasyChair by selecting the track “Technical Papers.”

All submissions must be written in English and must be submitted via EasyChair https://easychair.org/my/conference?conf=esem2023 in the PDF format, and they must be formatted according to the standard IEEE template in conference mode (which can be found at https://www.ieee.org/conferences/publishing/templates.html) or in Overleaf at https://www.overleaf.com/gallery/tagged/ieee-official).

A structured abstract is required with the headings: Background, Aims, Method, Results, and Conclusions. Papers must contain an explicit description of the empirical strategy used or investigated. The submission must also comply with the IEEE ethics guidelines https://journals.ieeeauthorcenter.ieee.org/wp-content/uploads/IEEE-Author-Ethics-Guidelines.pdf. In particular, it must not have been published elsewhere and must not be under review elsewhere while under review for ESEM.

ESEM 2023 Technical Track will employ a double-blind review process. Thus, submissions may not reveal its authors’ identities. The authors must make an acceptable effort to honor the double-blind review process. In particular, the authors’ names must be omitted from the submission and references to their prior work should be in the third person. More details on author ethics and peer review can be found at https://conferences.ieeeauthorcenter.ieee.org/.

All submissions will be peer-reviewed by at least three experts from the international program committee of each track and will receive an additional meta-review. Any papers that are outside the scope of the symposium, exceed the maximum number of pages for the respective category, or do not follow the formatting guidelines will be desk rejected without review. The PC members’ bidding information may be used to assess what is considered out of scope.

Finally, please note that each accepted contribution must have a minimum of one author registered by the deadline for the camera-ready submission for their respective paper type. Also, each paper must be presented by one of the authors. Failure to meet these criteria will result in the paper’s removal from the proceedings.


Open Science Policy

Openness in science is key to fostering progress via transparency, reproducibility and replicability. While all submissions will undergo the same review process independent of whether or not they disclose their tools, data, and code, we expect authors to include a data availability statement in their submissions that either provides links to the open data / replication package or that explains that why data cannot be disclosed (e.g. due to the sensitivity of the data or due to existing non-disclosure agreements).

Authors who can make their data available are strongly encouraged to do so already upon submission (either privately or publicly), but they can also disclose it upon acceptance (publicly).

  • We expect authors to include a data availability statement in the submission (for instance, at the end of the introduction) explaining whether and where the data and related material is available and under which conditions the data/material can be accessed. If the authors cannot disclose industrial or otherwise non-public data, they should provide an explicit (short) explanation in the statement.
  • For submissions based on open data sources, the publication of any cleaned or filtered data is mandatory.
  • Where reasonable, we ask authors to provide elaborate explanations on how to navigate the data source and how to use it. It must be explained how the provided data, code, and tools are used in the steps of the method described in the paper. This includes:
    • Study protocols, coding and transcription schemas, and further relevant information used in qualitative studies.
    • Information to the code (incl. version information) or the data input/output relevant to every step of data cleaning and labeling, feature engineering, model training and evaluation for quantitative analysis and/or machine learning studies.

Finally, we further ask the authors to follow the FAIR principles in open science when sharing their tools, data, and code, and recommend following the principles as outlined in the book chapter “Open Science in Software Engineering” https://link.springer.com/chapter/10.1007/978-3-030-32489-6_17.


Program Co-Chairs

Maleknaz Nayebi, York University, Toronto, Canada

Per Runeson, Lund University, Sweden

Dates
Thu 26 Oct 2023
Fri 27 Oct 2023
Tracks
ESEIW ESEM
ESEIW ESEM IGC
ESEIW ESEM Journal-First Papers
ESEIW ESEM Registered Reports
ESEIW ESEM Technical Papers
ESEIW Emerging Results, Vision and Reflection Papers Track
You're viewing the program in a time zone which is different from your device's time zone change time zone

Thu 26 Oct

Displayed time zone: Central Time (US & Canada) change

10:30 - 12:15
1A - Fault correction and information seekingESEM Technical Papers at Rhythms 2
Chair(s): Andreas Jedlitschka Fraunhofer IESE
10:30
20m
Full-paper
What Do Infrastructure-as-Code Practitioners Discuss: An Empirical Study on Stack Overflow
ESEM Technical Papers
Mahi Begoug , Narjes Bessghaier ETS Montreal, University of Quebec, Ali Ouni ETS Montreal, University of Quebec, Eman Abdullah AlOmar Stevens Institute of Technology, Mohamed Wiem Mkaouer Rochester Institute of Technology
10:50
20m
Full-paper
All For One and One For All: investigating how Global Game Jam participants seek and get help
ESEM Technical Papers
11:10
20m
Full-paper
Leveraging Evidence Theory to Improve Fault Localization: An Exploratory Study
ESEM Technical Papers
Yueke Zhang , Kevin Leach Vanderbilt University, Yu Huang Vanderbilt University
11:30
20m
Full-paper
Investigating the Impact of Bug Dependencies on Bug-fixing Time Prediction
ESEM Technical Papers
Chenglin Li , Yangyang Zhao Zhejiang Sci-Tech University, Yibiao Yang Nanjing University, Yuming Zhou Nanjing University, Liming Nie , Zuohua Ding
Media Attached
11:50
20m
Full-paper
Understanding Resolution of Multi-Language Bugs: An Empirical Study on Apache Projects
ESEM Technical Papers
Zengyang Li Central China Normal University, Wenshuo Wang Central China Normal University, Sicheng Wang Central China Normal University, Peng Liang Wuhan University, China, Ran Mo Central China Normal University
Link to publication Pre-print Media Attached
10:30 - 12:15
1B - Machine learning in SEESEM Technical Papers / ESEM Journal-First Papers / ESEM IGC at Rhythms 3
Chair(s): Davide Taibi University of Oulu
10:30
20m
Full-paper
What is the Carbon Footprint of ML Models on Hugging Face? A Repository Mining Study
ESEM Technical Papers
Joel Castaño Fernández Universitat Politècnica de Catalunya (UPC), Silverio Martínez-Fernández UPC-BarcelonaTech, Xavier Franch Universitat Politècnica de Catalunya, Justus Bogner Vrije Universiteit Amsterdam
Link to publication Pre-print
10:50
20m
Full-paper
An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Code
ESEM Technical Papers
Max Hort Simula Research Laboratory, Anastasiia Grishina Simula Research Laboratory, Leon Moonen Simula Research Laboratory and BI Norwegian Business School
Pre-print Media Attached
11:10
20m
Full-paper
An Empirical Study on Low- and High-Level Explanations of Deep Learning Misbehaviours
ESEM Technical Papers
Tahereh Zohdinasab USI Lugano, Vincenzo Riccio University of Udine, Paolo Tonella USI Lugano
11:30
20m
Full-paper
Assessing the Use of AutoML for Data-Driven Software Engineering
ESEM Technical Papers
Fabio Calefato University of Bari, Luigi Quaranta University of Bari, Italy, Filippo Lanubile University of Bari, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio)
Pre-print
13:30 - 15:05
2A - Software and system testingESEM Journal-First Papers / ESEM Technical Papers / Emerging Results, Vision and Reflection Papers Track / ESEM IGC at Rhythms 2
Chair(s): Davide Fucci Blekinge Institute of Technology
13:30
20m
Full-paper
Manual Tests Do Smell! Cataloging and Identifying Natural Language Test Smells
ESEM Technical Papers
Elvys Soares Federal University of Pernambuco / Federal Institute of Alagoas, Manoel Aranda III , Naelson Oliveira , Márcio Ribeiro Federal University of Alagoas, Brazil, Rohit Gheyi Federal University of Campina Grande, Emerson Paulo Soares de Souza , Ivan Machado Federal University of Bahia, Andre Santos , Baldoino Fonseca , Rodrigo Bonifácio Computer Science Department - University of Brasília
Pre-print Media Attached
13:50
20m
Full-paper
An Empirical Study of Regression Testing for Android Apps in Continuous Integration Environment
ESEM Technical Papers
Dingbang Wang , Yu Zhao University of Central Missouri, Lu Xiao Stevens Institute of Technology, Tingting Yu University of Connecticut
13:30 - 15:05
13:30
20m
Full-paper
Experienced Challenges of Adopting Scaling Frameworks
ESEM Technical Papers
Irina Safonova , Maria Paasivaara LUT University, Finland & Aalto University, Finland, Casper Lassenius Aalto University, Finland and Simula Metropolitan Center for Digital Engineering, Norway, Ömer Uludag Technical University of Munich, Abheeshta Putta
15:30 - 17:00
3B - Software managementESEM Journal-First Papers / ESEM Technical Papers at Rhythms 3
Chair(s): Rashina Hoda Monash University
15:30
20m
Full-paper
Whistleblowing in the Software Industry: a Survey
ESEM Technical Papers
Stefan Reijenga , Kousar Aslam , Emitzá Guzmán Vrije Universiteit Amsterdam
15:50
20m
Full-paper
On the Impact and Lessons Learned from Mindfulness Practice in a Real-world Software Company
ESEM Technical Papers

Fri 27 Oct

Displayed time zone: Central Time (US & Canada) change

08:30 - 10:15
4 - Advancement of empirical research methodsESEM Journal-First Papers / ESEM Technical Papers at Rhythms 3
Chair(s): Maleknaz Nayebi York University, Per Runeson Lund University
09:20
55m
Panel
Panel Discussion on Advancement of Empirical Research Methods
ESEM Technical Papers

10:40 - 12:15
10:40
20m
Full-paper
ToxiSpanSE: An Explainable Toxicity Detection in Code Review Comments
ESEM Technical Papers
Jaydeb Sarker Department of Computer Science, Wayne State University, Sayma Sultana Wayne State University, Steven Wilson , Amiangshu Bosu Wayne State University
Pre-print Media Attached
11:00
20m
Full-paper
Towards Automated Classification of Code Review Feedback to Support Analytics
ESEM Technical Papers
Asif Kamal Turzo Wayne State University, Fahim Faysal , Ovi Poddar , Jaydeb Sarker Department of Computer Science, Wayne State University, Anindya Iqbal Bangladesh University of Engineering and Technology Dhaka, Bangladesh, Amiangshu Bosu Wayne State University
Pre-print Media Attached
11:20
20m
Full-paper
Security Defect Detection via Code Review: A Study of the OpenStack and Qt Communities
ESEM Technical Papers
Jiaxin Yu , Liming Fu Wuhan University, Peng Liang Wuhan University, China, Amjed Tahir Massey University, Mojtaba Shahin RMIT University, Australia
Link to publication Pre-print Media Attached
10:40 - 12:15
5B - SecurityEmerging Results, Vision and Reflection Papers Track / ESEM Technical Papers / ESEM IGC at Rhythms 3
Chair(s): Oliver Karras TIB - Leibniz Information Centre for Science and Technology
10:40
20m
Full-paper
Exploring Technical Debt in Security Questions on Stack Overflow
ESEM Technical Papers
Joshua Aldrich Edbert University of Saskatchewan, Sahrima Jannat Oishwee University of Saskatchewan, Shubhashis Karmakar , Zadia Codabux University of Saskatchewan, Roberto Verdecchia University of Florence
Link to publication DOI Pre-print
11:00
20m
Full-paper
Personalized Guidelines for Design, Implementation and Evaluation of Anti-phishing Interventions
ESEM Technical Papers
Orvila Sarker , Sherif Haggag The University of Adelaide, Asangi Jayatilaka University of Adelaide, Chelsea Liu
13:30 - 15:00
6A - Requirements engineering and tool selectionESEM Technical Papers / ESEM Journal-First Papers at Rhythms 2
Chair(s): Ronnie de Souza Santos University of Calgary
13:30
20m
Full-paper
Divide and Conquer the EmpiRE: A Community-Maintainable Knowledge Graph of Empirical Research in Requirements Engineering
ESEM Technical Papers
Oliver Karras TIB - Leibniz Information Centre for Science and Technology, Felix Wernlein , Jil Klünder Leibniz Universität Hannover, Sören Auer TIB - Leibniz Information Centre for Science and Technology
Pre-print Media Attached
13:50
20m
Full-paper
What are Pros and Cons? Stance Detection and Summarization on Feature Request
ESEM Technical Papers
Yawen Wang Institute of Software, Chinese Academy of Sciences, Junjie Wang Institute of Software, Chinese Academy of Sciences, Hongyu Zhang Chongqing University, Kairui Wang , Qing Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences
Media Attached
14:20
20m
Full-paper
A Comparative Study of Software Secrets Reporting by Secret Detection Tools
ESEM Technical Papers
Setu Kumar Basak North Carolina State University, Jamison Cox , Bradley Reaves North Carolina State University, Laurie Williams North Carolina State University
Pre-print
14:40
20m
Full-paper
How R Developers explain their Package Choice: A Survey
ESEM Technical Papers
Addi Malviya-Thakur Oak Ridge National Laboratory, USA/ University of Tennessee, Knoxville, Audris Mockus The University of Tennessee, Russell Zaretzki , Bogdan Bichescu , Randy Bradley
13:30 - 15:00
6B - Code quality and beyondESEM Journal-First Papers / ESEM Technical Papers at Rhythms 3
Chair(s): Valentina Lenarduzzi University of Oulu
13:30
20m
Full-paper
Replicability Study: Corpora For Understanding Simulink Models & Projects
ESEM Technical Papers
Sohil Lal Shrestha The University of Texas at Arlington, Shafiul Azam Chowdhury University of Texas at Arlington, Christoph Csallner University of Texas at Arlington
Link to publication Pre-print Media Attached File Attached
14:10
20m
Full-paper
Beyond the Code: Investigating the Effects of Pull Request Conversations on Design Decay
ESEM Technical Papers
Caio Barbosa Pontifical Catholic University of Rio de Janeiro, Anderson Uchôa Federal University of Ceará, Daniel Coutinho PUC-Rio, Wesley Assunção North Carolina State University, Anderson Oliveira PUC-Rio, Alessandro Garcia PUC-Rio, Baldoino Fonseca , Matheus Feitosa de Oliveira Rabelo , José Eric Mesquita Coelho , Eryka Carvalho da Silva , Paulo Henrique Santos Marques

Accepted Papers

Title
A Comparative Study of Software Secrets Reporting by Secret Detection Tools
ESEM Technical Papers
Pre-print
All For One and One For All: investigating how Global Game Jam participants seek and get help
ESEM Technical Papers
An Empirical Study of Regression Testing for Android Apps in Continuous Integration Environment
ESEM Technical Papers
An Empirical Study on Low- and High-Level Explanations of Deep Learning Misbehaviours
ESEM Technical Papers
An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Code
ESEM Technical Papers
Pre-print Media Attached
Assessing the Use of AutoML for Data-Driven Software Engineering
ESEM Technical Papers
Pre-print
Beyond the Code: Investigating the Effects of Pull Request Conversations on Design Decay
ESEM Technical Papers
Divide and Conquer the EmpiRE: A Community-Maintainable Knowledge Graph of Empirical Research in Requirements Engineering
ESEM Technical Papers
Pre-print Media Attached
Experienced Challenges of Adopting Scaling Frameworks
ESEM Technical Papers
Exploring Technical Debt in Security Questions on Stack Overflow
ESEM Technical Papers
Link to publication DOI Pre-print
How R Developers explain their Package Choice: A Survey
ESEM Technical Papers
Investigating the Impact of Bug Dependencies on Bug-fixing Time Prediction
ESEM Technical Papers
Media Attached
Leveraging Evidence Theory to Improve Fault Localization: An Exploratory Study
ESEM Technical Papers
Manual Tests Do Smell! Cataloging and Identifying Natural Language Test Smells
ESEM Technical Papers
Pre-print Media Attached
On the Impact and Lessons Learned from Mindfulness Practice in a Real-world Software Company
ESEM Technical Papers
Personalized Guidelines for Design, Implementation and Evaluation of Anti-phishing Interventions
ESEM Technical Papers
Replicability Study: Corpora For Understanding Simulink Models & Projects
ESEM Technical Papers
Link to publication Pre-print Media Attached File Attached
Security Defect Detection via Code Review: A Study of the OpenStack and Qt Communities
ESEM Technical Papers
Link to publication Pre-print Media Attached
Towards Automated Classification of Code Review Feedback to Support Analytics
ESEM Technical Papers
Pre-print Media Attached
ToxiSpanSE: An Explainable Toxicity Detection in Code Review Comments
ESEM Technical Papers
Pre-print Media Attached
Understanding Resolution of Multi-Language Bugs: An Empirical Study on Apache Projects
ESEM Technical Papers
Link to publication Pre-print Media Attached
What are Pros and Cons? Stance Detection and Summarization on Feature Request
ESEM Technical Papers
Media Attached
What Do Infrastructure-as-Code Practitioners Discuss: An Empirical Study on Stack Overflow
ESEM Technical Papers
What is the Carbon Footprint of ML Models on Hugging Face? A Repository Mining Study
ESEM Technical Papers
Link to publication Pre-print
Whistleblowing in the Software Industry: a Survey
ESEM Technical Papers
:
: