ESEM Technical Papers TrackESEIW 2023
ESEM 2023 - Technical Papers Track - Call for Papers
The International Symposium on Empirical Software Engineering and Measurement (ESEM) technical papers track features submissions that describe original, unpublished work in software engineering and software measurement, with a strong empirical foundation. Papers in this track should communicate fully developed research and related results. Strong emphasis should be given to the methodological aspects of the research and the assessment of the validity of the contributions.
Please note:
- Make sure the paper follows the standard IEEE template in conference mode (see https://www.ieee.org/conferences/publishing/templates.html).
- Make sure your paper follows the double-blind instructions and does not reveal the authors’ identities.
General Scope of Submissions
Submissions should not be under consideration for publication or presentation elsewhere. In addition to the specific scope of this track, submissions may address any aspect of software engineering but must tackle the problem from an empirical perspective and using a rigorous empirical method, including:
- Empirical studies using qualitative, quantitative, and mixed methods
- Cross- and multi-disciplinary methods and studies
- Formal experiments and quasi-experiments
- Case studies, action research, ethnography and field studies
- Survey research
- Simulation studies
- Artifact studies
- Data mining using statistical and machine learning approaches
- Secondary and tertiary studies including
- Systematic literature reviews and rapid reviews, that include a strong synthesis part
- Meta-analyses, and qualitative, quantitative or structured syntheses of studies
- Replication of empirical studies and families of studies
Papers should be positioned in terms of research methodology and contribution in relation to established frameworks, e.g. https://link.springer.com/article/10.1007/s10664-020-09858-z, https://dl.acm.org/doi/10.1145/3241743 or https://github.com/acmsigsoft/EmpiricalStandards.
Topics commonly addressed using an empirical approach include, but are not limited to:
- Evaluation and comparison of software models, tools, techniques, and practices
- Modeling, measuring, and assessing product or process quality and productivity
- Continuous software engineering
- Software verification and validation, including analysis and testing
- Engineering of software systems which include machine learning components and data dependencies
- Applications of software engineering to different types of systems and domains (e.g. IoT, Industry 4.0, Context-awareness systems, Cyber-physical systems)
- Human factors, teamwork, and behavioral aspects of software engineering
We welcome submissions on these research meta-topics:
- Development, evaluation, and comparison of empirical approaches and methods
- Infrastructure for conducting empirical studies
- Techniques and tools for supporting empirical studies
- Empirically-based decision making
We also welcome submissions that:
- demonstrate multi-disciplinary work,
- transfer and apply empirical methods from other disciplines,
- replication studies, and
- studies with negative findings.
Important Dates
(All dates are end of the day, anywhere on earth)
Abstract 24 April 2023
Submission 2 May 2023
Notification 16 June 2023
Camera-ready 7 July 2023
Submission Link: https://easychair.org/my/conference?conf=esem2023
How to Submit
Submissions to this track are limited to 10 pages excluding references and 12 pages with references and must be submitted through EasyChair by selecting the track “Technical Papers.”
All submissions must be written in English and must be submitted via EasyChair https://easychair.org/my/conference?conf=esem2023 in the PDF format, and they must be formatted according to the standard IEEE template in conference mode (which can be found at https://www.ieee.org/conferences/publishing/templates.html) or in Overleaf at https://www.overleaf.com/gallery/tagged/ieee-official).
A structured abstract is required with the headings: Background, Aims, Method, Results, and Conclusions. Papers must contain an explicit description of the empirical strategy used or investigated. The submission must also comply with the IEEE ethics guidelines https://journals.ieeeauthorcenter.ieee.org/wp-content/uploads/IEEE-Author-Ethics-Guidelines.pdf. In particular, it must not have been published elsewhere and must not be under review elsewhere while under review for ESEM.
ESEM 2023 Technical Track will employ a double-blind review process. Thus, submissions may not reveal its authors’ identities. The authors must make an acceptable effort to honor the double-blind review process. In particular, the authors’ names must be omitted from the submission and references to their prior work should be in the third person. More details on author ethics and peer review can be found at https://conferences.ieeeauthorcenter.ieee.org/.
All submissions will be peer-reviewed by at least three experts from the international program committee of each track and will receive an additional meta-review. Any papers that are outside the scope of the symposium, exceed the maximum number of pages for the respective category, or do not follow the formatting guidelines will be desk rejected without review. The PC members’ bidding information may be used to assess what is considered out of scope.
Finally, please note that each accepted contribution must have a minimum of one author registered by the deadline for the camera-ready submission for their respective paper type. Also, each paper must be presented by one of the authors. Failure to meet these criteria will result in the paper’s removal from the proceedings.
Open Science Policy
Openness in science is key to fostering progress via transparency, reproducibility and replicability. While all submissions will undergo the same review process independent of whether or not they disclose their tools, data, and code, we expect authors to include a data availability statement in their submissions that either provides links to the open data / replication package or that explains that why data cannot be disclosed (e.g. due to the sensitivity of the data or due to existing non-disclosure agreements).
Authors who can make their data available are strongly encouraged to do so already upon submission (either privately or publicly), but they can also disclose it upon acceptance (publicly).
- We expect authors to include a data availability statement in the submission (for instance, at the end of the introduction) explaining whether and where the data and related material is available and under which conditions the data/material can be accessed. If the authors cannot disclose industrial or otherwise non-public data, they should provide an explicit (short) explanation in the statement.
- For submissions based on open data sources, the publication of any cleaned or filtered data is mandatory.
- Where reasonable, we ask authors to provide elaborate explanations on how to navigate the data source and how to use it. It must be explained how the provided data, code, and tools are used in the steps of the method described in the paper. This includes:
- Study protocols, coding and transcription schemas, and further relevant information used in qualitative studies.
- Information to the code (incl. version information) or the data input/output relevant to every step of data cleaning and labeling, feature engineering, model training and evaluation for quantitative analysis and/or machine learning studies.
Finally, we further ask the authors to follow the FAIR principles in open science when sharing their tools, data, and code, and recommend following the principles as outlined in the book chapter “Open Science in Software Engineering” https://link.springer.com/chapter/10.1007/978-3-030-32489-6_17.
Program Co-Chairs
Maleknaz Nayebi, York University, Toronto, Canada
Per Runeson, Lund University, Sweden
Thu 26 OctDisplayed time zone: Central Time (US & Canada) change
13:30 - 15:05 | 2A - Software and system testingESEM Journal-First Papers / ESEM Technical Papers / Emerging Results, Vision and Reflection Papers Track / ESEM IGC at Rhythms 2 Chair(s): Davide Fucci Blekinge Institute of Technology | ||
13:30 20mFull-paper | Manual Tests Do Smell! Cataloging and Identifying Natural Language Test Smells ESEM Technical Papers Elvys Soares Federal University of Pernambuco / Federal Institute of Alagoas, Manoel Aranda III , Naelson Oliveira , Márcio Ribeiro Federal University of Alagoas, Brazil, Rohit Gheyi Federal University of Campina Grande, Emerson Paulo Soares de Souza , Ivan Machado Federal University of Bahia, Andre Santos , Baldoino Fonseca , Rodrigo Bonifácio Computer Science Department - University of Brasília Pre-print Media Attached | ||
13:50 20mFull-paper | An Empirical Study of Regression Testing for Android Apps in Continuous Integration Environment ESEM Technical Papers Dingbang Wang , Yu Zhao University of Central Missouri, Lu Xiao Stevens Institute of Technology, Tingting Yu University of Connecticut |
13:30 - 15:05 | 2B - Agile software engineeringEmerging Results, Vision and Reflection Papers Track / ESEM Technical Papers / ESEM Journal-First Papers / ESEM IGC at Rhythms 3 Chair(s): Silverio Martínez-Fernández UPC-BarcelonaTech | ||
13:30 20mFull-paper | Experienced Challenges of Adopting Scaling Frameworks ESEM Technical Papers Irina Safonova , Maria Paasivaara LUT University, Finland & Aalto University, Finland, Casper Lassenius Aalto University, Finland and Simula Metropolitan Center for Digital Engineering, Norway, Ömer Uludag Technical University of Munich, Abheeshta Putta |
15:30 - 17:00 | 3B - Software managementESEM Journal-First Papers / ESEM Technical Papers at Rhythms 3 Chair(s): Rashina Hoda Monash University | ||
15:30 20mFull-paper | Whistleblowing in the Software Industry: a Survey ESEM Technical Papers | ||
15:50 20mFull-paper | On the Impact and Lessons Learned from Mindfulness Practice in a Real-world Software Company ESEM Technical Papers Beatriz Bernárdez Universidad de Sevilla, José Antonio Parejo Maestre , Margarita Cruz Risco , Salvador Muñoz Hermoso , Antonio Ruiz-Cortés University of Seville |
Fri 27 OctDisplayed time zone: Central Time (US & Canada) change
08:30 - 10:15 | 4 - Advancement of empirical research methodsESEM Journal-First Papers / ESEM Technical Papers at Rhythms 3 Chair(s): Maleknaz Nayebi York University, Per Runeson Lund University | ||
09:20 55mPanel | Panel Discussion on Advancement of Empirical Research Methods ESEM Technical Papers |
10:40 - 12:15 | 5B - SecurityEmerging Results, Vision and Reflection Papers Track / ESEM Technical Papers / ESEM IGC at Rhythms 3 Chair(s): Oliver Karras TIB - Leibniz Information Centre for Science and Technology | ||
10:40 20mFull-paper | Exploring Technical Debt in Security Questions on Stack Overflow ESEM Technical Papers Joshua Aldrich Edbert University of Saskatchewan, Sahrima Jannat Oishwee University of Saskatchewan, Shubhashis Karmakar , Zadia Codabux University of Saskatchewan, Roberto Verdecchia University of Florence Link to publication DOI Pre-print | ||
11:00 20mFull-paper | Personalized Guidelines for Design, Implementation and Evaluation of Anti-phishing Interventions ESEM Technical Papers Orvila Sarker , Sherif Haggag The University of Adelaide, Asangi Jayatilaka University of Adelaide, Chelsea Liu |
13:30 - 15:00 | 6A - Requirements engineering and tool selectionESEM Technical Papers / ESEM Journal-First Papers at Rhythms 2 Chair(s): Ronnie de Souza Santos University of Calgary | ||
13:30 20mFull-paper | Divide and Conquer the EmpiRE: A Community-Maintainable Knowledge Graph of Empirical Research in Requirements Engineering ESEM Technical Papers Oliver Karras TIB - Leibniz Information Centre for Science and Technology, Felix Wernlein , Jil Klünder Leibniz Universität Hannover, Sören Auer TIB - Leibniz Information Centre for Science and Technology Pre-print Media Attached | ||
13:50 20mFull-paper | What are Pros and Cons? Stance Detection and Summarization on Feature Request ESEM Technical Papers Yawen Wang Institute of Software, Chinese Academy of Sciences, Junjie Wang Institute of Software, Chinese Academy of Sciences, Hongyu Zhang Chongqing University, Kairui Wang , Qing Wang Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences Media Attached | ||
14:20 20mFull-paper | A Comparative Study of Software Secrets Reporting by Secret Detection Tools ESEM Technical Papers Setu Kumar Basak North Carolina State University, Jamison Cox , Bradley Reaves North Carolina State University, Laurie Williams North Carolina State University Pre-print | ||
14:40 20mFull-paper | How R Developers explain their Package Choice: A Survey ESEM Technical Papers Addi Malviya-Thakur Oak Ridge National Laboratory, USA/ University of Tennessee, Knoxville, Audris Mockus The University of Tennessee, Russell Zaretzki , Bogdan Bichescu , Randy Bradley |
13:30 - 15:00 | 6B - Code quality and beyondESEM Journal-First Papers / ESEM Technical Papers at Rhythms 3 Chair(s): Valentina Lenarduzzi University of Oulu | ||
13:30 20mFull-paper | Replicability Study: Corpora For Understanding Simulink Models & Projects ESEM Technical Papers Sohil Lal Shrestha The University of Texas at Arlington, Shafiul Azam Chowdhury University of Texas at Arlington, Christoph Csallner University of Texas at Arlington Link to publication Pre-print Media Attached File Attached | ||
14:10 20mFull-paper | Beyond the Code: Investigating the Effects of Pull Request Conversations on Design Decay ESEM Technical Papers Caio Barbosa Pontifical Catholic University of Rio de Janeiro, Anderson Uchôa Federal University of Ceará, Daniel Coutinho PUC-Rio, Wesley Assunção North Carolina State University, Anderson Oliveira PUC-Rio, Alessandro Garcia PUC-Rio, Baldoino Fonseca , Matheus Feitosa de Oliveira Rabelo , José Eric Mesquita Coelho , Eryka Carvalho da Silva , Paulo Henrique Santos Marques |