Write a Blog >>
ESEM 2021
Mon 11 - Fri 15 October 2021

These papers should promote current work in progress on research and practice and should clearly state the longer-term objectives and planned work. Papers on emerging results should communicate initial research results for which there is not yet a complete evaluation. The primary purpose of such papers is the communication of new ideas to obtain early feedback from the empirical software engineering community. The track also welcomes vision papers which will be on long-term challenges and opportunities in empirical software engineering research that are outside of current mainstream topics of the field. The goal of vision papers is to describe how empirical software engineering research and practice will look at least ten years from now.

General Scope of Submissions

Submissions should not be under consideration for publication or presentation elsewhere.

In addition to the specific scope of this track, submissions may address any aspect of software engineering but must tackle the problem from an empirical perspective and using a rigorous empirical method, including:

  • Empirical studies using qualitative, quantitative, and mixed methods
  • Cross- and multi-disciplinary methods and studies
  • Experiments and quasi-experiments
  • Case studies, action research, ethnography and field studies
  • Survey research
  • Simulation
  • Artifact studies
  • Data mining, machine learning, and AI-based approaches
  • Secondary and tertiary studies including
    • Systematic literature reviews and rapid reviews that include a strong synthesis part
    • Meta-analyses, and qualitative, quantitative or structured syntheses of studies
  • Replication of empirical studies and families of studies

Topics commonly addressed using an empirical approach include, but are not limited to:

  • Evaluation and comparison of software technologies
  • Evaluation and comparison of software development methods, techniques, and practices
  • Modeling, measuring, and assessing product and/or process quality
  • Modeling, measuring, and assessing software development productivity
  • Defect and quality prediction
  • Software cost and size estimation
  • Software evolution
  • Software verification and validation, including analysis and testing
  • Evaluation and modeling of contemporary software systems (IoT, Industry 4.0, Context–
  • Awareness Systems, Cyber-physical, among others)
  • Human factors, teamwork, and behavioral aspects of software engineering

We welcome submissions on these meta-topics:

  • Development, evaluation, and comparison of empirical approaches and methods
  • Infrastructure for conducting empirical studies
  • Techniques and tools for supporting empirical studies
  • Empirically-based decision making

We also welcome submissions that:

  • demonstrate multi-disciplinary work,
  • transfer and apply empirical methods from other disciplines,
  • replication studies, and
  • studies with negative findings.

Open Science Policy

Openness in science is key to fostering progress via transparency, reproducibility and replicability. While all submissions will undergo the same review process independent of whether or not they disclose their analysis code or data, we strongly encourage authors to make data available upon submission (either privately or publicly) and especially upon acceptance (publicly). If the authors cannot disclose industrial or otherwise non-public data, they should provide an explicit (short) statement in the paper.

Dates
Tue 12 Oct 2021
Wed 13 Oct 2021
Thu 14 Oct 2021
Tracks
ESEM Emerging Results and Vision papers
ESEM Journal-first Papers
ESEM Technical Papers
You're viewing the program in a time zone which is different from your device's time zone change time zone

Tue 12 Oct

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:20 - 15:15
Testing & Security 1Technical Papers / Emerging Results and Vision papers at ESEM ROOM
Chair(s): Davide Fucci Blekinge Institute of Technology
15:05
10m
Talk
Why Some Bug-bounty Vulnerability Reports are Invalid?
Emerging Results and Vision papers
Saman Shafigh University of New South Wales, Boualem Benatallah University of New South Wales, Carlos Rodriguez University of New South Wales, Mortada Al-Banna University of New South Wales
15:30 - 16:35
Testing & Security 2Technical Papers / Emerging Results and Vision papers at ESEM ROOM
Chair(s): Davide Fucci Blekinge Institute of Technology
16:15
10m
Talk
Python Crypto Misuses in the Wild
Emerging Results and Vision papers
Anna-Katharina Wickert TU Darmstadt, Germany, Lars Baumgärtner TU Darmstadt, Florian Breitfelder TU Darmstadt, Mira Mezini TU Darmstadt, Germany
Pre-print Media Attached
16:25
10m
Talk
Web Application Testing: Using Tree Kernels to Detect Near-duplicate States in Automated Model Inference
Emerging Results and Vision papers
Anna Corazza Università degli Studi di Napoli Federico II, Sergio Di Martino Università degli Studi di Napoli Federico II, Adriano Peron Università degli Studi di Napoli Federico II, Luigi Libero Lucio Starace Università degli Studi di Napoli Federico II
Pre-print Media Attached

Wed 13 Oct

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

13:00 - 14:10
Research MethodsEmerging Results and Vision papers / Technical Papers / Journal-first Papers at ESEM ROOM
Chair(s): Tayana Conte Universidade Federal do Amazonas
13:30
10m
Talk
Towards a Methodology for Participant Selection in Software Engineering Experiments. A Vision of the Future
Emerging Results and Vision papers
Valentina Lenarduzzi LUT University, Oscar Dieste Universidad Politécnica de Madrid, Davide Fucci Blekinge Institute of Technology, Sira Vegas Universidad Politecnica de Madrid
Pre-print Media Attached
13:40
10m
Talk
Important Experimentation Characteristics: An Expert Survey
Emerging Results and Vision papers
Florian Auer University of Innsbruck, Michael Felderer University of Innsbruck
13:50
10m
Talk
Inclusion and Exclusion Criteria in Software Engineering Tertiary Studies: A Systematic Mapping and Emerging Framework
Emerging Results and Vision papers
Dolors Costal Universitat Politècnica de Catalunya, Carles Farré Universitat Politècnica de Catalunya, Xavier Franch Universitat Politècnica de Catalunya, Carme Quer Universitat Politècnica de Catalunya
14:00
10m
Talk
Towards Sustainability of Systematic Literature Reviews
Emerging Results and Vision papers
Vinicius Santos University of São Paulo (ICMC/USP), São Carlos - SP, Anderson Y. Iwazaki University of São Paulo (ICMC/USP), São Carlos - SP, Katia Felizardo Federal Technological University of Paraná, Érica F. Souza Federal Technological University of Paraná, Cornélio Procópio - PR, Elisa Yumi Nakagawa University of São Paulo
14:20 - 15:15
Testing & Security 3Emerging Results and Vision papers / Journal-first Papers / Technical Papers at ESEM ROOM
Chair(s): Robert Feldt Chalmers University of Technology, Sweden
15:05
10m
Talk
Contextual Understanding and Improvement of Metamorphic Testing in Scientific Software Development
Emerging Results and Vision papers
Zedong Peng University of Cincinnati, Upulee Kanewala University of North Florida, Nan Niu University of Cincinnati
15:30 - 16:25
Development Approaches and RequirementsTechnical Papers / Emerging Results and Vision papers at ESEM ROOM
Chair(s): Robert Feldt Chalmers University of Technology, Sweden
16:15
10m
Talk
Vision for an Artefact-based Approach to Regulatory Requirements Engineering
Emerging Results and Vision papers
Oleksandr Kosenkov fortiss GmbH, Michael Unterkalmsteiner Blekinge Institute of Technology, Daniel Mendez Blekinge Institute of Technology, Davide Fucci Blekinge Institute of Technology

Thu 14 Oct

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

13:00 - 14:05
Software Architecture and DesignTechnical Papers / Emerging Results and Vision papers at ESEM ROOM
Chair(s): Davide Taibi Tampere University
13:45
10m
Talk
Study of the Utility Of Text Classification Based Software Architecture Recovery Method RELAX for Maintenance
Emerging Results and Vision papers
Daniel Link University of Southern California, Kamonphop Srisopha University of Southern California, USA, Barry Boehm University of Southern California
Media Attached
13:55
10m
Talk
Semantic Slicing of Architectural Change Commits: Towards Semantic Design Review
Emerging Results and Vision papers
Amit Kumar Mondal University of Saskatchewan, Chanchal K. Roy University of Saskatchewan, Kevin Schneider University of Saskatchewan, Banani Roy University of Saskatchewan, Sristy Sumana Nath University of Saskatchewan
14:20 - 15:15
Development Approaches, Requirements & Behavioral Software EngineeringTechnical Papers / Journal-first Papers / Emerging Results and Vision papers at ESEM ROOM
Chair(s): Valentina Lenarduzzi LUT University
15:05
10m
Talk
A Rubric to Identify Misogynistic and Sexist Texts from Software Developer Communications
Emerging Results and Vision papers
Sayma Sultana Wayne State University, Jaydeb Sarker Department of Computer Science, Wayne State University, Amiangshu Bosu Wayne State University

Accepted Papers

Title
A Rubric to Identify Misogynistic and Sexist Texts from Software Developer Communications
Emerging Results and Vision papers
Contextual Understanding and Improvement of Metamorphic Testing in Scientific Software Development
Emerging Results and Vision papers
Important Experimentation Characteristics: An Expert Survey
Emerging Results and Vision papers
Inclusion and Exclusion Criteria in Software Engineering Tertiary Studies: A Systematic Mapping and Emerging Framework
Emerging Results and Vision papers
Python Crypto Misuses in the Wild
Emerging Results and Vision papers
Pre-print Media Attached
Semantic Slicing of Architectural Change Commits: Towards Semantic Design Review
Emerging Results and Vision papers
Study of the Utility Of Text Classification Based Software Architecture Recovery Method RELAX for Maintenance
Emerging Results and Vision papers
Media Attached
Towards a Methodology for Participant Selection in Software Engineering Experiments. A Vision of the Future
Emerging Results and Vision papers
Pre-print Media Attached
Towards Sustainability of Systematic Literature Reviews
Emerging Results and Vision papers
Vision for an Artefact-based Approach to Regulatory Requirements Engineering
Emerging Results and Vision papers
Web Application Testing: Using Tree Kernels to Detect Near-duplicate States in Automated Model Inference
Emerging Results and Vision papers
Pre-print Media Attached
Why Some Bug-bounty Vulnerability Reports are Invalid?
Emerging Results and Vision papers

How to Submit

Submissions to this track are limited to 6 pages and must be submitted through EasyChair by selecting the track “Emerging Results and Vision Papers.”

All submissions must be written in English and must be submitted via EasyChair (https://easychair.org/conferences/?conf=esem2021) in the PDF format, and they must be formatted according to the ACM proceedings template, which can be found at ACM Proceedings Template (https://www.acm.org/publications/proceedings-template).

A structured abstract is required with the headings: Background, Aims, Method, Results, and Conclusions. Papers should contain an explicit description of the empirical strategy used or investigated. The submission must also comply with the ACM plagiarism policy and procedures (http://www.acm.org/publications/policies/plagiarism_policy). In particular, it must not have been published elsewhere and must not be under review elsewhere while under review for ESEM. The submission must also comply with the IEEE Policy on Authorship (http://ieeeauthorcenter.ieee.org/publish-with-ieee/publishing-ethics/).

ESEM 2021 will employ a double-blind review process (except for Journal-First papers and Industry Talks). Thus, regular submissions may not reveal its authors’ identities. The authors must make every effort to honor the double-blind review process. In particular, the authors’ names must be omitted from the submission and references to their prior work should be in the third person. Further advice, guidance, and explanation about the double-blind review process can be found on the conference website.

All submissions will be peer-reviewed by at least three experts from the international program committee of each track and will receive an additional meta-review. Any papers that are outside the scope of the symposium, exceed the maximum number of pages for the respective category, or do not follow the formatting guidelines will be desk rejected without review. ​

Finally, please note that each accepted contribution must have a minimum of one author registered (at the full conference rate) by the deadline for the camera-ready submission for their respective paper type. Also, each paper must be presented by one of the authors. Failure to meet these criteria will result in the paper’s removal from the proceedings.

:
: