ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal

The New Ideas and Emerging Results (NIER) track at ICSE provides a vibrant forum for forward-looking, innovative research in software engineering. Our aim is to accelerate the exposure of the software engineering community to early yet potentially ground-breaking research results, and to techniques and perspectives that challenge the status quo in the discipline. To broadly capture this goal, NIER 2024 will publish the following types of papers.

  • Forward-looking ideas: exciting new directions or techniques that may have yet to be supported by solid experimental results, but are nonetheless supported by strong and well-argued scientific intuitions or preliminary results as well as concrete plans going forward.
  • Thought-provoking reflections: bold and unexpected results and reflections that can help us look at current research directions under a new light, calling for new directions for future research.
Dates
Wed 17 Apr 2024
Thu 18 Apr 2024
Fri 19 Apr 2024
Tracks
ICSE Demonstrations
ICSE Industry Challenge Track
ICSE Journal-first Papers
ICSE New Ideas and Emerging Results
ICSE Research Track
ICSE Software Engineering Education and Training
ICSE Software Engineering in Practice
ICSE Software Engineering in Society
You're viewing the program in a time zone which is different from your device's time zone change time zone

Wed 17 Apr

Displayed time zone: Lisbon change

11:00 - 12:30
Language Models and Generated Code 1Research Track / New Ideas and Emerging Results at Maria Helena Vieira da Silva
Chair(s): Yiling Lou Fudan University
12:15
7m
Talk
Expert Monitoring: Human-Centered Concept Drift Detection in Machine Learning Operations
New Ideas and Emerging Results
Joran Leest Vrije Universiteit Amsterdam, Claudia Raibulet Vrije Universiteit Amsterdam, Ilias Gerostathopoulos Vrije Universiteit Amsterdam, Patricia Lago Vrije Universiteit Amsterdam
Pre-print
14:00 - 15:30
LLM, NN and other AI technologies 1Journal-first Papers / Research Track / New Ideas and Emerging Results at Luis de Freitas Branco
Chair(s): Shin Yoo Korea Advanced Institute of Science and Technology
15:14
7m
Talk
Exploring ChatGPT for Toxicity Detection in GitHub
New Ideas and Emerging Results
Shyamal Mishra Drexel University, Preetha Chatterjee Drexel University, USA
16:00 - 17:30
Security 2Research Track / Software Engineering in Practice / Journal-first Papers / New Ideas and Emerging Results at Grande Auditório
Chair(s): Diomidis Spinellis Athens University of Economics and Business & Delft University of Technology
17:14
7m
Talk
Synthesis of Allowlists for Runtime Protection against SQLi
New Ideas and Emerging Results
Kostyantyn Vorobyov Oracle Labs, François Gauthier Oracle Labs, Paddy Krishnan Oracle Labs, Australia
16:00 - 17:30
17:07
7m
Talk
ITG: Trace Generation via Iterative Interaction between LLM Query and Trace Checking
New Ideas and Emerging Results
Weilin Luo SUN YAT-SEN UNIVERSITY, Weiyuan Fang SUN YAT-SEN UNIVERSITY, Junming Qiu SUN YAT-SEN UNIVERSITY, Hai Wan School of Data and Computer Science, Sun Yat-sen University, Yanan Liu SUN YAT-SEN UNIVERSITY, Rongzhen Ye Sun Yat-Sen University

Thu 18 Apr

Displayed time zone: Lisbon change

11:00 - 12:30
12:14
7m
Talk
Coding with a Creative Twist: Investigating the Link Between Creativity Scores and problem-solving Strategies
New Ideas and Emerging Results
Mahta Amini Polytechnique Montreal, Jay A. Olson University of Toronto Mississauga, Zohreh Sharafi Polytechnique Montréal
11:00 - 12:30
12:15
7m
Talk
Locating Buggy Segments in Quantum Program Debugging
New Ideas and Emerging Results
Naoto Sato Hitachi, Ltd., Ryota Katsube Hitachi, Ltd.
12:22
7m
Talk
Beyond a Joke: Dead Code Elimination Can Delete Live Code
New Ideas and Emerging Results
Haoxin Tu Singapore Management University, Singapore, Lingxiao Jiang Singapore Management University, Debin Gao Singapore Management University, He Jiang Dalian University of Technology
11:00 - 12:30
12:15
7m
Talk
Leveraging Large Language Models to Improve REST API Testing
New Ideas and Emerging Results
Myeongsoo Kim Georgia Institute of Technology, Tyler Stennett Georgia Institute of Technology, Dhruv Shah Georgia Institute of Technology, Saurabh Sinha IBM Research, Alessandro Orso Georgia Institute of Technology
Pre-print
12:22
7m
Talk
LogExpert: Log-based Recommended Resolutions Generation using Large Language Model
New Ideas and Emerging Results
JiaboWang Beijing University of Posts and Telecommunications, guojun chu Beijing University of Posts and Telecommunications, Jingyu Wang , Haifeng Sun Beijing University of Posts and Telecommunications, Qi Qi , Yuanyi Wang Beijing University of Posts and Telecommunications, Ji Qi China Mobile (Suzhou) Software Technology Co., Ltd., Jianxin Liao Beijing University of Posts and Telecommunications
11:00 - 12:30
AI & Security 2Research Track / New Ideas and Emerging Results at Sophia de Mello Breyner Andresen
Chair(s): Gabriele Bavota Software Institute @ Università della Svizzera Italiana
12:15
7m
Talk
Large Language Model for Vulnerability Detection: Emerging Results and Future Directions
New Ideas and Emerging Results
Xin Zhou Singapore Management University, Singapore, Ting Zhang Singapore Management University, David Lo Singapore Management University
12:22
7m
Talk
Re(gEx|DoS)Eval: Evaluating Generated Regular Expressions and their Proneness to DoS Attacks
New Ideas and Emerging Results
Mohammed Latif Siddiq University of Notre Dame, Jiahao Zhang , Lindsay Roney University of Notre Dame, Joanna C. S. Santos University of Notre Dame
DOI Pre-print Media Attached
14:00 - 15:30
15:14
7m
Talk
Decomposing and Measuring Trust in Open-Source Software Supply Chains
New Ideas and Emerging Results
Lina Boughton The College of Wooster, Courtney Miller Carnegie Mellon University, Yasemin Acar Max Planck Institute for Security and Privacy, Dominik Wermke North Carolina State University, Christian Kästner Carnegie Mellon University
14:00 - 15:30
15:13
7m
Talk
Toward Adaptive Tracing: Efficient System Behavior Analysis using Language Models
New Ideas and Emerging Results
Kasra Darvishi Brock University, Morteza Noferesti Brock University, Naser Ezzati Jivan
Link to publication
14:00 - 15:30
LLM, NN and other AI technologies 4Research Track / Industry Challenge Track / New Ideas and Emerging Results at Pequeno Auditório
Chair(s): David Nader Palacio William & Mary
15:15
7m
Talk
XAIport: A Service Framework for the Early Adoption of XAI in AI Model Development
New Ideas and Emerging Results
Zerui Wang Concordia University, Yan Liu Concordia University, Abishek Arumugam Thiruselvi Concordia University, Wahab Hamou-Lhadj Concordia University, Montreal, Canada
DOI Pre-print
15:22
7m
Talk
Which Syntactic Capabilities Are Statistically Learned by Masked Language Models for Code?
New Ideas and Emerging Results
Alejandro Velasco William & Mary, David Nader Palacio William & Mary, Daniel Rodriguez-Cardenas , Denys Poshyvanyk William & Mary
Pre-print

Fri 19 Apr

Displayed time zone: Lisbon change

14:00 - 15:30
15:00
7m
Talk
"Don’t Touch my Model!" Towards Managing Model History and Versions during Metamodel Evolution
New Ideas and Emerging Results
Marcel Homolka Institute for Software Systems Engineering, Johannes Kepler University, Linz, Luciano Marchezan Johannes Kepler University Linz, Wesley Assunção North Carolina State University, Alexander Egyed Johannes Kepler University Linz
Pre-print
15:07
7m
Talk
Challenges in Empirically Testing Memory Persistency Models
New Ideas and Emerging Results
Vasileios Klimis Queen Mary University of London, Alastair F. Donaldson Imperial College London, Viktor Vafeiadis MPI-SWS, John Wickerson Imperial College London, Azalea Raad Imperial College London
14:00 - 15:30
15:22
7m
Talk
Designing Trustful Cooperation Ecosystems is Key to the New Space Exploration Era
New Ideas and Emerging Results
Renan Lima Baima University of Luxembourg, Loïck Chovet University of Luxembourg, Johannes Sedlmeir University of Luxembourg, Miguel A. Olivares-Mendez University of Luxembourg, Gilbert Fridgen University of Luxembourg
16:00 - 17:30
Language Models and Generated Code 4New Ideas and Emerging Results / Research Track at Almada Negreiros
Chair(s): Shin Yoo Korea Advanced Institute of Science and Technology
17:00
7m
Talk
Naturalness of Attention: Revisiting Attention in Code Language Models
New Ideas and Emerging Results
Mootez Saad Dalhousie University, Tushar Sharma Dalhousie University
Pre-print
17:07
7m
Talk
Towards Trustworthy AI Software Development Assistance
New Ideas and Emerging Results
Daniel Maninger TU Darmstadt, Krishna Narasimhan TU Darmstadt, Mira Mezini TU Darmstadt
DOI Pre-print
16:00 - 17:30
17:15
7m
Talk
Breaking the Silence: the Threats of Using LLMs in Software Engineering
New Ideas and Emerging Results
June Sallou Delft University of Technology, Thomas Durieux TU Delft, Annibale Panichella Delft University of Technology
Pre-print
16:00 - 17:30
17:00
7m
Talk
Deductive Software Architecture Recovery via Chain-of-thought Prompting
New Ideas and Emerging Results
Satrio Adi Rukmono , Lina Ochoa Eindhoven University of Technology, Michel Chaudron Eindhoven University of Technology, The Netherlands
17:07
7m
Talk
Reproducibility of Build Environments through Space and Time
New Ideas and Emerging Results
Julien Malka LTCI, Télécom Paris, Institut Polytechnique de Paris, France, Stefano Zacchiroli Télécom Paris, Polytechnic Institute of Paris, Théo Zimmermann Télécom Paris, Polytechnic Institute of Paris
Pre-print

Accepted Papers

Title
Beyond a Joke: Dead Code Elimination Can Delete Live Code
New Ideas and Emerging Results
Breaking the Silence: the Threats of Using LLMs in Software Engineering
New Ideas and Emerging Results
Pre-print
Challenges in Empirically Testing Memory Persistency Models
New Ideas and Emerging Results
Coding with a Creative Twist: Investigating the Link Between Creativity Scores and problem-solving Strategies
New Ideas and Emerging Results
Decomposing and Measuring Trust in Open-Source Software Supply Chains
New Ideas and Emerging Results
Deductive Software Architecture Recovery via Chain-of-thought Prompting
New Ideas and Emerging Results
Designing Trustful Cooperation Ecosystems is Key to the New Space Exploration Era
New Ideas and Emerging Results
"Don’t Touch my Model!" Towards Managing Model History and Versions during Metamodel Evolution
New Ideas and Emerging Results
Pre-print
Expert Monitoring: Human-Centered Concept Drift Detection in Machine Learning Operations
New Ideas and Emerging Results
Pre-print
Exploring ChatGPT for Toxicity Detection in GitHub
New Ideas and Emerging Results
ITG: Trace Generation via Iterative Interaction between LLM Query and Trace Checking
New Ideas and Emerging Results
Large Language Model for Vulnerability Detection: Emerging Results and Future Directions
New Ideas and Emerging Results
Leveraging Large Language Models to Improve REST API Testing
New Ideas and Emerging Results
Pre-print
Locating Buggy Segments in Quantum Program Debugging
New Ideas and Emerging Results
LogExpert: Log-based Recommended Resolutions Generation using Large Language Model
New Ideas and Emerging Results
Naturalness of Attention: Revisiting Attention in Code Language Models
New Ideas and Emerging Results
Pre-print
Re(gEx|DoS)Eval: Evaluating Generated Regular Expressions and their Proneness to DoS Attacks
New Ideas and Emerging Results
DOI Pre-print Media Attached
Reproducibility of Build Environments through Space and Time
New Ideas and Emerging Results
Pre-print
Synthesis of Allowlists for Runtime Protection against SQLi
New Ideas and Emerging Results
Toward Adaptive Tracing: Efficient System Behavior Analysis using Language Models
New Ideas and Emerging Results
Link to publication
Towards Trustworthy AI Software Development Assistance
New Ideas and Emerging Results
DOI Pre-print
Which Syntactic Capabilities Are Statistically Learned by Masked Language Models for Code?
New Ideas and Emerging Results
Pre-print
XAIport: A Service Framework for the Early Adoption of XAI in AI Model Development
New Ideas and Emerging Results
DOI Pre-print

Call for Papers

Scope

A NIER track paper is not just a scaled-down version of a ICSE full research track paper. The NIER track is reserved for first class, top quality technical contributions. Therefore, a NIER submission is neither an ICSE full research track submission with weaker or no evaluation, nor an op-ed piece advertising existing and already published results. Authors of such submissions should instead consider submitting to either the main track or one of the many satellite events of ICSE. We require all submissions to the NIER track to include a section titled “Future Plans” where the authors outline the work they plan on doing to turn their new idea and emerging results into a full-length paper in the future.

Evaluation Criteria

Each submission will be reviewed and evaluated in terms of the following quality criteria: Significance: The extent to which the paper’s contributions can impact the field of software engineering, and under which assumptions (if any);

  • Novelty: The extent to which the contributions are sufficiently original with respect to the state-of-the-art;
  • Soundness: The extent to which the paper’s contributions and the authors’ plans for future work are based rigorous application of appropriate research methods;
  • Presentation: The extent to which the paper’s quality of writing meets the high standards of ICSE, including clear descriptions, as well as adequate use of the English language, absence of major ambiguity, clearly readable figures and tables, and adherence to the formatting instructions provided below;
  • Verifiability: The extent to which the paper includes sufficient information to understand how innovation works; to understand how data was obtained, analyzed, and interpreted; and how the paper supports independent verification or replication of the paper’s claimed contributions.

Formatting and Submission

All submissions must conform to the ICSE 2024 formatting and submission instructions available at https://www.acm.org/publications/proceedings-template for both LaTeX and Word users. LaTeX users must use the provided acmart.cls and ACM-Reference-Format.bst without modification, enable the conference format in the preamble of the document (i.e., \documentclass[sigconf,review]{acmart}), and use the ACM reference format for the bibliography (i.e., \bibliographystyle{ACM-Reference-Format}). The review option adds line numbers, thereby allowing referees to refer to specific lines in their comments.

All NIER submissions must not exceed 4 pages for the main text, inclusive of all figures, tables, appendices, etc. An extra page is allowed for references. All submissions must be in PDF. The page limit is strict, and it will not be possible to purchase additional pages at any point in the process (including after the paper is accepted). Submissions may be made through NIER submission site (link will be provided closer to the date).

By submitting to this track, authors acknowledge that they are aware of and agree to be bound by the ACM Policy and Procedures on Plagiarism ( https://www.acm.org/publications/policies/plagiarism ) and the IEEE Plagiarism FAQ (https://www.ieee.org/publications/rights/plagiarism/plagiarism-faq.html ). In particular, papers submitted to NIER 2023 must not have been published elsewhere and must not be under review or submitted for review elsewhere whilst under consideration for NIER 2023. Contravention of this concurrent submission policy will be deemed a serious breach of scientific ethics, and appropriate action will be taken in all such cases. To check for double submission and plagiarism issues, the chairs reserve the right to (1) share the list of submissions with the PC Chairs of other conferences with overlapping review periods and (2) use external plagiarism detection software, under contract to the ACM or IEEE, to detect violations of these policies. By submitting to this track, authors acknowledge that they conform to the authorship policy of the ACM (https://www.acm.org/publications/policy-on-authorship), and the authorship policy of the IEEE (https://journals.ieeeauthorcenter.ieee.org/become-an-ieee-journal-author/publishing-ethics/definition-of-authorship/).

By submitting your article to an ACM Publication, you are hereby acknowledging that you and your co-authors are subject to all ACM Publications Policies, including ACM’s new Publications Policy on Research Involving Human Participants and Subjects. Alleged violations of this policy or any ACM Publications Policy will be investigated by ACM and may result in a full retraction of your paper, in addition to other potential penalties, as per ACM Publications Policy.

Please ensure that you and your co-authors obtain an ORCID ID, so you can complete the publishing process for your accepted paper. ACM has been involved in ORCID from the start and we have recently made a commitment to collect ORCID IDs from all of our published authors. The collection process has started and will roll out as a requirement throughout 2022. We are committed to improve author discoverability, ensure proper attribution and contribute to ongoing community efforts around name normalization; your ORCID ID will help in these efforts.

Important Dates

  • NIER Submissions Deadline: 14 September 2023 - Submissions close at 23:59 AoE (Anywhere on Earth, UTC-12)
  • NIER Acceptance Notification: 22 November 2023
  • NIER Camera Ready: 21 December 2023

Double-Anonymous Submission Guidelines

The ICSE 2024 NIER track will adopt a double-anonymous review process. No submitted paper may reveal its authors’ identities. The authors must make every effort to honor the double-anonymous review process; reviewers will be asked to honor the double-anonymous review process as much as possible. Any author having further questions on double-anonymous reviewing is encouraged to contact the track’s program co-chairs by e-mail. Any submission that does not comply with the double-anonymous review process will be desk-rejected.

Conference Attendance Expectation

If a submission is accepted, at least one author of the paper is required to register for and attend the full 3-day technical conference and present the paper. The presentation is expected to be delivered in person.

Open Science Policy

The NIER track of ICSE 2024 is governed by the ICSE 2024 Open Science policies. In summary, the steering principle is that all research results should be accessible to the public and, if possible, empirical studies should be reproducible. In particular, we actively support the adoption of open data and open source principles and encourage all contributing authors to disclose (anonymized and curated) data to increase reproducibility and replicability. Note that sharing research data is not mandatory for submission or acceptance. However, sharing is expected to be the default, and non-sharing needs to be justified. We recognize that reproducibility or replicability is not a goal in qualitative research and that, similar to industrial studies, qualitative studies often face challenges in sharing research data. For guidelines on how to report qualitative research to ensure the assessment of the reliability and credibility of research results, see this previously developed Q&A page.

Upon submission to the NIER track, authors are asked:

  • to make their data available to the program committee (via upload of supplemental material or a link to an anonymous repository) – and provide instructions on how to access this data in the paper; or
  • to include in the paper an explanation as to why this is not possible or desirable; and
  • to indicate if they intend to make their data publicly available upon acceptance.

Supplementary material can be uploaded via the HotCRP site or anonymously linked from the paper submission. Although PC members are not required to look at this material, we strongly encourage authors to use supplementary material to provide access to anonymized data, whenever possible. Authors are asked to carefully review any supplementary material to ensure it conforms to the double-anonymous policy (described above). For example, code and data repositories may be exported to remove version control history, scrubbed of names in comments and metadata, and anonymously uploaded to a sharing site to support review. One resource that may be helpful in accomplishing this task is this blog post.

Upon acceptance, authors have the possibility to separately submit their supplementary material to the ICSE 2024 Artifact Evaluation track, for recognition of artifacts that are reusable, available, replicated or reproduced.

:
: