ICPC 2025
Sun 27 - Mon 28 April 2025 Ottawa, Ontario, Canada
co-located with ICSE 2025
Dates
Sun 27 Apr 2025
Mon 28 Apr 2025
Tracks
ICPC Keynotes
ICPC Closing
ICPC Early Research Achievements (ERA)
ICPC MIP Talk
ICPC Opening
ICPC Replications and Negative Results (RENE)
ICPC Research Track
ICPC Tool Demonstration
You're viewing the program in a time zone which is different from your device's time zone change time zone

Sun 27 Apr

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Vulnerabilities, Technical Debt, DefectsEarly Research Achievements (ERA) / Research Track / Replications and Negative Results (RENE) at 205
Chair(s): Anthony Peruma University of Hawai‘i at Mānoa, Coen De Roover Vrije Universiteit Brussel, Gema Rodríguez-Pérez Department of Computer Science, Mathematics, Physics and Statistics, University of British Columbia, Okanagan Campus
11:36
6m
Talk
Leveraging multi-task learning to improve the detection of SATD and vulnerability
Replications and Negative Results (RENE)
Barbara Russo Free University of Bolzano, Jorge Melegati Free University of Bozen-Bolzano, Moritz Mock Free University of Bozen-Bolzano
Pre-print
11:52
6m
Talk
Personalized Code Readability Assessment: Are We There Yet?
Replications and Negative Results (RENE)
Antonio Vitale Politecnico di Torino, University of Molise, Emanuela Guglielmi University of Molise, Rocco Oliveto University of Molise, Simone Scalabrino University of Molise
11:58
6m
Talk
Automated Refactoring of Non-Idiomatic Python Code: A Differentiated Replication with LLMs
Replications and Negative Results (RENE)
Alessandro Midolo University of Sannio, Italy, Massimiliano Di Penta University of Sannio, Italy
Pre-print
12:14
6m
Talk
A Study on Applying Large Language Models to Issue Classification
Replications and Negative Results (RENE)
Jueun Heo Gyeongsang National University, Seonah Lee Gyeongsang National University
14:00 - 15:30
Education, Debugging, Dynamic AnalysisResearch Track / Early Research Achievements (ERA) / Replications and Negative Results (RENE) / Tool Demonstration at 205
Chair(s): Simone Scalabrino University of Molise, Coen De Roover Vrije Universiteit Brussel, Gema Rodríguez-Pérez Department of Computer Science, Mathematics, Physics and Statistics, University of British Columbia, Okanagan Campus
14:52
6m
Talk
Investigating Execution-Aware Language Models for Code Optimization
Replications and Negative Results (RENE)
Federico Di Menna University of L'Aquila, Luca Traini University of L'Aquila, Gabriele Bavota Software Institute @ Università della Svizzera Italiana, Vittorio Cortellessa University of L'Aquila
Pre-print
16:00 - 17:30
Summarisation, Natural Language GenerationResearch Track / Early Research Achievements (ERA) / Replications and Negative Results (RENE) at 205
Chair(s): Oscar Chaparro William & Mary, Coen De Roover Vrije Universiteit Brussel, Gema Rodríguez-Pérez Department of Computer Science, Mathematics, Physics and Statistics, University of British Columbia, Okanagan Campus
17:16
6m
Talk
Towards Generating the Rationale for Code Changes
Replications and Negative Results (RENE)
Francesco Casillo Università di Salerno, Antonio Mastropaolo William and Mary, USA, Gabriele Bavota Software Institute @ Università della Svizzera Italiana, Vincenzo Deufemia University of Salerno, Carmine Gravino University of Salerno

Mon 28 Apr

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Empirical Findings, Future Visions, Recommendations Replications and Negative Results (RENE) / Early Research Achievements (ERA) / Tool Demonstration / Research Track at 205
Chair(s): Mark Hills Appalachian State University, Coen De Roover Vrije Universiteit Brussel, Gema Rodríguez-Pérez Department of Computer Science, Mathematics, Physics and Statistics, University of British Columbia, Okanagan Campus
11:52
6m
Talk
Mining Code Change Patterns in Ada Projects
Replications and Negative Results (RENE)
Robin van Straeten Radboud University, Bin Lin Hangzhou Dianzi University

Call for Papers

The 33rd IEEE/ACM International Conference on Program Comprehension (ICPC’25) would like to encourage researchers to (1) reproduce results from previous papers and (2) publish studies with important and relevant negative or null results (results which fail to show an effect, yet demonstrate the research paths that did not pay off).

We would also like to encourage the publication of the negative results or reproducible aspects of previously published work. For example, authors of a published paper reporting a working solution for a given problem can document in a “negative results paper” other (failed) attempts they made before defining the working solution they published.

  1. Reproducibility studies. The papers in this category must go beyond simply re-implementing an algorithm and/or re-running the artifacts provided by the original paper. Such submissions should at least apply the approach on new data sets (open-source or proprietary). A reproducibility study should clearly report on results that the authors were able to reproduce as well as on the aspects of the work that were irreproducible. We encourage reproducibility studies to follow the ACM guidelines on reproducibility (different team, different experimental setup): “The measurement can be obtained with stated precision by a different team, a different measuring system, in a different location on multiple trials. For computational experiments, this means that an independent group can obtain the same result using artifacts which they develop completely independently.”

  2. Negative results papers. We seek papers that report on negative results. We seek negative results for all types of software engineering research in any empirical area (qualitative, quantitative, case study, experiment, etc.). For example, did your controlled experiment not show an improvement over the baseline? Even if negative, results obtained are still valuable when they are either not obvious or disprove widely accepted wisdom.

Evaluation Criteria

Both Reproducibility Studies and Negative Results submissions will be evaluated according to the following standards:

  • Depth and breadth of the empirical studies
  • Clarity of writing
  • Appropriateness of conclusions
  • Amount of useful, actionable insights
  • Availability of artifacts
  • Underlying methodological rigor. A negative result due primarily to misaligned expectations or due to lack of statistical power (small samples) is not a good submission. The negative result should be a result of a lack of effect, not lack of methodological rigor.

Most importantly, we expect reproducibility studies to clearly point out the artifacts the study is built upon, and to provide the links to all the artifacts in the submission (the only exception will be given to those papers that reproduce the results on proprietary datasets that can not be publicly released).

Submission Instructions

Submissions must be original, in the sense that the findings and writing have not been previously published or under consideration elsewhere. However, as either reproducibility studies or negative results, some overlap with previous work is expected. Please make that clear in the paper.

Publication format should follow the ICPC guidelines. Submissions to the RENE Track can be made via the ICPC RENE track submission site (https://icpc2025-rene.hotcrp.com) by the submission deadline.

Length: There are two formats. (1) New reproducibility studies and new descriptions of negative results will have a length of 10 pages, plus 2 pages which may only contain references. (2) Appendices to conference submissions or previous work by the authors can be described in 4 pages, plus 1 page which may only contain references (e.g., as previously said, authors of a published paper can document negative results they got while working on it, such as solutions that did not work).

Important note: the RENE track does not follow a double-anonymous review process.

The official publication date is the date the proceedings are made available in the ACM or IEEE Digital Libraries. This date may be up to two weeks prior to the first day of ICSE 2025. The official publication date affects the deadline for any patent filings related to published work.

Purchases of additional pages in the proceedings are not allowed. Full registration and in-person presentation are required for papers accepted at the conference.

:
: