The International Conference on Predictive Models and Data Analytics in Software Engineering (PROMISE) is an annual forum for researchers and practitioners to present, discuss and exchange ideas, results, expertise and experiences in construction and/or application of predictive models, artificial intelligence, and data analytics in software engineering. PROMISE encourages researchers to publicly share their data in order to provide interdisciplinary research between the software engineering and data mining communities, and seek for verifiable and repeatable experiments that are useful in practice.
Please see the FSE 2024 website for venue, registration, and visa information.
The website for PROMISE 24 was previously hosted here.
Keynote by Dr. Raula Gaikovina Kula, Nara Institute of Science and Technology, Japan
The Ever-Evolving Promises of Data in Software Ecosystems: Models, AI, and Analytics
The year 2024 has sparked extensive discussions about the future of software engineering research, particularly for library dependencies and the software ecosystems they create. In this talk, I will take you on an experiential journey spanning the last decade, beginning in 2013 when I first embarked on my journey, and finally landing in the era of generative AI and augmented reality. We will explore how the landscape of collecting datasets through mining, user studies, and expanding from 3 systems to 3 million systems has evolved, examine what elements have remained constant, and discuss how we can advance with software ecosystems research in the face of these innovations.
Tue 16 JulDisplayed time zone: Brasilia, Distrito Federal, Brazil change
09:00 - 10:30 | |||
09:00 5mDay opening | Opening PROMISE 2024 | ||
09:05 55mKeynote | SEA4DQ keynote 1 (Denys Poshyvanyk) PROMISE 2024 | ||
10:00 15mTalk | Graph Neural Network vs. Large Language Model: A Comparative Analysis for Bug Report Priority and Severity Prediction PROMISE 2024 DOI | ||
10:15 15mTalk | A Hitchhiker’s Guide to Jailbreaking ChatGPT via Prompt Engineering PROMISE 2024 Yi Liu Nanyang Technological University, Gelei Deng Nanyang Technological University, Zhengzi Xu Nanyang Technological University, Yuekang Li The University of New South Wales, Yaowen Zheng Institute of Information Engineering at Chinese Academy of Sciences, Ying Zhang Virginia Tech, Lida Zhao Nanyang Technological University, Tianwei Zhang Nanyang Technological University, Kailong Wang Huazhong University of Science and Technology DOI |
10:30 - 11:00 | |||
10:30 30mCoffee break | Break FSE Social Events |
11:00 - 12:30 | |||
11:00 60mTalk | The Ever-Evolving Promises of Data in Software Ecosystems: Models, AI, and Analytics (Keynote) PROMISE 2024 Raula Gaikovina Kula Nara Institute of Science and Technology DOI | ||
12:00 15mTalk | Smarter Project Selection for Software Engineering Research PROMISE 2024 Tapajit Dey Carnegie Mellon University Software Engineering Institute, Jonathan Loungani Carnegie Mellon University, James Ivers Carnegie Mellon University DOI | ||
12:15 15mTalk | Evaluating the Quality of Open Source Ansible Playbooks: An Executability Perspective PROMISE 2024 Pemsith Mendis Auburn University, Wilson Reaves Auburn University, Muhammad Ali Babar School of Computer Science, The University of Adelaide, Yue Zhang Auburn University, Akond Rahman Auburn University DOI |
12:30 - 14:00 | |||
12:30 90mLunch | Lunch FSE Social Events |
14:00 - 15:30 | |||
14:00 60mTalk | Responsible AI Engineering from a Data Perspective (Keynote) PROMISE 2024 Qinghua Lu Data61, CSIRO DOI | ||
15:00 15mTalk | Sociotechnical Dynamics in Open Source Smart Contract Repositories: An Exploratory Data Analysis of Curated High Market Value Projects PROMISE 2024 Saori Costa State University of Ceará, Matheus Paixao State University of Ceará, Igor Steinmacher Northern Arizona University, Pamella Soares de Sousa State University of Ceará, Allysson Allex Araújo Federal University of Cariri, Jerffeson Teixeira de Souza State University of Ceara, Brazil DOI | ||
15:15 15mTalk | A Curated Solidity Smart Contracts Repository of Metrics and Vulnerability PROMISE 2024 Giacomo Ibba University of Cagliari - Department of Mathematics and Computer Science, Sabrina Aufiero University College London, Rumyana Neykova Brunel University London, Silvia Bartolucci University College London, Marco Ortu University of Cagliari, Roberto Tonelli University of Cagliari, Giuseppe Destefanis Brunel University London DOI |
15:30 - 16:00 | |||
15:30 30mCoffee break | Break FSE Social Events |
16:00 - 18:00 | |||
16:00 15mTalk | MoreFixes: A Large-Scale Dataset of CVE Fix Commits Mined through Enhanced Repository Discovery PROMISE 2024 Jafar Akhoundali Leiden University, Sajad Rahim Nouri Islamic Azad University of Ramsar, Kristian Rietveld Leiden University, Olga Gadyatskaya DOI | ||
16:15 15mTalk | A Pilot Study in Surveying Data Challenges of Automatic Software Engineering Tasks PROMISE 2024 DOI | ||
16:30 15mTalk | Prioritising GitHub Priority Labels PROMISE 2024 DOI | ||
16:45 15mTalk | Predicting Fairness of ML Software Configurations PROMISE 2024 Salvador Robles Herrera University of Texas at El Paso, Verya Monjezi University of Texas at El Paso, Vladik Kreinovich University of Texas at El Paso, Ashutosh Trivedi University of Colorado Boulder, Saeid Tizpaz-Niari University of Texas at El Paso DOI | ||
17:00 5mDay closing | Closing PROMISE 2024 |
18:00 - 19:30 | TOSEM Editorial Board MeetingFSE Social Events at Pitanga Chair(s): Mauro Pezze USI Università della Svizzera Italiana & SIT Schaffhausen Institute of Technology | ||
18:00 90mMeeting | TOSEM Editorial Board Meeting FSE Social Events |
Accepted Papers
Call for Papers
The International Conference on Predictive Models and Data Analytics in Software Engineering (PROMISE) welcomes four types of submissions:
Technical papers (10 pages)
- PROMISE accepts a wide range of papers where AI tools have been applied to SE such as predictive modeling and other AI methods. Both positive and negative results are welcome, though negative results should still be based on rigorous research and provide details on lessons learned.
Industrial papers (2-4 pages)
- Results, challenges, lessons learned from industrial applications of software analytics.
New idea papers (2-4 pages)
- Novel insights or ideas that may yet to be fully tested.
Journal First
- Selected papers will be invited for journal first presentations at PROMISE. Details to follow.
Topics of Interest
PROMISE papers can explore any of the following topics (or more).
Application-oriented papers:
- prediction of cost, effort, quality, defects, business value;
- quantification and prediction of other intermediate or final properties of interest in software development regarding people, process or product aspects;
- using predictive models and data analytics in different settings, e.g. lean/agile, waterfall, distributed, community-based software development;
- dealing with changing environments in software engineering tasks;
- dealing with multiple-objectives in software engineering tasks;
- using predictive models and software data analytics in policy and decision-making.
Ethically-aligned papers:
- Can we apply and adjust our AI-for-SE tools (including predictive models) to handle ethical non-functional requirements such as inclusiveness, transparency, oversight and accountability, privacy, security, reliability, safety, diversity and fairness?
Theory-oriented papers:
- model construction, evaluation, sharing and reusability;
- interdisciplinary and novel approaches to predictive modelling and data analytics that contribute to the theoretical body of knowledge in software engineering;
- verifying/refuting/challenging previous theory and results;
- combinations of predictive models and search-based software engineering;
- the effectiveness of human experts vs. automated models in predictions.
Data-oriented papers:
- data quality, sharing, and privacy;
- curated data sets made available for the community to use; ethical issues related to data collection and sharing;
- metrics;
- tools and frameworks to support researchers and practitioners to collect data and construct models to share/repeat experiments and results.
Validity-oriented papers:
- replication and repeatability of previous work using predictive modelling and data analytics in software engineering;
- assessment of measurement metrics for reporting the performance of predictive models;
- evaluation of predictive models with industrial collaborators.
Submissions
PROMISE 2024 submissions must meet the following criteria:
- be original work, not published or under review elsewhere while being considered;
- conform to the ACM SIG proceedings template;
- not exceed 10 (4) pages for technical (industrial, new-ideas) papers including references;
- be written in English;
- be prepared for double blind review
- Exception: for data-oriented papers, authors may elect not to use double blind by placing a footnote on page 1 saying “Offered for single-blind review”.
- be submitted via EasyChair;
- on submission, please choose the paper category appropriately, i.e., technical (main track, 10 pages max); industrial (4 pages max); and new idea papers (4 pages max).
To satisfy the double blind requirement submissions must meet the following criteria:
- no author names and affiliations in the body and metadata of the submitted paper;
- self-citations are written in the third person;
- no references to the authors personal, lab, or university website;
- no references to personal accounts on GitHub, bitbucket, Google Drive, etc.
Evaluation
Submissions will be peer reviewed by at least three experts from the international program committee. Submissions will be evaluated on the basis of their originality, importance of contribution, soundness, evaluation, quality, and consistency of presentation, and appropriate comparison to related work.
Important Dates
- Abstracts due: March 22nd, 2024 AoE
- Submissions due: March 28th, 2024 AoE
- Author notification: April 19th, 2024 AoE
- Camera ready: May 17th, 2024 AoE
- Conference Date: July 16th, 2024
Green Open Access
Similar to other leading SE conferences, PROMISE supports and encourages Green Open Access, i.e., self-archiving. Authors can archive their papers on their personal home page, an institutional repository of their employer, or at an e-print server such as arXiv (preferred). Also, given that PROMISE papers heavily rely on software data, we would like to draw authors that leverage data scraped from GitHub of GitHub’s Terms of Service, which require that “publications resulting from that research are open access”.
We also strongly encourage authors to submit their tools and data to Zenodo, which adheres to FAIR (findable, accessible, interoperable and re-usable) principles and provides DOI versioning.
Journal Special Section
Following the conference, the authors of the best papers will be invited to submit extended versions of their papers for consideration in a special section in the journal Empirical Software Engineering (EMSE).
Publication and Attendance
Accepted papers will be published in the ACM Digital Library within its International Conference Proceedings Series and will be available electronically via ACM Digital Library.
Each accepted paper needs to have one registration at the full conference rate and be presented in person at the conference.
AUTHORS TAKE NOTE: The official publication date is the date the proceedings are made available in the ACM Digital Library. This date may be up to two weeks prior to the first day of the conference. The official publication date affects the deadline for any patent filings related to published work.