CAIN 2022 - 1st International Conference on AI Engineering - Software Engineering for AI
Welcome to CAIN’22 - 1st Conference on AI Engineering – Software Engineering for AI
May 16-17, 2022 on-line and in-person May 24, 2022 in Pittsburgh, PA, USA
The aim of CAIN’22 is to bring together researchers and practitioners in software engineering, in data-science and AI, and to build up a community that will target the new challenges emerging in Software Engineering for AI-enabled systems.
In development and implementation of AI-enabled systems, the main challenge is not to develop the best models/algorithms, but to provide support for the entire lifecycle – from a business idea, through collection, training, and management of data, code development, product deployment and operation, and its maintenance and evolution. There is a clear need for specific support of Software Engineering for AI.
CAIN has the following goals for the next few years.
- Identify the main challenges of AI engineering, from an AI and SE perspective, considering industrial needs and their current experiences;
- Create a roadmap capturing the research directions in AI engineering in relation to AI-based systems lifecycle;
- Contribute to a better understating of practical problems and understanding differences in approaches of data science and AI/ML and SE;
- Identify industrial challenges in building and using AI-enabled systems and contribute to solving them
- Build a thriving community of SE, and data-science and AI practitioners and researchers.
CAIN’22 will have all sessions in a single track. The following sessions are planned:
- Invited keynotes and panels
- Presentation of accepted papers
- Industrial Talks
- Poster presentations
Mon 16 MayDisplayed time zone: Eastern Time (US & Canada) change
06:00 - 06:30 | Welcome to CAINCAIN 2022 at CAIN main room Chair(s): Jan Bosch Chalmers University of Technology, Jane Cleland-Huang University of Notre Dame, Helena Holmström Olsson Malmö University, Iva Krasteva Sofia University, GATE Institute, Lucy Ellen Lwakatare University of Helsinki, Henry Muccini University of L'Aquila, Italy, Ipek Ozkaya Carnegie Mellon Software Engineering Institute, Thomas Zimmermann Microsoft Research | ||
07:30 - 07:45 | |||
09:15 - 09:30 | |||
09:30 - 11:00 | Training & LearningCAIN 2022 at CAIN main room Chair(s): Jan Bosch Chalmers University of Technology | ||
09:30 15mResearch paper | An Empirical Evaluation of Flow Based Programming in the Machine Learning Deployment ContextResearch Paper CAIN 2022 Andrei Paleyes Department of Computer Science and Technology, Univesity of Cambridge, Christian Cabrera Department of Computer Science and Technology, Univesity of Cambridge, Neil D. Lawrence Department of Computer Science and Technology, Univesity of Cambridge Pre-print Media Attached | ||
09:45 15mResearch paper | Automatic Checkpointing and Deterministic Training for Deep LearningResearch Paper CAIN 2022 Xiangzhe Xu Purdue University, Hongyu Liu Huawei Galois Lab, China, Guanhong Tao Purdue University, USA, Zhou Xuan Purdue University, Xiangyu Zhang Purdue University | ||
10:00 15mResearch paper | Influence-Driven Data Poisoning in Graph-Based Semi-Supervised ClassifiersResearch Paper CAIN 2022 Adriano Franci University of Luxembourg, Maxime Cordy University of Luxembourg, Luxembourg, Martin Gubri University of Luxembourg, Luxembourg, Mike Papadakis University of Luxembourg, Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg | ||
10:15 15mIndustry talk | Engineering a Platform for Reinforcement Learning WorkloadsIndustry Talk CAIN 2022 | ||
10:30 15mResearch paper | Method Cards for Prescriptive Machine-Learning TransparencyResearch Paper CAIN 2022 David Adkins Meta AI, Bilal Alsallakh Meta AI, Adeel Cheema Meta AI, Narine Kokhlikyan Meta AI, Emily McReynolds Meta AI, Pushkar Mishra Meta AI, Chavez Procope Meta AI, Jeremy Sawruk Meta AI, Erin Wang Meta AI, Polina Zvyagina Meta AI | ||
10:45 15mOther | Discussion on Training & Learning CAIN 2022 |
11:00 - 11:15 | |||
11:15 - 12:15 | |||
11:15 60mKeynote | Software 2.0, Foundation Models, Data-Centric AI, and why I’m excited enough to tolerate these buzzwords CAIN 2022 |
Tue 17 MayDisplayed time zone: Eastern Time (US & Canada) change
07:30 - 07:45 | |||
09:15 - 09:30 | |||
09:30 - 11:00 | AI SmellsCAIN 2022 at CAIN main room Chair(s): Ipek Ozkaya Carnegie Mellon Software Engineering Institute, Thomas Zimmermann Microsoft Research | ||
09:30 30mOther | Activity: Brainwriting CAIN 2022 | ||
10:00 15mResearch paper | Code Smells for Machine Learning ApplicationsResearch Paper CAIN 2022 Haiyin Zhang AI for Fintech Research, ING, Luís Cruz Deflt University of Technology, Arie van Deursen Delft University of Technology, Netherlands Pre-print | ||
10:15 15mResearch paper | Data Smells: Categories, Causes and Consequences, and Detection of Suspicious Data in AI-based SystemsResearch Paper CAIN 2022 Harald Foidl University of Innsbruck, Michael Felderer University of Innsbruck, Rudolf Ramler Software Competence Center Hagenberg Pre-print | ||
10:30 15mResearch paper | Data smells in Public DatasetsResearch Paper CAIN 2022 Arumoy Shome Delft University of Technology, Luís Cruz Deflt University of Technology, Arie van Deursen Delft University of Technology, Netherlands Pre-print | ||
10:45 15mOther | Discussion on Smells in AI CAIN 2022 |
11:00 - 11:15 | |||
11:15 - 12:15 | Keynote Saleema AmershiCAIN 2022 at CAIN main room Chair(s): Jane Cleland-Huang University of Notre Dame | ||
11:15 60mKeynote | Challenges in creating responsible and human-centered AI CAIN 2022 Saleema Amershi Microsoft Research |
12:15 - 12:30 | Closing and AwardsCAIN 2022 at CAIN main room Chair(s): Jan Bosch Chalmers University of Technology, Jane Cleland-Huang University of Notre Dame, Helena Holmström Olsson Malmö University, Iva Krasteva Sofia University, GATE Institute, Lucy Ellen Lwakatare University of Helsinki, Henry Muccini University of L'Aquila, Italy, Ipek Ozkaya Carnegie Mellon Software Engineering Institute, Thomas Zimmermann Microsoft Research | ||
Accepted Papers
1. Call for Papers
Keynotes
- Chris Re: Software 2.0, Foundation Models, Data-Centric AI, and why I’m excited enough to tolerate these buzzwords.
- Saleema Amershi: Challenges in Creating Responsible and Human-cCentered AI
Accepted contributions
For the list of accepted papers, posters, and industry talks, please visit this link
Welcome to CAIN’22 - 1st International Conference on AI Engineering – Software Engineering for AI
Call for submission - research and experience papers
You are invited to submit research and experience papers describing the challenges, new research results, visionary ideas, or experience papers from or in cooperation with practitioners.
Topics of interests
The overall area is Software Engineering for AI, i.e. means to improve development of software AI-based systems and software-intensive systems, including topics relevant for the entire lifecycle. The suggested topics are (but not limited to):
- System and software requirements and their relations AI/ML modelling;
- Data management ensuring relevance and efficiency related to business goals;
- System and software architecture of AI-based systems;
- Integration of AI-development process and software development processes, including continuous and federated ML, continuous deployment, system and software evolution;
- Ensuring and managing system and software nonfunctional properties and their relation to AI/ML properties, including run-time properties such as performance, safety, security, reliability, and life-cycle properties including reusability, maintainability and evolution;
- Development teams, organizational and management issues for a successful development of AI-systems.
Review criteria
The paper submissions will undergo a review process with three independent reviews and a virtual PC decision meeting. The acceptance criteria include novelty, research and industrial relevance, soundness, experiences, and preliminary results.
Submission form
The papers should be submitted to HotCRP web page (https://cain2022.hotcrp.com/). The submission deadline is firm.
Update (1/17/2022) Submissions must be registered by January 20 with the paper title, author list and some additional metadata. The deadline for the completed paper is January 25.
All submissions must adhere to the following requirements:
- The page limit is 10 pages plus 2 additional pages of references.
- Submissions must be unpublished original work and should not be under review or submitted elsewhere while being under consideration.
- The submissions must adhere to the rules specified by the Submission format.
- The submissions will be reviewed in a form of Double Blind Review process, i.e. the authors’ names must be omitted from the submission. For formatting and additional instructions see Submission format.
Publication
The accepted papers will be published in the ICSE 2022 Co-located Event Proceedings and included in the IEEE and ACM Digital Libraries. Authors of accepted papers are required to register and present their accepted paper at the conference in order for the paper to be included in the proceedings and the Digital Libraries.
The official publication date is the date the proceedings are made available in the ACM or IEEE Digital Libraries. This date may be up to two weeks prior to the first day of ICSE 2022. The official publication date affects the deadline for any patent filings related to published work.
Submission format
All submissions to CAIN 2022 must adhere to the following rules:
- Submissions must strictly conform to the ACM formatting instructions for both LaTeX and Word users. LaTeX users must use the provided acmart.cls and ACM-Reference-Format.bst without modification, enable the conference format in the preamble of the document (i.e., {\documentclass[sigconf,review]{acmart}), and use the ACM reference format for the bibliography (i.e., \bibliographystyle{ACM-Reference-Format}). The review option adds line numbers, thereby allowing referees to refer to specific lines in their comments.
- All submissions must be in PDF.
- By submitting to CAIN, authors acknowledge that they are aware of and agree to be bound by the ACM Policy and Procedures on Plagiarism and the IEEE Plagiarism FAQ. The authors also acknowledge that they conform to the authorship policy of the ACM and the authorship policy of the IEEE.
- The CAIN 2020 Full paper review will employ a double-anonymous review process. Thus, no submission may reveal its authors’ identities. The authors must make every effort to honor the double-anonymous review process. In particular:
- Authors’ names must be omitted from the submitted paper. LaTeX users can add anonymous (omitting author names) option (i.e. \documentclass[sigconf,review,anonymous]{acmart} specification).
- All references to the author’s prior work should be in the third person.
- Authors are encouraged to title their submission differently than preprints of the authors on ArXiV or similar sites. During review, authors should not publicly use the submission title.
- The review process of posters and Industrial Talks proposals will use a single blind review process, i.e. the authors should specify their names in the submitted document.
3. Call for posters
In addition to full technical papers, CAIN 2022 provides the opportunity to submit posters which will be included in the proceedings as two-page extended abstracts. New ideas, a starting work and the results, or presentation of challenges in theory in practice, related to the topics of AI engineering, are welcome to be submitted. In addition, the full papers that will not be accepted, but are of interest for the AI engineering community, will be invited to submit to this track.
The authors need to submit a 2-page extended abstract that should adhere to the ICSE 2022 Conference Proceedings Formatting Guidelines. The 2-page extended abstract of each accepted poster may, at the authors’ discretion, be published in the CAIN’22 proceedings.
The submissions must adhere to the rules specified by the Submission format.
Abstracts must be submitted electronically at the submission site EasyChair CAIN2022-posters. by the submission deadline. A submission will be desk rejected if it does not comply with the instructions and size limits. At least one author of each accepted extended abstract is required to register for the CAIN 2022 conference and to present the poster. Each accepted poster will be presented by its authors during the 2 days of CAIN conference.
2. Call for Industrial Talks
The goal of industrial talks is to share experiences in industrial applications of software engineering of AI-enabled systems and lessons learned from applications of various techniques and practices. This type of submission is only open to individuals willing to share practical lessons learned directly from the field.
We solicit practitioner-oriented talks on topics that are likely to be relevant to both industrial and academic attendees. Talk proposals should include a short abstract (150 words), and up to 8 keywords. In addition, the proposal should include a “talk description”, which describes what the talk will be about, highlighting its key points and the reason why it is relevant and important to the software engineering community (500 words). This description will be included in the CAIN’22 proceedings as a two-page long extended abstract for each industrial talk.
In addition, please include up to 10 slides that represent the content of your talk. Submissions should also include the title, the name and affiliation of each presenter, and a speaker biography. Talk proposals can include supporting supplemental materials such as white papers or videos. Please indicate a desired length of either 15 min or 30 min for your talk.
The papers should be submitted to Easy Chair page. The submission deadline is firm.
The submissions must adhere to the rules specified by the Submission format.
The submitted proposals will be reviewed by the Industrial Track Committee.