Write a Blog >>
SEAMS 2021
Tue 18 - Fri 21 May 2021
co-located with ICSE 2021

SEAMS 2021 will be colocated with ICSE 2021 and held in Madrid, May 18-21, 2021.

Modern and emerging software systems, such as industrial Internet of Things, Cyber-Physical Systems, cloud and edge computing, robotics, and smart environments have to operate without interruption. Self-adaptation and self-management enable these systems to adapt themselves at runtime to preserve and optimize their operation in the presence of uncertain changes in their operating environment, resource variability, new user needs, attacks, intrusions, and faults. Approaches to complement software-based systems with self-managing and self-adaptive capabilities are an important area of research and development, offering solutions that leverage advances in fields such as software architecture, fault-tolerant computing, programming languages, run-time program analysis and verification, among others. Additionally, research in this field is informed by related areas such as control systems, machine learning, artificial intelligence, agent-based systems, and biologically inspired computing. The SEAMS symposium focuses on applying software engineering to these approaches, including methods, techniques, processes and tools that can be used to support self-* properties like self-protection, self-healing, self-optimization, and self-configuration

Dates

This program is tentative and subject to change.

You're viewing the program in a time zone which is different from your device's time zone - change time zone

Tue 18 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:30 - 15:00
OpeningSEAMS 2021 at SEAMS Room
Chair(s): Rogério de LemosUniversity of Kent, UK
15:00 - 15:55
Session 1: Self-Adaptation and Machine LearningSEAMS 2021 at SEAMS Room
Chair(s): Sona GhahremaniHasso Plattner Institute, University of Potsdam
15:00
5m
Paper
On the Impact of Applying Machine Learning in the Decision-Making of Self-Adaptive SystemsShort Paper
SEAMS 2021
Omid Gheibi, Danny WeynsKU Leuven, Federico QuinKatholieke Universiteit Leuven
Pre-print
15:05
5m
Paper
Federated Machine Learning as a Self-adaptive ProblemShort Paper
SEAMS 2021
Luciano BaresiPolitecnico di Milano, Giovanni QuattrocchiPolitecnico di Milano, Nicholas Rasi
15:10
5m
Paper
Towards Better Adaptive Systems by Combining MAPE, Control Theory, and Machine LearningShort Paper
SEAMS 2021
Danny WeynsKU Leuven, Bradley SchmerlCarnegie Mellon University, USA, Masako Kishida, Alberto LevaPolitecnico di Milano, Marin LitoiuYork University, Necmiye Ozay, Colin PatersonUniversity of York, Kenji TeiWaseda University / National Institute of Informatics, Japan
Pre-print
15:15
35m
Live Q&A
Session 1 - Discussion
SEAMS 2021
16:00 - 17:00
Keynote 1SEAMS 2021 at SEAMS Room
Chair(s): Ingrid NunesUniversidade Federal do Rio Grande do Sul (UFRGS), Brazil
16:00
60m
Keynote
Viewing Autonomic Computing through the Lens of Embodied Artificial Intelligence: A Self-DebateKeynote
SEAMS 2021
A: Jeffrey KephartIBM Thomas J Watson Research Center
17:05 - 18:00
Session 2: Cyber-Physical SystemsSEAMS 2021 at SEAMS Room
Chair(s): Tomas BuresCharles University
17:05
5m
Paper
ReSonAte: A Runtime Risk Assessment Framework for Autonomous SystemsLong Paper
SEAMS 2021
17:10
5m
Paper
The Hitchhiker's Guide to the End-of-Life for Smart DevicesShort Paper
SEAMS 2021
17:15
5m
Paper
Seamless Reconfiguration of Rule-based IoT ApplicationsShort Paper
SEAMS 2021
Francisco DuránUniversity of Málaga, Spain, Ajay KrishnaInria Grenoble, France, Michel Le PallecNokia Bell Labs, Radu MateescuINRIA, Gwen SalaünUniversity of Grenoble Alpes
17:20
5m
Paper
Body Sensor Network: A Self-Adaptive System Exemplar in the Healthcare DomainArtifact Paper
SEAMS 2021
Eric Bernd GilUniversity of Brasilia, Ricardo CaldasChalmers, Arthur RodriguesUniversity of Brası́lia, Gabriel Levi Gomes da SilvaUniversity of Brasília, Brazil, Genaína Nunes RodriguesUniversity of Brasília, Patrizio PelliccioneGran Sasso Science Institute (GSSI) and Chalmers | University of Gothenburg
Pre-print Media Attached
17:25
35m
Live Q&A
Session 2 - Discussion
SEAMS 2021

Wed 19 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:30 - 15:25
Session 3: Decentralisation and DistributionSEAMS 2021 at SEAMS Room
Chair(s): Radu CalinescuUniversity of York, UK
14:30
5m
Paper
Decentralized Self-Adaptive Systems: A Mapping StudyLong Paper
SEAMS 2021
Federico QuinKatholieke Universiteit Leuven, Danny WeynsKU Leuven, Omid Gheibi
Pre-print
14:35
5m
Paper
Self-Adaptive Microservice-based Systems - Landscape and Research OpportunitiesLong Paper
SEAMS 2021
Messias FilhoState University of Ceará, Eliaquim Barbosa Pimentel, Wellington Pereira, Paulo MaiaState University of Ceará, Mariela Inés Cortés
Pre-print
14:40
5m
Paper
Platooning LEGOs: An Open Physical Exemplar for Engineering Self-Adaptive Cyber-Physical Systems-of-SystemsArtifact Paper
SEAMS 2021
Yong-Jun ShinKorea Advanced Institute of Science and Technology (KAIST), Lingjun LiuKorea Advanced Institute of Science and Technology (KAIST), Sangwon Hyun, Doo-Hwan BaeKorea Advanced Institute of Science and Technology
14:45
35m
Live Q&A
Session 3 - Discussion
SEAMS 2021
17:30 - 18:00
Social EventSEAMS 2021 at SEAMS Room

Thu 20 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:30 - 15:25
Session 4: Industry 4.0SEAMS 2021 at SEAMS Room
Chair(s): Nuno AntunesUniversidade de Coimbra
14:30
5m
Paper
Self-Adaptive Manufacturing with Digital TwinsLong Paper
SEAMS 2021
Manuela DaliborSoftware Engineering, RWTH Aachen University, Andreas WortmannRWTH Aachen University, Bernhard RumpeRWTH Aachen, Tim Bolender, Gereon Bürvenich
14:35
5m
Paper
The Design Space of Emergent Scheduling for Distributed Execution FrameworksLong Paper
SEAMS 2021
Paul DeanLancaster University, Barry PorterLancaster University
14:40
5m
Paper
Enhancing Human-in-the-Loop Adaptive Systems through Digital Twins and VR InterfacesLong Paper
SEAMS 2021
Enes YigitbasPaderborn University, Germany, Kadiray KarakayaHeinz Nixdorf Institut, Paderborn University, Ivan JovanovikjPaderborn University, Gregor EngelsPaderborn University
Pre-print
14:45
5m
Paper
Towards a Self-Adaptive Architecture for Federated Learning of Industrial Automation SystemsShort Paper
SEAMS 2021
14:50
35m
Live Q&A
Session 4 - Discussion
SEAMS 2021
15:30 - 16:00
MIPSEAMS 2021 at SEAMS Room
Chair(s): Betty H.C. ChengMichigan State University
15:30
15m
Paper
Most Influential Paper: SEAMS 2008
SEAMS 2021
15:45
15m
Paper
Most Influential Paper: SEAMS 2009
SEAMS 2021
16:00 - 16:55
Session 5: Human in the LoopSEAMS 2021 at SEAMS Room
Chair(s): Shihong HuangFlorida Atlantic University
16:00
5m
Paper
Hey! Preparing Humans to do Tasks in Self-adaptive SystemsLong Paper
SEAMS 2021
NIANYU LIPeking University, China, Javier CamaraUniversity of York, David GarlanCarnegie Mellon University, USA, Bradley SchmerlCarnegie Mellon University, USA
16:05
5m
Paper
A Conceptual Reference Model for Human as a Service Provider in Cyber Physical SystemsLong Paper
SEAMS 2021
Hargyo Tri Nugroho IgnatiusUniversity of Birmingham, Rami BahsoonUniversity of Birmingham
16:10
5m
Paper
Maintaining driver attentiveness in shared-control autonomous drivingShort Paper
SEAMS 2021
16:15
5m
Paper
Self-adaptive and Interconnected Gamified Applications to Reach the Common Good: Research Challenges AheadShort Paper
SEAMS 2021
Antonio BucchiaroneFondazione Bruno Kessler, Trento, Italy, Antonio CicchettiMälardalen University, Nelly BencomoAston University, Enrica Loria, Annapaola MarconiFondazione Bruno Kessler, Trento, Italy
16:20
35m
Live Q&A
Session 5 - Discussion
SEAMS 2021
17:00 - 18:00
Session 6: Uncertainty and FairnessSEAMS 2021 at SEAMS Room
Chair(s): Pooyan JamshidiUniversity of South Carolina
17:00
5m
Paper
"Know What You Know": Predicting Behavior for Learning-Enabled Systems When Facing UncertaintyLong Paper
SEAMS 2021
Michael LangfordMichigan State University, Betty H.C. ChengMichigan State University
17:05
5m
Paper
Run-time Reasoning from Uncertain Observations with Subjective Logic in Multi-Agent Self-Adaptive Cyber-Physical SystemsLong Paper
SEAMS 2021
Ana PetrovskaTechnical University of Munich, Malte Neuss, Ilias GerostathopoulosVrije Universiteit Amsterdam, Alexander PretschnerTechnical University of Munich
Pre-print
17:10
5m
Paper
Reliability Prediction of Self-Adaptive Systems Managing Uncertain AI Black-Box ComponentsShort Paper
SEAMS 2021
Max ScheererFZI Research Center for Information Technology, Germany, Ralf ReussnerKarlsruhe Institute of Technology (KIT) and FZI - Research Center for Information Technology (FZI)
17:15
5m
Paper
On Adaptive Fairness in Software SystemsShort Paper
SEAMS 2021
Ali FarahaniLero - The Irish Software Research Centre and University of Limerick, Liliana PasqualeUniversity College Dublin & Lero, Amel BennaceurThe Open University, Thomas Welsh, Bashar NuseibehThe Open University (UK) & Lero (Ireland)
Pre-print
17:20
35m
Live Q&A
Session 6 - Discussion
SEAMS 2021

Fri 21 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:30 - 15:25
Session 7: Core Approaches for Self-adaptationSEAMS 2021 at SEAMS Room
Chair(s): Genaina RodriguesUniversity of Brasilia
14:30
5m
Paper
How do we Evaluate Self-adaptive Software Systems?Long Paper
SEAMS 2021
Ilias GerostathopoulosVrije Universiteit Amsterdam, Thomas VogelHumboldt-Universität zu Berlin, Danny WeynsKU Leuven, Patricia LagoVrije Universiteit Amsterdam
Pre-print
14:35
5m
Paper
Threat models at run time: the case for reflective and adaptive threat managementShort Paper
SEAMS 2021
Dimitri Van LanduytKatholieke Universiteit Leuven, Liliana PasqualeUniversity College Dublin & Lero, Laurens Sionimec-DistriNet, KU Leuven, Wouter JoosenKatholieke Universiteit Leuven
14:40
5m
Paper
Incremental Runtime Model Queries and Adaptive MonitoringShort Paper
SEAMS 2021
Matthias BarkowskyHasso Plattner Institute, University of Potsdam, Germany, Thomas Brand, Holger GieseHasso Plattner Institute, University of Potsdam
14:45
5m
Paper
RDMSim: An Exemplar for Evaluation and Comparison of Decision-Making Techniques for Self-AdaptationArtifact Paper
SEAMS 2021
14:50
35m
Live Q&A
Session 7 - Discussion
SEAMS 2021
15:30 - 16:30
Keynote 2SEAMS 2021 at SEAMS Room
Chair(s): Raffaela MirandolaPolitecnico di Milano
15:30
60m
Keynote
Uncertain models of unknown realities: modelling and simulating complex biological systemsKeynote
SEAMS 2021
A: Fiona PolackKeele University
16:35 - 17:30
Session 8: Cyber-Physical SystemsSEAMS 2021 at SEAMS Room
Chair(s): Luciano BaresiPolitecnico di Milano
16:35
5m
Paper
The Concept of an Autonomic Avionics Platform and the Resulting Software Engineering ChallengesShort Paper
SEAMS 2021
Pre-print
16:40
5m
Paper
Analysis and Monitoring of Cyber-Physical Systems via Environmental Domain Knowledge & ModelingShort Paper
SEAMS 2021
Byron DevriesGrand Valley State University, Erik FredericksGrand Valley State University, Betty H.C. ChengMichigan State University
16:45
5m
Paper
RoboMAX: Robotic Mission Adaptation eXemplarsArtifact Paper
SEAMS 2021
Mehrnoosh AskarpourMcMaster University, Christos TsigkanosTU Vienna, Claudio MenghiUniversity of Luxembourg, Radu CalinescuUniversity of York, UK, Patrizio PelliccioneGran Sasso Science Institute (GSSI) and Chalmers | University of Gothenburg, Sergio Garcia, Ricardo CaldasChalmers, Tim J. von Oertzen, Manuel WimmerJKU Linz, Luca BerardinelliJohannes Kepler University Linz, Matteo RossiPolitecnico di Milano, Marcello M. BersaniPolitecnico di Milano, Gabriel S. RodriguesUniversity of Brasília, Brazil
16:50
35m
Live Q&A
Session 8 - Discussion
SEAMS 2021
17:30 - 18:00
Closing and AwardsSEAMS 2021 at SEAMS Room
Chair(s): Rogério de LemosUniversity of Kent, UK

Not scheduled yet

Not scheduled yet
Break
Virtual Coffee Break 1
SEAMS 2021
Not scheduled yet
Break
Virtual Coffee Break 2
SEAMS 2021
Not scheduled yet
Social Event
Social Event
SEAMS 2021
Not scheduled yet
Talk
Virtual Coffee Break 5
SEAMS 2021
Not scheduled yet
Break
Virtual Coffee Break 4
SEAMS 2021
Not scheduled yet
Break
Virtual Coffee Break 7
SEAMS 2021
Not scheduled yet
Break
Virtual Coffee Break 6
SEAMS 2021
Not scheduled yet
Day opening
SEAMS Opening
SEAMS 2021
Not scheduled yet
Break
Virtual Coffee Break 3
SEAMS 2021

Call for Papers

Modern and emerging software systems, such as industrial Internet of Things, Cyber-Physical Systems, cloud and edge computing, robotics, and smart environments have to operate without violating their quality requirements. Self-adaptation and self-management enable these systems to adapt themselves at runtime to preserve and optimize their operation in the presence of uncertain changes in their operating environment, resource variability, evolving user needs, attacks, intrusions, and faults. Approaches to augment software and software-controlled systems with self-managing and self-adaptive capabilities are an important area of research and development, offering solutions that leverage advances in fields such as software architecture, fault-tolerant computing, programming languages, run-time program analysis and verification, among others. Additionally, research in this field is informed by related areas such as control systems, machine learning, artificial intelligence, agent-based systems, and biologically inspired computing. SEAMS focuses on applying software engineering to these approaches, including methods, techniques, processes and tools that can be used to support self-* properties, like, self-protection, self healing, self-optimization, and self-configuration. The objective of SEAMS is to bring together researchers and practitioners from academia, industry and government, to investigate, discuss, examine and advance the fundamental principles, the state of the art, and the solutions addressing critical challenges of engineering self-adaptive and self-managing systems.

Topics of Interest:

All topics related to engineering self-adaptive and self-managing systems, including:

Foundational Concepts

  • Self-* properties
  • Understanding and taming uncertainty
  • Runtime models and variability
  • Mixed-initiative and human-in-the-loop systems
  • Situational awareness
  • Ethical challenges of self-adaptive systems

Engineering Strategies

  • Control theory
  • Online analysis and planning
  • Decentralized control
  • Automatic synthesis techniques
  • AI techniques
  • Search-based techniques and learning
  • Simulation

Engineering Activities

  • Domain/environment analysis techniques
  • Requirements elicitation techniques
  • Architecture and design techniques
  • Verification and validation activities & frameworks
  • Systematic reuse (patterns, viewpoints, reference architectures, code, etc.)
  • Instrumentation of legacy systems (probing and effecting)
  • Processes and methodologies

Languages

  • Formal notations for modeling and analyzing self-* properties
  • Domain-specific language support for self-adaptation
  • Programming language support for self-adaptation

Application Areas

  • Industrial Internet of Things
  • Cyber-physical systems
  • Cloud, fog and edge computing
  • Bioengineering
  • Robotics
  • Smart environments
  • Smart user interfaces
  • Privacy and security

Types of Papers:

SEAMS 2021 solicits the following types of papers:

  • Long papers (10 pages main text, inclusive of figures, tables, appendices, etc.; plus references up to two additional pages): papers offering novel and mature research contributions, including:

    • Technical papers that clearly describe an innovative and original technical contribution.
    • Empirical study that evaluates or compares existing techniques or derives relevant findings using a research method (experiment, survey, case study, grounded theory, …).
    • Literature review on a research topic in the field.

    Authors of long papers are encouraged to submit their supplementary material for recognition of artifacts that are functional, reusable, available, replicated, or reproduced. Accepted long papers whose supplementary material has been evaluated positively will receive corresponding artifact badges. To submit supplementary material, an extra one page abstract (not included in the proceedings) should be attached to the submitted long paper, which describes the material, provides information to access the material, supports the evaluation of the material, and justifies why the material deserves the badges the authors are applying for.

  • Short papers (6 pages + 1 page references): papers that have smaller scope and/or contribution. This type of papers also includes:

    • New Ideas and Emergent Results (NIER) papers, which describe novel and promising ideas and/or techniques that are in an early stage of development.
    • Experience papers that describe the experiences gained from applying/evaluating software engineering research results in practice.
    • Artifact papers, which describe model problems, exemplars, or sets of resources (e.g., data sets, tools, and frameworks) that are useful for the broader SEAMS community to develop, evaluate, and compare self-adaptation approaches. Please, check the specific call for this type of paper at following link
  • Demo papers (2 pages + 1 page references): papers that should demonstrate the use of self-adaptive software in a proof-of-concept, prototype or real-world application. The paper should contain a URL to a demonstration video of no more than five minutes in duration explaining the working of the application.

  • Community debate papers (2 pages including references): Researchers who want to participate in the community debate (see above) are invited to write a motion either in favour or against the statement “handling unanticipated changes is the ultimate challenge for self-adaptation.”

Accepted papers will appear in the SEAMS 2021 proceedings that will be published in the IEEE and ACM digital libraries. The official publication date is the first day of the conference. The official publication date affects the deadline for any patent filings related to published work. Purchases of additional pages in the proceedings are not allowed.

Conference Attendance Expectation

If a submission is accepted, at least one author of the paper is required to register for and attend SEAMS 2021 and present the paper. The presentation is expected to be delivered in person, unless this is impossible due to travel limitations (related to, e.g., health, visa, or COVID-19 prevention).

Accepted Papers

Title
"Know What You Know": Predicting Behavior for Learning-Enabled Systems When Facing UncertaintyLong Paper
SEAMS 2021
A Conceptual Reference Model for Human as a Service Provider in Cyber Physical SystemsLong Paper
SEAMS 2021
Adaptation to Unknown Situations as the Holy Grail of Learning-Based Self-Adaptive Systems: Research DirectionsCommunity Debate Paper
SEAMS 2021
Pre-print
Analysis and Monitoring of Cyber-Physical Systems via Environmental Domain Knowledge & ModelingShort Paper
SEAMS 2021
Body Sensor Network: A Self-Adaptive System Exemplar in the Healthcare DomainArtifact Paper
SEAMS 2021
Pre-print Media Attached
Change Is the Ultimate Self-Adaptive ChallengeCommunity Debate Paper
SEAMS 2021
Link to publication Pre-print
Decentralized Self-Adaptive Systems: A Mapping StudyLong Paper
SEAMS 2021
Pre-print
Enhancing Human-in-the-Loop Adaptive Systems through Digital Twins and VR InterfacesLong Paper
SEAMS 2021
Pre-print
Federated Machine Learning as a Self-adaptive ProblemShort Paper
SEAMS 2021
Hey! Preparing Humans to do Tasks in Self-adaptive SystemsLong Paper
SEAMS 2021
How do we Evaluate Self-adaptive Software Systems?Long Paper
SEAMS 2021
Pre-print
If a System is Learning to Self-adapt, Who's Teaching?Community Debate Paper
SEAMS 2021
Incremental Runtime Model Queries and Adaptive MonitoringShort Paper
SEAMS 2021
Is this all about handling unanticipated changes or about foreseeing what needs handling?Community Debate Paper
SEAMS 2021
Maintaining driver attentiveness in shared-control autonomous drivingShort Paper
SEAMS 2021
Most Influential Paper: SEAMS 2009
SEAMS 2021
On Adaptive Fairness in Software SystemsShort Paper
SEAMS 2021
Pre-print
On the Impact of Applying Machine Learning in the Decision-Making of Self-Adaptive SystemsShort Paper
SEAMS 2021
Pre-print
Platooning LEGOs: An Open Physical Exemplar for Engineering Self-Adaptive Cyber-Physical Systems-of-SystemsArtifact Paper
SEAMS 2021
Predict the Future: Preventing unanticipated changes is the ultimate challenge for self-adaptive systemsCommunity Debate Paper
SEAMS 2021
RDMSim: An Exemplar for Evaluation and Comparison of Decision-Making Techniques for Self-AdaptationArtifact Paper
SEAMS 2021
ReSonAte: A Runtime Risk Assessment Framework for Autonomous SystemsLong Paper
SEAMS 2021
Reliability Prediction of Self-Adaptive Systems Managing Uncertain AI Black-Box ComponentsShort Paper
SEAMS 2021
RoboMAX: Robotic Mission Adaptation eXemplarsArtifact Paper
SEAMS 2021
Run-time Reasoning from Uncertain Observations with Subjective Logic in Multi-Agent Self-Adaptive Cyber-Physical SystemsLong Paper
SEAMS 2021
Pre-print
Seamless Reconfiguration of Rule-based IoT ApplicationsShort Paper
SEAMS 2021
Self-Adaptation 2.0Community Debate Paper
SEAMS 2021
Self-Adaptive Manufacturing with Digital TwinsLong Paper
SEAMS 2021
Self-Adaptive Microservice-based Systems - Landscape and Research OpportunitiesLong Paper
SEAMS 2021
Pre-print
Self-adaptive and Interconnected Gamified Applications to Reach the Common Good: Research Challenges AheadShort Paper
SEAMS 2021
The Concept of an Autonomic Avionics Platform and the Resulting Software Engineering ChallengesShort Paper
SEAMS 2021
Pre-print
The Design Space of Emergent Scheduling for Distributed Execution FrameworksLong Paper
SEAMS 2021
The Hitchhiker's Guide to the End-of-Life for Smart DevicesShort Paper
SEAMS 2021
The Unknown Unknowns Are Not Totally UnknownCommunity Debate Paper
SEAMS 2021
Pre-print
Threat models at run time: the case for reflective and adaptive threat managementShort Paper
SEAMS 2021
Towards Better Adaptive Systems by Combining MAPE, Control Theory, and Machine LearningShort Paper
SEAMS 2021
Pre-print
Towards a Self-Adaptive Architecture for Federated Learning of Industrial Automation SystemsShort Paper
SEAMS 2021

SEAMS 2021 continues to encourage its community members to build dedicated artifacts that support driving, communicating, comparing, and evaluating their research on software engineering for adaptive and self-managing systems. In this spirit, the SEAMS 2021 artifacts track exists to review, promote, share, and catalog research artifacts that bring value to the community.

NOTE: While this call is about dedicated artifacts, we also encourage authors to submit supplementary material together with their long research papers to SEAMS 2021. In this case, long papers accepted at SEAMS 2021 will be awarded with badges if the reviewers of the paper evaluate positively the supplementary material. Please check the SEAMS 2021 Call for Papers for how to submit supplementary material.

Types of Artifacts

According to ACM’s "Artifact Review and Badging (Version 1.1)” policy, an artifact is “a digital object that was either created by the authors to be used as part of the study or generated by the experiment itself. For example, artifacts can be software systems, scripts used to run experiments, input datasets, raw data collected in the experiment, or scripts used to analyze results.” A formal review of such artifacts promotes artifacts of high quality that promotes reproducibility and replicability of research results and that drive the research of the whole SEAMS community. Hence, artifacts of interest for SEAMS include but are not limited to:

  • Testbeds / Exemplars, which are implementations or detailed specifications of systems that pose and highlight fundamental or characteristic challenges in this community, and that self-adaptive systems should address.
  • Datasets, which are data (e.g., logging data, sensor data, system traces, survey raw data) that can be used to develop, evaluate, and compare self-adaptation approaches.
  • Frameworks, which are tools and services illustrating and implementing self-adaptation techniques or algorithms that are potentially useful in different contexts and that other researchers could use and customize to specific contexts.

Thus, frameworks primarily support developing self-adaptation approaches whereas testbeds / exemplars and datasets particularly support evaluating and comparing different approaches. However, this list is not exhaustive. If your proposed artifact is not on this list, please email the Artifacts Chair before submitting.

Quality of Artifacts

According to the ACM’s "Artifact Review and Badging (Version 1.1)” policy, SEAMS aims for artifacts that are available and reusable so that other researchers can access and built upon the artifacts to drive research in the overall SEAMS community. Thus, artifacts have to be made permanently available—latest after acceptance and before publication of the artifact—using publisher repositories (ACM or IEEE), institutional repositories, or open (commercial) repositories (e.g., figshare, Zenodo, or GitHub/Zenodo) that provide permanent and unique identifiers for the artifacts. Personal web pages are not acceptable for this purpose. Moreover, artifacts should be reusable by other researchers. To facilitate reuse, they should be carefully documented, well-structured, complete, exercisable, as well as appropriately verified and validated (e.g., use of the artifact in a study).

Note that if your work is not at a stage of development where it can be released as an artifact usable by the broader SEAMS community, you should consider submitting a demo paper to SEAMS 2021.

Submission of Artifacts

Submission includes an artifact paper and the artifact itself. The paper should be submitted via EasyChair (https://easychair.org/conferences/?conf=seams2021). The artifact can also be submitted via EasyChair, or preferably via a link provided in the paper. Artifacts must not have been previously published or concurrently submitted elsewhere.

Artifact Paper

An artifact paper is of max 6 pages + 1 page references. It should include a synopsis or description of the problem that is being addressed, a description of the context(s) in which the artifact would be useful, a list of the challenges that it poses for self-adaptation, and examples of its use in at least one area of self-adaptive systems. Accepted artifact papers will be included in the proceedings, and authors will be given an opportunity to present their artifact at SEAMS 2021.

Artifact papers must conform to the IEEE formatting instructions IEEE Conference Proceedings Formatting Guidelines (title in 24pt font and full text in 10pt type, LaTeX users must use \documentclass[10pt,conference]{IEEEtran} without including the compsoc or compsocconf options).

There will be a best artifact award recognizing the work of authors who contribute the most useful artifact to the community. Moreover, we will do our best to work with the IEEE Xplore and ACM Portal administrator to add badges to the electronic versions of the authors’ paper(s).

Artifact

Authors must perform the following steps to submit an artifact:

Packaging the Artifact

When packaging your artifact, it is important to keep in mind: a) how accessible the artifact is to other researchers, and b) the fact that the artifact evaluators have very limited time to assess each artifact. The setup for your artifact should take less than 30 minutes or it is unlikely to be endorsed simply because the committee will not have sufficient time to evaluate it. If you envision difficulties, please provide your artifact with a working environment in a VirtualBox VM image or a Docker container image so that the artifact can be run and exercised. Otherwise, the artifact can be packaged in a single archive file (zip or tar.gz) or its code base can be provided by a public repository.

In either case, the artifact should be exercisable and appropriately validated.

Making the Artifact Available

Regardless of the packaging, the artifact should be made available to the artifact reviewers through a link to a public repository (e.g., GitHub) or to a single archive file.

Latest after acceptance and before publication of artifacts in the SEAMS 2021 program, artifacts have to be made permanently available to the public using an archival repository (e.g., publisher repositories at ACM or IEEE, institutional repositories, or open (commercial) repositories such as figshare and Zenodo). For instance, Zenodo supports archiving snapshots of GitHub repositories and provides DOIs for such snapshots.

Documenting the Artifact

To facilitate reuse, an artifact should be complete and carefully documented. Therefore, it must:

  • be self-contained, that is, it contains the artifact itself, which may include source code, executables, data, a virtual machine image, documents and other content deemed relevant by the authors. Please use open formats for documents (e.g., csv for data). Publicly available external tools or libraries used to exercise and use the artifact do not have to be included in the artifact;
  • include a documentation that fully describes the artifact and especially the following information:
  • a Getting Started section that should stress the key elements of your artifact and that should enable the reviewers to run, execute or analyze your artifact without any technical difficulty. In this context, requirements and side effects of running the artifact should be discussed.
  • a Step-by-Step Instructions section on how you propose to evaluate your artifact, e.g., a tutorial-style document describing how to download, install, run, and “play” the artifact, and how to check the results of the execution.
  • where appropriate, descriptions of and links to files (included in the archive or generated by executing the artifact) that represent expected outputs (e.g., the log files expected to be generated by the artifact on the given inputs).
  • if applicable, descriptions of how the artifact can be customized and extended to be reused in a different research context of self-adaptive systems.
  • include a license file or statement describing the distribution rights. Note that a reusable artifact requires some of open source license.

Optionally, the authors are encouraged to submit a link to a short video (YouTube, max. 5 minutes) demonstrating the artifact.

Review Process and Selection Criteria

All submitted artifact will be reviewed by at least three members of the program committee. Each artifact will be evaluated in relation to the expectations set by the artifact paper. In addition to just running the artifact, the evaluators will read the paper and may try to tweak provided inputs and create new ones, to test the limits of the system.

Artifacts will be evaluated using the following criteria: * Community value: Does the artifact bring value to the SEAMS community? Is this value clearly explained in the paper? Can the artifact be readily used by other researchers? * Insightfulness: Does the artifact address or identify a gap in previous work? * Timeliness: Does the artifact address a problem that is timely? * Usability: Is it complete and easy to understand? Is it carefully documented and well-structured? Is it accompanied by tutorial notes? and other documentation? Is it exercisable? If the artifact is executable, is it easy to download, install, and execute? Has it been validated? Is it functional? Is it reusable?

Paper Submission Details and Review Process

All submitted papers and artifacts will be reviewed by at least three members of the program committee. Papers must not have been previously published or concurrently submitted elsewhere.

Submissions must conform to the IEEE formatting instructions IEEE Conference Proceedings Formatting Guidelines (title in 24pt font and full text in 10pt type, LaTeX users must use \documentclass[10pt,conference]{IEEEtran} without including the compsoc or compsocconf options).

Papers must be submitted via EasyChair: https://easychair.org/conferences/?conf=seams2021

All types of papers should be submitted via EasyChair. Community debate and Artifact papers should be submitted to their respective tracks, and all the other types of papers should be submitted to the Main track.

By submitting to SEAMS, authors acknowledge that they are aware of and agree to be bound by the ACM Policy and Procedures on Plagiarism and the IEEE Plagiarism FAQ. In particular, papers submitted to SEAMS 2021 must not have been published elsewhere and must not be under review or submitted for review elsewhere whilst under consideration for SEAMS 2021. Contravention of this concurrent submission policy will be deemed a serious breach of scientific ethics, and appropriate action will be taken in all such cases. To check for double submission and plagiarism issues, the chairs reserve the right to (1) share the list of submissions with the PC Chairs of other conferences with overlapping review periods and (2) use external plagiarism detection software, under contract to the ACM or IEEE, to detect violations of these policies. By submitting to the SEAMS, authors acknowledge that they conform to the authorship policy of the ACM, and the authorship policy of the IEEE.