SEAMS 2020
Mon 29 June - Fri 3 July 2020
co-located with ICSE 2020

The main goal of any feedback control system is essentially to remove humans from the loop. This has always been the goal in the engineering of control systems. The MAPE-K loop is the embodiment of a feedback control loop in self-adaptive software systems, but the complete removal of humans from the control loop has not been thoroughly debated. One of the reasons is that, software systems are social-technical systems, and as such, humans need to be considered right from the inception of such systems, otherwise their deployment is bound to fail. However, as software self-adaptation progresses, enabling to place higher assurances on the deployment of these systems to the point humans become dispensable, some ethical questions need to be raised. Similar questions have been raised in past when the first automatic systems became intrinsic to the industrial fabric. The difference between then and now is that then the impact was confined to portions of the society, but now the implications are much wider, if we consider, in particular, software systems that are able to change themselves. If humans are not aware of those changes, and their implications, humans cease to be in tune with the system they are operating, and inevitably accidents will ensue. The point of no return in self-adaptive software systems refers to the moment in their technical maturity when any human involvement with the operation of a system is perceived to create more harm than benefit. Confronted with this situation, software engineers need start asking themselves some basic ethical questions. Do we really need to consider humans as an integral part of self-adaptive software systems? If humans are removed from the control loop, what kind of assurances will be needed for society to accept such systems?

Fri 3 Jul

Displayed time zone: (UTC) Coordinated Universal Time change

14:00 - 15:20
Session 6: Ethical Concerns of Self-Adaptive SystemsSEAMS 2020 at SEAMS
Chair(s): Paola Inverardi University of L'Aquila
14:00
5m
Talk
Towards a Code of Ethics for Autonomous and Self-Adaptive SystemsEthical
SEAMS 2020
Danny Weyns KU Leuven
Pre-print Media Attached
14:05
5m
Talk
Human in the Loop: What is the Point of no Return?Ethical
SEAMS 2020
Rogério de Lemos University of Kent, UK
Pre-print Media Attached
14:10
70m
Other
Panel and Discussion
SEAMS 2020