SEAMS 2019
Sat 25 - Sun 26 May 2019 Montreal, QC, Canada
co-located with ICSE 2019
Sun 26 May 2019 16:00 - 16:25 at Duluth - Assurance Chair(s): Radu Calinescu

Given the ever-increasing complexity of adaptable software systems and their commonly hidden internal information (e.g., software runs in the public cloud), machine learning based performance modeling has gained momentum for evaluating, understanding and predicting software performance, which facilitates better informed self-adaptations. As performance data accumulates during the run of the software, updating the performance models become necessary. To this end, there are two conventional modeling methods: the retrained modeling that always discard the old model and retrain a new one using all available data; or the incremental modeling that retains the existing model and tunes it using one newly arrival data sample. Generally, literature on machine learning based performance modeling for adaptable software chooses either of those methods according to a general belief, but they provide insufficient evidences or references to justify their choice. This paper is the first to report on a comprehensive empirical study that examines both modeling methods under distinct domains of adaptable software, 5 performance indicators, 8 learning algorithms and settings, covering a total of 1360 different conditions. Our findings challenge the general belief, which is shown to be only partially correct, and reveal some of the important, statistically significant factors that are often overlooked in existing work, providing evidence-based insights on the choice.

Sun 26 May

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 17:35
AssuranceSEAMS 2019 at Duluth
Chair(s): Radu Calinescu University of York, UK
16:00
25m
Talk
All Versus One: An Empirical Comparison on Retrained and Incremental Machine Learning for Modeling Performance of Adaptable SoftwareLong Paper
SEAMS 2019
Tao Chen Nottingham Trent University, UK and University of Birmingham, UK
16:25
25m
Talk
On the Practical Feasibility of Software Monitoring: a Framework for Low-impact Execution TracingLong Paper
SEAMS 2019
Jhonny Mertz Universidade Federal do Rio Grande do Sul, Ingrid Nunes Universidade Federal do Rio Grande do Sul (UFRGS), Brazil
16:50
15m
Talk
DARTSim: An Exemplar for Evaluation and Comparison of Self-Adaptation Approaches for Smart Cyber-Physical SystemsArtifactReusableBest Artifact Award
SEAMS 2019
Gabriel A. Moreno Carnegie Mellon University, USA, Cody Kinneer Carnegie Mellon University, Ashutosh Pandey Carnegie Mellon University, USA, David Garlan Carnegie Mellon University
Media Attached
17:05
15m
Talk
OCCI-compliant, fully causal-connected architecture runtime models supporting sensor managementArtifactFunctional
SEAMS 2019
Johannes Erbel , Thomas Brand , Holger Giese Hasso Plattner Institute, University of Potsdam, Jens Grabowski
17:20
15m
Talk
DingNet: A Self-Adaptive Internet-of-Things ExemplarArtifactFunctional
SEAMS 2019