Write a Blog >>
ASE 2021
Sun 14 - Sat 20 November 2021 Australia

[ROSE REPORT]: The artifact is being submitted as part of the ROSE initiative. The ROSE team reads papers from SE conferences looking for examples of reuse of tools as well as data sets, methodology, innovative statistical methods, etc. Also, for papers comparing one algorithm to another (e.g. in optimization, data mining, and theorem proving work) we search for “stepping stone” reuse; I.e. (a) some new paper has surveyed the related work to declare that some other algorithm from another paper is the prior state of the art; (b) the new paper then runs that prior method (as a baseline); (c) new results from new algorithms are then compared against the baseline.

If the new paper reuses something from an older paper, using code from that older paper, then REPRODUCTION of the claim that some prior method is useful for some task. If the new paper implements their own version of the older idea, then that is a REPLICATION of the claim that some prior method is useful for some task.

As part of that work, we report here the following example of REPLICATION. The original paper is a prior work about multi-objective genetic algorithm by Deb et al. The paper “Model-Based Exploration of the Frontier of Behaviours for Deep Learning System Testing” by Riccio et al. replicated the work in the original paper.