Write a Blog >>
ICSE 2021
Sun 16 May - Sat 5 June 2021

This program is tentative and subject to change.

Thu 27 May 2021 15:45 - 16:05 at Blended Sessions Room 2 - 3.3.2. API: Development Chair(s): Carolyn Seaman
Fri 28 May 2021 03:45 - 04:05 at Blended Sessions Room 2 - 3.3.2. API: Development

Since the introduction of annotations in Java 5, the majority of testing frameworks, such as JUnit, TestNG, and Mockito, have adopted annotations in their core design. This adoption affected the testing practices in every step of the test lifecycle from fixture setup and test execution to fixture teardown. Despite the importance of test annotations, most research on test maintenance has mainly focused on test code quality and test assertions. As a result, there is little empirical evidence on the evolution and maintenance of test annotations. To fill this gap, we perform the first fine-grained empirical study on annotation changes. We developed a tool to mine 82, 810 commits and detect 23, 936 instances of test annotation changes from 12 open-source Java projects. Our main findings are: (1) Test annotation changes are more frequent than rename and type change refactorings. (2) We recover various migration efforts within the same testing framework or between different frameworks by analyzing common annotation replacement patterns. (3) We create a taxonomy by manually inspecting and classifying a sample of 368 test annotation changes, and documenting the motivations driving these changes. Finally, we present a list actionable implications for developers, researchers and framework designers.

This program is tentative and subject to change.

Thu 27 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

15:05 - 16:05
3.3.2. API: Development Technical Track / SEIP - Software Engineering in Practice at Blended Sessions Room 2 +12h
Chair(s): Carolyn SeamanUniversity of Maryland Baltimore County
15:05
20m
Paper
Unveiling the Mystery of API Evolution in Deep Learning Frameworks -- A Case Study of Tensorflow 2SEIP
SEIP - Software Engineering in Practice
Zejun ZhangZhejiang University, Yanming YangMonash University, Xin XiaMonash University, David LoSingapore Management University, Xiaoxue RenZhejiang University, John GrundyMonash University
Pre-print
15:25
20m
Paper
Domain-Specific Fixes for Flaky Tests with Wrong Assumptions on Underdetermined SpecificationsTechnical Track
Technical Track
Peilun ZhangUniversity of Illinois at Urbana-Champaign, Yanjie JiangBeijing Institute of Technology, Anjiang WeiPeking University, Victoria StoddenUniversity of Illinois at Urbana-Champaign, Darko MarinovUniversity of Illinois at Urbana-Champaign, August ShiThe University of Texas Austin
Pre-print
15:45
20m
Paper
Studying Test Annotation Maintenance in the WildTechnical Track
Technical Track
Dong Jae KimConcordia University, Nikolaos TsantalisConcordia University, Tse-Hsun (Peter) ChenConcordia University, Jinqiu YangConcordia University
Link to publication Pre-print

Fri 28 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

03:05 - 04:05
03:05
20m
Paper
Unveiling the Mystery of API Evolution in Deep Learning Frameworks -- A Case Study of Tensorflow 2SEIP
SEIP - Software Engineering in Practice
Zejun ZhangZhejiang University, Yanming YangMonash University, Xin XiaMonash University, David LoSingapore Management University, Xiaoxue RenZhejiang University, John GrundyMonash University
Pre-print
03:25
20m
Paper
Domain-Specific Fixes for Flaky Tests with Wrong Assumptions on Underdetermined SpecificationsTechnical Track
Technical Track
Peilun ZhangUniversity of Illinois at Urbana-Champaign, Yanjie JiangBeijing Institute of Technology, Anjiang WeiPeking University, Victoria StoddenUniversity of Illinois at Urbana-Champaign, Darko MarinovUniversity of Illinois at Urbana-Champaign, August ShiThe University of Texas Austin
Pre-print
03:45
20m
Paper
Studying Test Annotation Maintenance in the WildTechnical Track
Technical Track
Dong Jae KimConcordia University, Nikolaos TsantalisConcordia University, Tse-Hsun (Peter) ChenConcordia University, Jinqiu YangConcordia University
Link to publication Pre-print

Information for Participants
Info for Blended Sessions Room 2: