ICSE 2025 (series) / FTW 2025 (series) / 2nd International Flaky Tests Workshop 2025 (FTW 2025) /
On the Perception and Adoption of Flakiness Scores
Sun 27 Apr 2025 14:22 - 14:45 at 206 - Improving Flakiness Mitigation Techniques
The ``Assume all Tests are Flaky'' approach to handling test flakiness establishes it as a risk. Flakiness scores serve as the first frontier for handling that risk. In our previous work, we refined an existing flakiness score and demonstrated, using two artificial datasets, how this refined score could support 3 strategies for dealing with test flakiness; Fix, Rerun and Monitor. The question remains, how will this score, and flakiness scores in general, be applied in actual industrial settings? In this study, we, alongside software developers from two separate industrial companies, report our experience when transferring in-vitro flakiness scoring formulae to in-vivo industrial settings.
Sun 27 AprDisplayed time zone: Eastern Time (US & Canada) change
Sun 27 Apr
Displayed time zone: Eastern Time (US & Canada) change
14:00 - 15:30 | |||
14:00 22mPaper | Evaluating NonDex for Modern Java Ecosystem FTW Kaiyao Ke University of Illinois at Urbana-Champaign, Darko Marinov University of Illinois at Urbana-Champaign | ||
14:22 22mTalk | On the Perception and Adoption of Flakiness Scores FTW Joanna Kisaakye , Mutlu Beyazıt University of Antwerp and Flanders Make vzw, Serge Demeyer University of Antwerp and Flanders Make vzw | ||
14:45 22mPaper | Reduction of Test Re-runs by Prioritizing Potential Order Dependent Flaky Tests FTW Hasnain Iqbal University of Dhaka, Zerina Begum University of Dhaka, Kazi Sakib Institute of Information Technology, University of Dhaka | ||
15:07 22mPanel | Mini Panel 2 FTW |