PrioTestCI: Efficient Test Case Prioritization in GitHub Workflows for CI Optimization
This program is tentative and subject to change.
Continuous Integration (CI) is a widely adopted practice in software development to automatically verify code changes across diverse environments. However, executing the full test suite on every pull request update can lead to redundant runs, slower feedback loops, and inefficient utilization of CI resources. To tackle this issue, we present PrioTestCI, a prioritization technique within GitHub Actions that focuses on re-executing test cases that previously failed. If these prioritized tests succeed, the remaining tests proceed; otherwise, the workflow terminates early, saving computation resources and providing early feedback to developers. PrioTestCI uses commit-to-commit test result tracking to inform future test runs, effectively reducing unnecessary repetition and speeding up validation cycles. We evaluated our technique on the Pytest project, a real-world open-source project with an extensive test matrix. PrioTestCI led to a CI runtime reduction of 1h57m39s in comparison to the normal workflow, with individual configuration improvements ranging from 63.75% to 91.94% (81.55% on average). Demo video: https://youtu.be/_3CF9LJdv0I?si=XyE_8mBnDxk1lMnD Repository: https://github.com/ShubhamDesai/CI-Optimization
This program is tentative and subject to change.
Wed 19 NovDisplayed time zone: Seoul change
15:00 - 18:00 | |||
15:00 3hDemonstration | DSBox: A Data Selection Framework for Efficient Deep Code Learning Tool Demonstration Track | ||
15:00 3hDemonstration | OSSPREY: AI-Driven Forecasting and Intervention for OSS Project Sustainability Tool Demonstration Track Nafiz Imtiaz Khan Department of Computer Science, University of California, Davis, Priyal Soni University of California, Davis, Arjun Ashok University of California, Davis, Vladimir Filkov University of California at Davis, USA | ||
15:00 3hDemonstration | ORMorpher: An Interactive Framework for ORM Translation and Optimization Tool Demonstration Track Milan Abrahám Department of Software Engineering, Charles University, Pavel Koupil Charles University, Faculty of Mathematics and Physics | ||
15:00 3hDemonstration | PrioTestCI: Efficient Test Case Prioritization in GitHub Workflows for CI Optimization Tool Demonstration Track Shubham Vasudeo Desai North Carolina State University, Shonil Bhide North Carolina State University, Souhaila Serbout University of Zurich, Zurich, Switzerland, Luciano Marchezan DIRO, University of Montreal, Wesley Assunção North Carolina State University | ||
15:00 3hDemonstration | CLARA: A Developer’s Companion for Code Comprehension and Analysis Tool Demonstration Track Ahmed Adnan , Mushfiqur Rahman Bangladesh University of Business and Technology, saad sakib noor University of Dhaka, Kazi Sakib Institute of Information Technology, University of Dhaka | ||
15:00 3hDemonstration | CodeGenLink: A Tool to Find the Likely Origin and License of Automatically Generated Code Tool Demonstration Track Daniele Bifolco University of Sannio, Guido Annicchiarico University of Sannio, Italy, Pierluigi Barbiero University of Sannio, Italy, Massimiliano Di Penta University of Sannio, Italy, Fiorella Zampetti University of Sannio, Italy Pre-print Media Attached | ||
15:00 3hDemonstration | A Large-Scale Evolvable Dataset for Model Context Protocol Ecosystem and Security Analysis Tool Demonstration Track Zhiwei Lin National University of Singapore, Bonan Ruan National University of Singapore, Jiahao Liu National University of Singapore, Weibo Zhao National University of Singapore | ||
15:00 3hDemonstration | Evaluating Program Coverage for Code-Model Training Tool Demonstration Track | ||
15:00 3hDemonstration | BuilDroid: A Self-Correcting LLM Agent for Automated Android Builds Tool Demonstration Track Jaehyeon Kim New York University Abu Dhabi, Rui Rua New York University Abu Dhabi, Karim Ali NYU Abu Dhabi | ||
15:00 3hDemonstration | LitterBox+: An Extensible Framework for LLM-enhanced Scratch Static Code Analysis Tool Demonstration Track Benedikt Fein University of Passau, Florian Obermueller University of Passau, Gordon Fraser University of Passau Pre-print | ||
15:00 3hDemonstration | PyGress: Tool for Analyzing Progression of Code Proficiency in Python OSS Projects Tool Demonstration Track Rujiphart Charatvaraphan Faculty of Information and Communication Technology, Mahidol University, Bunradar Chatchaiyadech Faculty of Information and Communication Technology, Mahidol University, Thitirat Sukijprasert Faculty of Information and Communication Technology, Mahidol University, Chaiyong Rakhitwetsagul Mahidol University, Thailand, Morakot Choetkiertikul Mahidol University, Thailand, Raula Gaikovina Kula The University of Osaka, Thanwadee Sunetnanta Mahidol University, Kenichi Matsumoto Nara Institute of Science and Technology | ||
15:00 3hDemonstration | PyTrim: A Practical Tool for Reducing Python Dependency Bloat Tool Demonstration Track Konstantinos Karakatsanis Athens University of Economics and Business, Georgios Alexopoulos University of Athens, Ioannis Karyotakis Athens University of Economics and Business, Foivos Timotheos Proestakis Athens University of Economics and Business, Evangelos Talos Athens University of Economics and Business, Panos Louridas Athens University of Economics and Business, Dimitris Mitropoulos University of Athens | ||