PerfCI: A Toolchain for Automated Performance Testing during Continuous Integration of Python Projects
Thu 24 Sep 2020 08:50 - 09:00 at Koala - Verification and Testing Chair(s): Jun Sun
Software performance testing is an essential quality assurance mechanism that can identify optimization opportunities. Automating this process requires strong tool support, especially in the case of Continuous Integration (CI) where tests need to run completely automatically and it is desirable to provide developers with actionable feedback. A lack of existing tools means that performance testing is normally left out of the scope of CI. In this paper, we propose a toolchain - PerfCI - to pave the way for developers to easily set up and carry out automated performance testing under CI. Our toolchain is based on allowing users to (1) specify performance testing tasks, (2) analyze unit tests on a variety of python projects ranging from scripts to full-blown flask-based web services, by extending a performance analysis framework (VyPR) and (3) evaluate performance data to get feedback on the code. We demonstrate the feasibility of our toolchain by using it on a web service running at the Compact Muon Solenoid (CMS) experiment at the world’s largest particle physics laboratory — CERN.
Wed 23 SepDisplayed time zone: (UTC) Coordinated Universal Time change
10:20 - 11:20 | |||
10:20 5mTalk | MetPurity: A Learning-Based Tool of Pure Method Identification for Automatic Test Generation Tool Demonstrations | ||
10:25 5mTalk | STIFA: Crowdsourced Mobile Testing Report Selection Based on Text and Image Fusion Analysis Tool Demonstrations Zhenfei Cao Nanjing University, Xu Wang Nanjing University, Shengcheng Yu Nanjing University, China, Yexiao Yun Nanjing University, Chunrong Fang Nanjing University, China | ||
10:30 5mTalk | ImpAPTr: A Tool For Identifying The Clues To Online Service Anomalies Tool Demonstrations hao wang , Guoping Rong Nanjing University, Yangchen Xu Nanjing University, Yong You Meituan-Dianping Group | ||
10:35 5mTalk | PerfCI: A Toolchain for Automated Performance Testing during Continuous Integration of Python Projects Tool Demonstrations Omar Javed Università della Svizzera italiana, Joshua Heneage Dawes University of Manchester and CERN, Marta Han University of Zagreb and CERN, Giovanni Franzoni CERN, Andreas Pfeiffer CERN, Giles Reger University of Manchester, Walter Binder University of Lugano, Switzerland | ||
10:40 5mTalk | Botsing, a Search-based Crash Reproduction Framework for Java Tool Demonstrations Pouria Derakhshanfar Delft University of Technology, Xavier Devroey Delft University of Technology, Annibale Panichella Delft University of Technology, Andy Zaidman Delft University of Technology, Arie van Deursen Delft University of Technology, Netherlands DOI Pre-print Media Attached | ||
10:45 5mTalk | Speeding up GUI Testing by On-Device Test Generation Tool Demonstrations Nataniel Borges Jr. CISPA Helmholtz Center for Information Security, Jenny Rau CISPA Helmholtz Center for Information Security, Andreas Zeller CISPA, Germany | ||
10:50 30mLive Q&A | Q&A or Discussion Tool Demonstrations | ||
Thu 24 SepDisplayed time zone: (UTC) Coordinated Universal Time change
08:00 - 09:00 | Verification and TestingTool Demonstrations / Industry Showcase / Research Papers at Koala Chair(s): Jun Sun Singapore Management University | ||
08:00 20mTalk | Attend and Represent: A Novel View on Algorithm Selection for Software Verification Research Papers | ||
08:20 20mTalk | Lightweight MBT Testing for National e-Health Portal in Norway Industry Showcase Davrondzhon Gafurov Norsk Helsenett SF, Margrete Sunde Grovan Norsk Helsenett SF, Margrete Sunde Grovan Norsk Helsenett SF | ||
08:40 10mTalk | Speeding up GUI Testing by On-Device Test Generation Tool Demonstrations Nataniel Borges Jr. CISPA Helmholtz Center for Information Security, Jenny Rau CISPA Helmholtz Center for Information Security, Andreas Zeller CISPA, Germany | ||
08:50 10mTalk | PerfCI: A Toolchain for Automated Performance Testing during Continuous Integration of Python Projects Tool Demonstrations Omar Javed Università della Svizzera italiana, Joshua Heneage Dawes University of Manchester and CERN, Marta Han University of Zagreb and CERN, Giovanni Franzoni CERN, Andreas Pfeiffer CERN, Giles Reger University of Manchester, Walter Binder University of Lugano, Switzerland | ||