Rethinking Performance Analysis for Configurable Software Systems: A Case Study from a Fitness Landscape Perspective
Modern software systems are often highly configurable to tailor varied requirements from diverse stakeholders. Understanding the mapping between configurations and the desired performance attributes plays a fundamental role in advancing the controllability and tuning of the underlying system, yet has long been a dark hole of knowledge due to its black-box nature. While there have been previous efforts in performance analysis for these systems, they analyze the configurations as isolated data points without considering their inherent spatial relationships. This renders them incapable of interrogating many important aspects of the configuration space like local optima. In this work, we advocate a novel perspective to rethink performance analysis—modeling the configuration space as a structured ``landscape''. To support this proposition, we designed GraphFLA, an open-source, graph data mining empowered fitness landscape analysis (FLA) framework. By applying this framework to $86$M benchmarked configurations from $32$ running workloads of $3$ real-world systems, we arrived at $6$ main findings, which together constitute a holistic picture of the landscape topography. We thoroughly discussed their implications on both configuration optimization and performance modeling.
Wed 25 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:00 - 12:15 | Systems and PerformanceResearch Papers at Aurora C Chair(s): Lars Grunske Humboldt-Universität zu Berlin | ||
11:00 25mTalk | Preventing Disruption of System Backup Against Ransomware Attacks Research Papers Yiwei Hou Tsinghua University, Lihua Guo Tsinghua University, Chijin Zhou Tsinghua University, Quan Zhang Tsinghua University, Wenhuan Liu Tsinghua University/Union Tech, Chengnian Sun University of Waterloo, Yu Jiang Tsinghua University DOI | ||
11:25 25mTalk | Rethinking Performance Analysis for Configurable Software Systems: A Case Study from a Fitness Landscape Perspective Research Papers Mingyu Huang University of Electronic Science and Technology of China, Peili Mao University of Electronic Science and Technology of China, Ke Li University of Exeter DOI | ||
11:50 25mTalk | Hulk: Exploring Data-Sensitive Performance Anomalies in DBMSs via Data-Driven Analysis Research Papers Zhiyong Wu Tsinghua University, China, Jie Liang , Jingzhou Fu School of Software, Tsinghua University, Mingzhe Wang Tsinghua University, Yu Jiang Tsinghua University DOI |
Aurora C is the third room in the Aurora wing.
When facing the main Cosmos Hall, access to the Aurora wing is on the right, close to the side entrance of the hotel.