ScalerEval: Automated and Consistent Evaluation Testbed for Auto-scalers in Microservices
Auto-scaling is an automated approach that dynamically provisions resources for microservices to accommodate fluctuating workloads. Despite the introduction of many sophisticated auto-scaling algorithms, evaluating auto-scalers remains time-consuming and labor-intensive, as it requires the implementation of numerous fundamental interfaces, complex manual operations, and in-depth domain knowledge. Besides, frequent human intervention can inevitably introduce operational errors, leading to inconsistencies in the evaluation of different auto-scalers. To solve these issues, we present ScalerEval, an end-to-end automated and consistent testbed for auto-scalers. ScalerEval integrates essential fundamental interfaces for implementation of auto-scalers and further orchestrates a complete evaluation workflow for researchers. The source code is publicly available at \href{https://github.com/WHU-AISE/ScalerEval}{https://github.com/WHU-AISE/ScalerEval} and the demo video is available at \href{https://youtu.be/HFxuXxNBTAM}{https://youtu.be/HFxuXxNBTAM}.
Thu 9 JulDisplayed time zone: Eastern Time (US & Canada) change
10:30 - 12:30 | Testing 3Research Papers / Industry Papers / Tool Demonstrations / Ideas, Visions and Reflections at MB 1.210 Chair(s): Nimmi Weeraddana University of Calgary, Canada | ||
10:30 20mTalk | ACME: Automated Clause Mapping Engine for Testing Emerging Database Systems Research Papers Yuancheng Jiang National University of Singapore, Jianing Wang Shandong University, Chuqi Zhang National University of Singapore, Roland H. C. Yap National University of Singapore, Zhenkai Liang National University of Singapore, Manuel Rigger National University of Singapore DOI Pre-print | ||
10:50 20mTalk | Interrogation Testing of CHC Solvers Research Papers David Kaindlstorfer TU Wien, Austria, Anastasia Isychev TU Wien, Valentin Wüstholz ConsenSys, Maria Christakis TU Wien Pre-print | ||
11:10 20mTalk | RAT: Retrieval-Augmented Testing of Certificate Revocation List Parsers in TLS Implementations Research Papers Chu Chen Qufu Normal University, Qianxin Cheng Qufu Normal University, Pinghong Ren Qufu Normal University, Hairong Yu Qufu Normal University, Cong Tian Xidian University, Zhenhua Duan Xidian University, Xu Lu Xidian University, Bin Yu Xidian University, WenSheng Wang Xidian University, Jin Liu Xi'an University of Technology Pre-print | ||
11:30 10mTalk | Software Testing Beyond Closed Worlds: Open-World Games as an Extreme Case Ideas, Visions and Reflections Yusaku Kato Ritsumeikan University, Norihiro Yoshida Ritsumeikan University, Erina Makihara Ritsumeikan University, Katsuro Inoue Ritsumeikan University Pre-print | ||
11:40 20mTalk | AstraGame: Effective and Efficient VLM Agent Serving for Large-Scale Game Testing in an Industry Setting Industry Papers Yuzhe Guo Peking University, Haochuan Lu Tencent, Mengzhou Wu Peking University, Ting Xiong Tencent Inc., Yuetang Deng Tencent, Dezhi Ran Peking University, Wei Yang UT Dallas, Tao Xie Peking University | ||
12:00 10mTalk | ScalerEval: Automated and Consistent Evaluation Testbed for Auto-scalers in Microservices Tool Demonstrations Shuaiyu Xie School of Computer Science, Wuhan University, China, Yang Luo Wuhan University, Yuzhen Tan Wuhan University, Yunqing Yong Wuhan University, Xiaosong Huang Peking University, Jian Wang Wuhan University, Bing Li Wuhan University | ||
12:10 20mTalk | WalleTruth: Visual-oriented Software Testing for Web3 Wallet Browser Extensions Research Papers Xiaohui Hu Huazhong University of Science and Technology, Ningyu He Hong Kong Polytechnic University, Haoyu Wang Huazhong University of Science and Technology DOI Authorizer link | ||