Valg: A Fast Reinforcement Learning-Based Runtime Verification Tool for Java
Runtime Verification (RV) dynamically monitors whether traces—sequences of events like method calls—violate formal specifications. RV is effective at bug finding, but incurs high runtime overheads. Prior work showed that 99.87% of monitors are redundant as they observe the same trace as the other 0.13%. So, we recently proposed a novel approach based on reinforcement learning (RL) to speed up RV by reducing redundant monitoring. We present Valg, a tool that implements that approach for Java. Compared to our prototype, Valg adds (i) per-spec hyperparameters, (ii) RL trajectory saving, (iii) offline hyperparameter tuning, and (iv) performance optimizations. Also, we integrate Valg with the main development branch of JavaMOP and TraceMOP, two state-of-the-art RV tools, and fix a long-standing specification bug. We evaluate Valg on 40 open-source projects, and Valg with per-spec hyperparameters is up to 58.7 percentage points (pp) and 89.7pp faster than our prototype, and Valg checks up to 44.8pp more unique traces. Valg’s offline hyperparameter tuning and our optimizations make JavaMOP, TraceMOP, and Valg faster. Valg is open-sourced at https://github.com/SoftEngResearch/tracemop, and a video demo can be found at: https://youtu.be/_QCyHaa_ICc.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Testing and Analysis 9Research Track / Journal-first Papers / Demonstrations / New Ideas and Emerging Results (NIER) at Oceania II Chair(s): Shiyi Wei University of Texas at Dallas | ||
11:00 15mTalk | GUISpector: An MLLM Agent Framework for Automated Verification of Natural Language Requirements in GUI Prototypes Demonstrations Kristian Kolthoff Institute for Software and Systems Engineering, Clausthal University of Technology, Felix Kretzer human-centered systems Lab (h-lab), Karlsruhe Institute of Technology (KIT) , Simone Paolo Ponzetto Data and Web Science Group, University of Mannheim, Alexander Maedche human-centered systems Lab (h-lab), Karlsruhe Institute of Technology (KIT) , Christian Bartelt Institute for Software and Systems Engineering, TU Clausthal Pre-print Media Attached | ||
11:15 15mTalk | Valg: A Fast Reinforcement Learning-Based Runtime Verification Tool for Java Demonstrations Shinhae Kim Cornell University, Saikat Dutta Cornell University, Owolabi Legunsen Cornell University | ||
11:30 15mTalk | Quantum Neural Network Classifier for Cancer Registry System Testing: A Feasibility Study Journal-first Papers Xinyi Wang Simula Research Laboratory; University of Oslo, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Paolo Arcaini National Institute of Informatics, Narasimha Raghavan Veeraragavan Cancer Registry of Norway and Norwegian Institute of Public Health, Jan F. Nygård Cancer Registry of Norway Link to publication DOI | ||
11:45 15mTalk | Testora: Using Natural Language Intent to Detect Behavioral Regressions Research Track Michael Pradel CISPA Helmholtz Center for Information Security | ||
12:00 15mTalk | Automatic Validation of LLM-Generated Code with Prompt Paraphrasing New Ideas and Emerging Results (NIER) | ||
12:15 15mTalk | Causally Perturbed Fairness Testing Journal-first Papers | ||