Traditional rule-based approaches to system monitoring have many areas for improvement. Rules are time-consuming to maintain, and their ability to detect unforeseen future incidents is limited. Online log anomaly detection workflows have the potential to improve upon rule-based methods by providing fine-grained, automated detection of abnormal behavior. However, system and process logs are not static. Code and configuration changes may alter the sequences of log entries produced by these processes, impacting the models trained on their previous behavior. These changes result in false positive signals that can overwhelm production services engineers and drown out alerts for real issues. For this reason, log drift is a significant obstacle to utilizing online log anomaly detection approaches for monitoring in industrial settings. This study explores the types of log drift and classifies them using a newly introduced taxonomy. It evaluates the impact these types of drift have on online anomaly detection workflows. Several potential mitigation methods are presented and evaluated based on synthetic and real-world log data. Finally, possible directions for future research are provided and discussed.
Wed 13 DecDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 15:00 | Software Analysis and ToolsResearch Papers / Organization / Short Papers and Posters / Industry Papers at W211 Chair(s): Giuseppe Scanniello University of Salerno | ||
14:00 10mIndustry talk | Using AI-Based Code Completion for Domain Specific Languages Industry Papers Christina Piereder Software Competence Center Hagenberg GmbH, Verena Geist Software Competence Center Hagenberg GmbH, Michael Moser Software Competence Center Hagenberg GmbH, Günter Fleck Siemens Transformers Austria, Josef Pichler University of Applied Sciences Upper Austria | ||
14:10 10mResearch paper | Assessing IDEA Diagrams for Supporting Analysis of Capabilities and Issues in Technical Debt Management Research Papers Sávio Freire Federal Institute of Ceará, Verusca Rocha Federal University of Bahia, Manoel Mendonça Federal University of Bahia, Clemente Izurieta Montana State University, Carolyn Seaman University of Maryland Baltimore County, Rodrigo Spinola Virginia Commonwealth University | ||
14:20 10mShort-paper | Automatic Fixation of Decompilation Quirks Using Pre-Trained Language Model Short Papers and Posters Ryunosuke Kaichi Graduate School of Information Science and Technology, Osaka University, Shinsuke Matsumoto Osaka University, Shinji Kusumoto Osaka University | ||
14:30 10mResearch paper | Log Drift Impact on Online Anomaly Detection Workflows Research Papers Scott Lupton Waseda University, Hironori Washizaki Waseda University, Nobukazu Yoshioka Waseda University, Japan, Yoshiaki Fukazawa Waseda University | ||
14:40 10mIndustry talk | Leveraging Historical Data to Support User Story Estimation Industry Papers Aleksander Grzegorz Duszkiewicz Morningtrain ApS, Jacob Glumby Sørensen The Maersk Mc-Kinney Moller Institute, University of Southern Denmark, Niclas Johansen Morningtrain ApS, Henry Edison Blekinge Institute of Technology, Thiago Rocha Silva The Maersk Mc-Kinney Moller Institute, University of Southern Denmark | ||
14:50 10mResearch paper | Design Patterns Understanding and Use in the Automotive Industry: An Interview Study Research Papers Sushant Kumar Pandey Chalmers and University of Gothenburg, Sivajeet Chand Dept. of CSE Chalmers | University of Gothenburg, Sweden, Jennifer Horkoff Chalmers and the University of Gothenburg, Miroslaw Staron Chalmers University of Technology |