DeepLV: Suggesting Log Levels Using Ordinal Based Neural NetworksTechnical Track
Thu 27 May 2021 02:50 - 03:10 at Blended Sessions Room 3 - 2.3.3. Software Log Analysis
Developers write logging statements to generate logs that provide valuable runtime information for debugging and maintenance of software systems. Log level is an important component of a logging statement, which enables developers to control the information to be generated at system runtime. However, due to the complexity of software systems and their runtime behaviors, deciding a proper log level for a logging statement is a challenging task. For example, choosing a higher level (e.g., error) for a trivial event may confuse end users and increase system maintenance overhead, while choosing a lower level (e.g., trace) for a critical event may prevent the important execution information to be conveyed opportunely. In this paper, we tackle the challenge by first conducting a preliminary manual study on the characteristics of log levels. We find that the syntactic context of the logging statement and the message to be logged might be related to the decision of log levels, and log levels that are further apart in order (e.g., trace and error) tend to have more differences in their characteristics. Based on this, we then propose a deep-learning based approach that can leverage the ordinal nature of log levels to make suggestions on choosing log levels, by using the syntactic context and message features of the logging statements extracted from the source code. Through an evaluation on nine large-scale open source projects, we find that: 1) our approach outperforms the state-of-the-art baseline approaches; 2) we can further improve the performance of our approach by enlarging the training data obtained from other systems; 3) our approach also achieves promising results on cross-system suggestions that are even better than the baseline approaches on within-system suggestions. Our study highlights the potentials in suggesting log levels to help developers make informed logging decisions.
Wed 26 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:30 - 15:25 | 2.3.3. Software Log AnalysisNIER - New Ideas and Emerging Results / Technical Track at Blended Sessions Room 3 +12h Chair(s): Silverio Martínez-Fernández UPC-BarcelonaTech | ||
14:30 20mPaper | Semi-supervised Log-based Anomaly Detection via Probabilistic Label EstimationTechnical Track Technical Track Lin Yang College of Intelligence and Computing, Tianjin University, Junjie Chen College of Intelligence and Computing, Tianjin University, Zan Wang College of Intelligence and Computing, Tianjin University, Weijing Wang College of Intelligence and Computing, Tianjin University, Jiajun Jiang College of Intelligence and Computing, Tianjin University, Xuyuan Dong Information and Network Center,Tianjin University, Wenbin Zhang Information and Network Center,Tianjin University Pre-print Media Attached | ||
14:50 20mPaper | DeepLV: Suggesting Log Levels Using Ordinal Based Neural NetworksTechnical Track Technical Track Zhenhao Li Concordia University, Heng Li Polytechnique Montréal, Tse-Hsun (Peter) Chen Concordia University, Weiyi Shang Concordia University Pre-print Media Attached | ||
15:10 15mShort-paper | On Automatic Parsing of Log RecordsNIER NIER - New Ideas and Emerging Results Pre-print Media Attached |
Thu 27 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
02:30 - 03:25 | 2.3.3. Software Log AnalysisTechnical Track / NIER - New Ideas and Emerging Results at Blended Sessions Room 3 | ||
02:30 20mPaper | Semi-supervised Log-based Anomaly Detection via Probabilistic Label EstimationTechnical Track Technical Track Lin Yang College of Intelligence and Computing, Tianjin University, Junjie Chen College of Intelligence and Computing, Tianjin University, Zan Wang College of Intelligence and Computing, Tianjin University, Weijing Wang College of Intelligence and Computing, Tianjin University, Jiajun Jiang College of Intelligence and Computing, Tianjin University, Xuyuan Dong Information and Network Center,Tianjin University, Wenbin Zhang Information and Network Center,Tianjin University Pre-print Media Attached | ||
02:50 20mPaper | DeepLV: Suggesting Log Levels Using Ordinal Based Neural NetworksTechnical Track Technical Track Zhenhao Li Concordia University, Heng Li Polytechnique Montréal, Tse-Hsun (Peter) Chen Concordia University, Weiyi Shang Concordia University Pre-print Media Attached | ||
03:10 15mShort-paper | On Automatic Parsing of Log RecordsNIER NIER - New Ideas and Emerging Results Pre-print Media Attached |